Sep 23 14:25:21 devstack cinder-volume[75285]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 23 14:25:21 devstack cinder-volume[75285]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 23 14:25:21 devstack cinder-volume[75285]: we strongly recommend against using it for new projects. Sep 23 14:25:21 devstack cinder-volume[75285]: If you are already using Eventlet, we recommend migrating to a different Sep 23 14:25:21 devstack cinder-volume[75285]: framework. For more detail see Sep 23 14:25:21 devstack cinder-volume[75285]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 23 14:25:21 devstack cinder-volume[75285]: import eventlet # noqa Sep 23 14:25:24 devstack cinder-volume[75285]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 23 14:25:24 devstack cinder-volume[75285]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 23 14:25:24 devstack cinder-volume[75285]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 23 14:25:25 devstack cinder-volume[75285]: INFO dbcounter [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] Registered counter for database cinder Sep 23 14:25:25 devstack cinder-volume[75285]: DEBUG oslo_db.sqlalchemy.engines [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75285) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 14:25:25 devstack cinder-volume[75285]: DEBUG dbcounter [-] [75285] Writer thread running {{(pid=75285) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 23 14:25:25 devstack cinder-volume[75285]: INFO cinder.rpc [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 23 14:25:25 devstack cinder-volume[75285]: INFO cinder.rpc [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_db.sqlalchemy.engines [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75285) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 14:25:26 devstack cinder-volume[75285]: INFO cinder.volume.manager [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] Determined volume DB was empty at startup. Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG cinder.volume.manager [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75285) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 23 14:25:26 devstack cinder-volume[75285]: INFO cinder.volume.manager [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 23 14:25:26 devstack cinder-volume[75285]: WARNING stevedore.named [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 23 14:25:26 devstack cinder-volume[75285]: WARNING castellan.key_manager [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 23 14:25:26 devstack cinder-volume[75285]: WARNING cinder.keymgr.conf_key_mgr [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG cinder.volume.drivers.lvm [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75285) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_concurrency.processutils [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_concurrency.processutils [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] CMD "cinder-rtstool verify" returned: 0 in 0.391s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_db.sqlalchemy.engines [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75285) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 14:25:26 devstack cinder-volume[75285]: INFO cinder.rpc [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 23 14:25:26 devstack cinder-volume[75285]: INFO cinder.rpc [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 23 14:25:26 devstack cinder-volume[75285]: WARNING stevedore.named [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 23 14:25:26 devstack cinder-volume[75285]: WARNING castellan.key_manager [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 23 14:25:26 devstack cinder-volume[75285]: INFO cinder.volume.manager [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_db.sqlalchemy.engines [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75285) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 14:25:26 devstack cinder-volume[75285]: INFO oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] Starting 1 workers Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] Started child 75453 {{(pid=75285) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] Full set of CONF: {{(pid=75285) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] ******************************************************************************** {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] Configuration options gathered from: {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] ================================================================================ {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] allow_availability_zone_fallback = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] allow_compression_on_image_upload = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] allowed_direct_url_schemes = [] {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] api_rate_limit = True {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] auth_strategy = keystone {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] az_cache_duration = 3600 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] backend_availability_zone = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75453]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] backend_host = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] backend_name = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] backend_stats_polling_interval = 60 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] backup_api_class = cinder.backup.api.API {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] backup_name_template = backup-%s {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] backup_use_same_host = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] backup_use_temp_snapshot = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] chap_password = **** {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] chap_username = {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] cinder_internal_tenant_project_id = e43c14861cd0490cbe3f1660a41537bd {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] cinder_internal_tenant_user_id = 86da715c14a942a09f0363264393ee15 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] cloned_volume_same_az = True {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] cluster = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] compression_format = gzip {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] compute_api_class = cinder.compute.nova.API {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] config_dir = [] {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] config_source = [] {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] control_exchange = openstack {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] debug = True {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] default_availability_zone = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] default_group_type = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] default_volume_type = lvmdriver-1 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] disk_geometry = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] driver_client_cert = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] driver_client_cert_key = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] driver_data_namespace = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] driver_ssl_cert_path = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] driver_ssl_cert_verify = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] driver_use_ssl = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] enable_force_upload = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] enable_new_services = True {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] enable_unsupported_driver = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] enforce_multipath_for_image_xfer = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] filter_function = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] glance_api_insecure = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] glance_api_servers = ['http://192.168.122.235/image'] {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] glance_api_ssl_compression = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] glance_ca_certificates_file = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] glance_catalog_info = image:glance:publicURL {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] glance_certfile = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] glance_keyfile = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] glance_num_retries = 3 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] glance_request_timeout = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] goodness_function = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] graceful_shutdown_timeout = 5 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] group_api_class = cinder.group.api.API {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] host = devstack {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] image_compress_on_upload = True {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] image_conversion_address_space_limit = 1 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] image_conversion_cpu_limit = 60 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] image_conversion_disable = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] image_introspection_address_space_limit = 1 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] image_introspection_cpu_limit = 60 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] image_upload_use_cinder_backend = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] image_upload_use_internal_tenant = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] image_volume_cache_enabled = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] image_volume_cache_max_count = 0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] image_volume_cache_max_size_gb = 0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] init_host_max_objects_retrieval = 0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] instance_format = [instance: %(uuid)s] {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] iscsi_target_flags = {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] iscsi_write_cache = on {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] iser_helper = tgtadm {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] iser_ip_address = 192.168.122.235 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] iser_port = 3260 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] log_color = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] log_config_append = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] log_dir = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] log_file = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] log_options = True {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] log_rotate_interval = 1 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] log_rotate_interval_type = days {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] log_rotation_type = none {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] max_age = 0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] max_logfile_count = 30 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] max_logfile_size_mb = 200 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] max_over_subscription_ratio = 20.0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] message_reap_interval = 86400 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] message_ttl = 2592000 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] migration_create_volume_timeout_secs = 300 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] monkey_patch = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] monkey_patch_modules = [] {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] my_ip = 192.168.122.235 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] no_snapshot_gb_quota = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] num_iser_scan_tries = 3 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] num_shell_tries = 3 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] num_volume_device_scan_tries = 3 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] nvmeof_conn_info_version = 1 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] nvmet_ns_id = 10 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] nvmet_port_id = 1 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] osapi_max_limit = 1000 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] osapi_volume_ext_list = [] {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] osapi_volume_listen_port = 8776 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] osapi_volume_use_ssl = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] osapi_volume_workers = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] per_volume_size_limit = -1 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] periodic_fuzzy_delay = 60 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] periodic_interval = 60 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] public_endpoint = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] publish_errors = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] quota_backup_gigabytes = 1000 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] quota_backups = 10 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] quota_gigabytes = 1000 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] quota_groups = 10 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] quota_snapshots = 10 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] quota_volumes = 10 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] rate_limit_burst = 0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] rate_limit_except_level = CRITICAL {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75453]: INFO cinder.volume.manager [None req-6e18d309-782b-4ad2-b205-6c53fcee41c1 None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] rate_limit_interval = 0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-6e18d309-782b-4ad2-b205-6c53fcee41c1 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] reinit_driver_count = 3 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] replication_device = **** {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] report_discard_supported = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] report_interval = 120 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] reservation_clean_interval = 86400 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] reservation_expire = 86400 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] reserved_image_namespaces = [] {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] reserved_percentage = 0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] rpc_response_timeout = 120 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] run_external_periodic_tasks = True {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] scst_target_driver = iscsi {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] scst_target_iqn_name = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] service_down_time = 720 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] shell_completion = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] snapshot_name_template = snapshot-%s {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] snapshot_same_host = True {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] split_loggers = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] state_path = /opt/stack/data/cinder {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] storage_availability_zone = nova {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] storage_protocol = iSCSI {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] syslog_log_facility = LOG_USER {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] target_helper = lioadm {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] target_ip_address = 192.168.122.235 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] target_port = 3260 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] target_protocol = iscsi {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] target_secondary_ip_addresses = [] {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] trace_flags = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] transport_url = **** {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] until_refresh = 0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] use_chap_auth = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] use_default_quota_class = True {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] use_journal = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] use_json = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] use_multipath_for_image_xfer = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] use_stderr = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] use_syslog = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] verify_glance_signatures = enabled {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] volume_api_class = cinder.volume.api.API {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] volume_backend_name = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] volume_clear = zero {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] volume_clear_ionice = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] volume_clear_size = 0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] volume_copy_bps_limit = 0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] volume_dd_blocksize = 1M {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] volume_name_template = volume-%s {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] volume_service_inithost_offload = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] volume_usage_audit_period = month {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] zoning_mode = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] oslo_concurrency.disable_process_locking = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] keystone_authtoken.auth_section = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] keystone_authtoken.auth_type = password {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] keystone_authtoken.auth_version = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] keystone_authtoken.cache = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] keystone_authtoken.certfile = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] keystone_authtoken.include_service_catalog = True {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] keystone_authtoken.insecure = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] keystone_authtoken.interface = public {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] keystone_authtoken.keyfile = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] keystone_authtoken.memcache_password = **** {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-6e18d309-782b-4ad2-b205-6c53fcee41c1 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.036s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] keystone_authtoken.memcache_username = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] keystone_authtoken.region_name = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-6e18d309-782b-4ad2-b205-6c53fcee41c1 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] keystone_authtoken.service_type = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.235/identity {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] cache.backend = dogpile.cache.null {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] cache.backend_argument = **** {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] cache.backend_expiration_time = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] cache.config_prefix = cache.oslo {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] cache.debug_cache_backend = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] cache.enable_retry_client = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] cache.enable_socket_keepalive = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] cache.enabled = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] cache.expiration_time = 600 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] cache.hashclient_retry_attempts = 2 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] cache.memcache_dead_retry = 300 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] cache.memcache_pool_maxsize = 10 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] cache.memcache_sasl_enabled = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] cache.password = **** {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] cache.proxies = [] {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] cache.redis_db = 0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] cache.redis_server = localhost:6379 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] cache.retry_attempts = 2 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] cache.retry_delay = 0.0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] cache.socket_keepalive_count = 1 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] cache.socket_keepalive_idle = 1 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] cache.socket_keepalive_interval = 1 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] cache.socket_timeout = 1.0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] cache.tls_allowed_ciphers = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] cache.tls_cafile = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] cache.tls_certfile = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] cache.tls_enabled = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] cache.tls_keyfile = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] cache.username = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] coordination.backend_url = **** {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] database.asyncio_connection = **** {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] database.asyncio_slave_connection = **** {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] database.backend = sqlalchemy {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] database.connection = **** {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] database.connection_debug = 0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] database.connection_parameters = {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] database.connection_recycle_time = 3600 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] database.connection_trace = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] database.db_inc_retry_interval = True {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] database.db_max_retries = 20 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] database.db_max_retry_interval = 10 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] database.db_retry_interval = 1 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] database.max_overflow = 50 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] database.max_pool_size = 5 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-6e18d309-782b-4ad2-b205-6c53fcee41c1 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.030s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] database.max_retries = 10 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-6e18d309-782b-4ad2-b205-6c53fcee41c1 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] database.mysql_wsrep_sync_wait = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] database.pool_timeout = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] database.retry_interval = 10 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] database.slave_connection = **** {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] database.sqlite_synchronous = True {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] database.synchronous_reader = True {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] database.use_db_reconnect = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] oslo_messaging_tracing.insecure = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] profiler.connection_string = messaging:// {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] profiler.enabled = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] profiler.es_doc_type = notification {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] profiler.es_scroll_size = 10000 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] profiler.es_scroll_time = 2m {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] profiler.filter_error_trace = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] profiler.hmac_keys = **** {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] profiler.sentinel_service_name = mymaster {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] profiler.socket_timeout = 0.1 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] profiler.trace_requests = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] profiler.trace_sqlalchemy = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] profiler_jaeger.process_tags = {} {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] profiler_jaeger.service_name_prefix = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] profiler_otlp.service_name_prefix = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] oslo_policy.enforce_new_defaults = True {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] oslo_policy.policy_default_rule = default {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] oslo_policy.policy_file = policy.yaml {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] privsep_osbrick.group = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] privsep_osbrick.helper_command = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] privsep_osbrick.user = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] cinder_sys_admin.group = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] cinder_sys_admin.helper_command = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] cinder_sys_admin.user = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] service_user.auth_section = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] service_user.auth_type = password {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] service_user.cafile = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] service_user.certfile = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-6e18d309-782b-4ad2-b205-6c53fcee41c1 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] service_user.collect_timing = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] service_user.insecure = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-6e18d309-782b-4ad2-b205-6c53fcee41c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] service_user.keyfile = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] service_user.send_service_user_token = True {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] service_user.split_loggers = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] service_user.timeout = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] service_user.tls_ciphers = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] service_user.tls_min_version = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] glance.auth_section = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] glance.auth_type = password {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] glance.certfile = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] glance.collect_timing = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] glance.insecure = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] glance.keyfile = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] glance.region_name = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] glance.split_loggers = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] glance.timeout = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] glance.tls_ciphers = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] glance.tls_min_version = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] backend_defaults.backend_availability_zone = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] backend_defaults.chap_password = **** {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] backend_defaults.chap_username = {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] backend_defaults.disk_geometry = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] backend_defaults.driver_client_cert = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] backend_defaults.driver_client_cert_key = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] backend_defaults.driver_data_namespace = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] backend_defaults.driver_use_ssl = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] backend_defaults.extra_capabilities = {} {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] backend_defaults.filter_function = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] backend_defaults.goodness_function = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] backend_defaults.iscsi_target_flags = {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] backend_defaults.iscsi_write_cache = on {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] backend_defaults.iser_helper = tgtadm {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] backend_defaults.iser_ip_address = 192.168.122.235 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] backend_defaults.iser_port = 3260 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] backend_defaults.lvm_share_target = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] backend_defaults.lvm_type = auto {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] backend_defaults.num_shell_tries = 3 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] backend_defaults.replication_device = **** {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] backend_defaults.report_discard_supported = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] backend_defaults.reserved_percentage = 0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] backend_defaults.target_helper = tgtadm {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] backend_defaults.target_ip_address = 192.168.122.235 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] backend_defaults.target_port = 3260 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] backend_defaults.target_protocol = iscsi {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] backend_defaults.trace_flags = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] backend_defaults.unique_fqdn_network = True {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] backend_defaults.use_chap_auth = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] backend_defaults.volume_backend_name = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] backend_defaults.volume_clear = zero {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] backend_defaults.volume_clear_ionice = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] backend_defaults.volume_clear_size = 0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] oslo_reports.file_event_handler = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] oslo_reports.log_dir = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] lvmdriver-1.backend_host = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] lvmdriver-1.chap_password = **** {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack sudo[75514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 23 14:25:26 devstack sudo[75514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] lvmdriver-1.chap_username = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] lvmdriver-1.disk_geometry = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] lvmdriver-1.driver_client_cert = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] lvmdriver-1.extra_capabilities = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] lvmdriver-1.filter_function = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] lvmdriver-1.goodness_function = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] lvmdriver-1.iser_helper = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] lvmdriver-1.iser_ip_address = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] lvmdriver-1.iser_port = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] lvmdriver-1.lvm_share_target = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] lvmdriver-1.lvm_type = auto {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] lvmdriver-1.num_shell_tries = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] lvmdriver-1.replication_device = **** {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] lvmdriver-1.report_discard_supported = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] lvmdriver-1.reserved_percentage = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] lvmdriver-1.scst_target_driver = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] lvmdriver-1.storage_protocol = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] lvmdriver-1.target_helper = lioadm {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] lvmdriver-1.target_ip_address = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] lvmdriver-1.target_port = 3260 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] lvmdriver-1.trace_flags = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] lvmdriver-1.use_chap_auth = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] lvmdriver-1.volume_clear = zero {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] lvmdriver-1.volume_clear_size = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] lvmdriver-1.volumes_dir = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] oslo_messaging_rabbit.ssl = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] oslo_messaging_notifications.driver = [] {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] oslo_messaging_notifications.retry = -1 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] key_manager.fixed_key = **** {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] barbican.barbican_api_version = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] barbican.barbican_endpoint = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] barbican.barbican_endpoint_type = public {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] barbican.barbican_region_name = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] barbican.cafile = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] barbican.certfile = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] barbican.collect_timing = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] barbican.insecure = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] barbican.keyfile = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] barbican.number_of_retries = 60 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] barbican.retry_delay = 1 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] barbican.send_service_user_token = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] barbican.split_loggers = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] barbican.timeout = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] barbican.tls_ciphers = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] barbican.tls_min_version = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] barbican.verify_ssl = True {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] barbican.verify_ssl_path = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] barbican_service_user.auth_section = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:26 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] barbican_service_user.auth_type = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:27 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] barbican_service_user.cafile = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:27 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] barbican_service_user.certfile = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:27 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] barbican_service_user.collect_timing = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:27 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] barbican_service_user.insecure = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:27 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] barbican_service_user.keyfile = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:27 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] barbican_service_user.split_loggers = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:27 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] barbican_service_user.timeout = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:27 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] barbican_service_user.tls_ciphers = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:27 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] barbican_service_user.tls_min_version = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:27 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] vault.approle_role_id = **** {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:27 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] vault.approle_secret_id = **** {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:27 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] vault.auth_method = approle {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:27 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] vault.auth_path = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:27 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] vault.kv_mountpoint = secret {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:27 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] vault.kv_path = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:27 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] vault.kv_version = 2 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:27 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] vault.namespace = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:27 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] vault.root_token_id = **** {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:27 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] vault.ssl_ca_crt_file = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:27 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] vault.timeout = 60.0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:27 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] vault.token_file = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:27 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] vault.token_role = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:27 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] vault.use_ssl = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:27 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:25:27 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] ******************************************************************************** {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 23 14:25:27 devstack sudo[75514]: pam_unix(sudo:session): session closed for user root Sep 23 14:25:27 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-6e18d309-782b-4ad2-b205-6c53fcee41c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.283s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:25:27 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-6e18d309-782b-4ad2-b205-6c53fcee41c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:25:27 devstack sudo[75622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 23 14:25:27 devstack sudo[75622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:25:27 devstack sudo[75622]: pam_unix(sudo:session): session closed for user root Sep 23 14:25:27 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-6e18d309-782b-4ad2-b205-6c53fcee41c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.261s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:25:27 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-6e18d309-782b-4ad2-b205-6c53fcee41c1 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 14:25:27 devstack cinder-volume[75453]: INFO cinder.brick.local_dev.lvm [None req-6e18d309-782b-4ad2-b205-6c53fcee41c1 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 23 14:25:27 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-6e18d309-782b-4ad2-b205-6c53fcee41c1 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:25:27 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-6e18d309-782b-4ad2-b205-6c53fcee41c1 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:25:27 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-6e18d309-782b-4ad2-b205-6c53fcee41c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:25:27 devstack sudo[75707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 23 14:25:27 devstack sudo[75707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:25:27 devstack sudo[75707]: pam_unix(sudo:session): session closed for user root Sep 23 14:25:27 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-6e18d309-782b-4ad2-b205-6c53fcee41c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:25:27 devstack cinder-volume[75453]: DEBUG cinder.brick.local_dev.lvm [None req-6e18d309-782b-4ad2-b205-6c53fcee41c1 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75453) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 23 14:25:27 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-6e18d309-782b-4ad2-b205-6c53fcee41c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:25:27 devstack sudo[75799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 23 14:25:27 devstack sudo[75799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:25:28 devstack sudo[75799]: pam_unix(sudo:session): session closed for user root Sep 23 14:25:28 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-6e18d309-782b-4ad2-b205-6c53fcee41c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.511s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:25:28 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-6e18d309-782b-4ad2-b205-6c53fcee41c1 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:25:28 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-6e18d309-782b-4ad2-b205-6c53fcee41c1 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:25:28 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-6e18d309-782b-4ad2-b205-6c53fcee41c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:25:28 devstack sudo[75961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 23 14:25:28 devstack sudo[75961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:25:28 devstack sudo[75961]: pam_unix(sudo:session): session closed for user root Sep 23 14:25:28 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-6e18d309-782b-4ad2-b205-6c53fcee41c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.310s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:25:28 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-6e18d309-782b-4ad2-b205-6c53fcee41c1 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:25:28 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-6e18d309-782b-4ad2-b205-6c53fcee41c1 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:25:28 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-6e18d309-782b-4ad2-b205-6c53fcee41c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:25:28 devstack sudo[76040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 23 14:25:28 devstack sudo[76040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:25:28 devstack sudo[76040]: pam_unix(sudo:session): session closed for user root Sep 23 14:25:28 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-6e18d309-782b-4ad2-b205-6c53fcee41c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.274s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:25:28 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-6e18d309-782b-4ad2-b205-6c53fcee41c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:25:28 devstack sudo[76062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 23 14:25:28 devstack sudo[76062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:25:29 devstack sudo[76062]: pam_unix(sudo:session): session closed for user root Sep 23 14:25:29 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-6e18d309-782b-4ad2-b205-6c53fcee41c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.291s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:25:29 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-6e18d309-782b-4ad2-b205-6c53fcee41c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:25:29 devstack sudo[76126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 23 14:25:29 devstack sudo[76126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:25:29 devstack sudo[76126]: pam_unix(sudo:session): session closed for user root Sep 23 14:25:29 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-6e18d309-782b-4ad2-b205-6c53fcee41c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:25:29 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-6e18d309-782b-4ad2-b205-6c53fcee41c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:25:29 devstack sudo[76135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 14:25:29 devstack sudo[76135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:25:29 devstack sudo[76135]: pam_unix(sudo:session): session closed for user root Sep 23 14:25:29 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-6e18d309-782b-4ad2-b205-6c53fcee41c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.296s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:25:29 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-6e18d309-782b-4ad2-b205-6c53fcee41c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:25:29 devstack sudo[76218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 23 14:25:29 devstack sudo[76218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:25:30 devstack sudo[76218]: pam_unix(sudo:session): session closed for user root Sep 23 14:25:30 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-6e18d309-782b-4ad2-b205-6c53fcee41c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.281s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:25:30 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-6e18d309-782b-4ad2-b205-6c53fcee41c1 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:25:30 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-6e18d309-782b-4ad2-b205-6c53fcee41c1 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:25:30 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-6e18d309-782b-4ad2-b205-6c53fcee41c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:25:30 devstack sudo[76222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 23 14:25:30 devstack sudo[76222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:25:30 devstack sudo[76222]: pam_unix(sudo:session): session closed for user root Sep 23 14:25:30 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-6e18d309-782b-4ad2-b205-6c53fcee41c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.259s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:25:30 devstack cinder-volume[75453]: INFO cinder.volume.drivers.lvm [None req-6e18d309-782b-4ad2-b205-6c53fcee41c1 None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 23 14:25:30 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-6e18d309-782b-4ad2-b205-6c53fcee41c1 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:25:30 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-6e18d309-782b-4ad2-b205-6c53fcee41c1 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:25:30 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-6e18d309-782b-4ad2-b205-6c53fcee41c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:25:30 devstack sudo[76232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 23 14:25:30 devstack sudo[76232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:25:30 devstack sudo[76232]: pam_unix(sudo:session): session closed for user root Sep 23 14:25:30 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-6e18d309-782b-4ad2-b205-6c53fcee41c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.266s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:25:30 devstack cinder-volume[75453]: DEBUG cinder.volume.drivers.lvm [None req-6e18d309-782b-4ad2-b205-6c53fcee41c1 None None] Updating volume stats {{(pid=75453) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 23 14:25:30 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-6e18d309-782b-4ad2-b205-6c53fcee41c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:25:30 devstack sudo[76236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 23 14:25:30 devstack sudo[76236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:25:30 devstack sudo[76236]: pam_unix(sudo:session): session closed for user root Sep 23 14:25:30 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-6e18d309-782b-4ad2-b205-6c53fcee41c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:25:30 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-6e18d309-782b-4ad2-b205-6c53fcee41c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:25:30 devstack sudo[76239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 14:25:30 devstack sudo[76239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:25:31 devstack sudo[76239]: pam_unix(sudo:session): session closed for user root Sep 23 14:25:31 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-6e18d309-782b-4ad2-b205-6c53fcee41c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:25:31 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-6e18d309-782b-4ad2-b205-6c53fcee41c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:25:31 devstack sudo[76242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 23 14:25:31 devstack sudo[76242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:25:31 devstack sudo[76242]: pam_unix(sudo:session): session closed for user root Sep 23 14:25:31 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-6e18d309-782b-4ad2-b205-6c53fcee41c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.249s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:25:31 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-6e18d309-782b-4ad2-b205-6c53fcee41c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:25:31 devstack sudo[76246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 14:25:31 devstack sudo[76246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:25:31 devstack sudo[76246]: pam_unix(sudo:session): session closed for user root Sep 23 14:25:31 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-6e18d309-782b-4ad2-b205-6c53fcee41c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:25:31 devstack cinder-volume[75453]: INFO cinder.volume.driver [None req-6e18d309-782b-4ad2-b205-6c53fcee41c1 None None] Driver hasn't implemented _init_vendor_properties() Sep 23 14:25:31 devstack cinder-volume[75453]: DEBUG cinder.volume.driver [None req-6e18d309-782b-4ad2-b205-6c53fcee41c1 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75453) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 23 14:25:31 devstack cinder-volume[75453]: DEBUG oslo_db.sqlalchemy.engines [None req-6e18d309-782b-4ad2-b205-6c53fcee41c1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75453) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 14:25:31 devstack cinder-volume[75453]: DEBUG dbcounter [-] [75453] Writer thread running {{(pid=75453) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 23 14:25:31 devstack cinder-volume[75453]: DEBUG cinder.db.api [None req-6e18d309-782b-4ad2-b205-6c53fcee41c1 None None] Building query based on filter {{(pid=75453) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 23 14:25:31 devstack cinder-volume[75453]: DEBUG cinder.image.image_utils [None req-6e18d309-782b-4ad2-b205-6c53fcee41c1 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75453) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 23 14:25:31 devstack cinder-volume[75453]: INFO cinder.keymgr.migration [None req-969a07e8-823c-426e-b8b7-f1b587516744 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 23 14:25:31 devstack cinder-volume[75453]: DEBUG cinder.volume.drivers.lvm [None req-6e18d309-782b-4ad2-b205-6c53fcee41c1 None None] Updating volume stats {{(pid=75453) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 23 14:25:31 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-6e18d309-782b-4ad2-b205-6c53fcee41c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:25:31 devstack sudo[76249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 23 14:25:31 devstack sudo[76249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:25:32 devstack sudo[76249]: pam_unix(sudo:session): session closed for user root Sep 23 14:25:32 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-6e18d309-782b-4ad2-b205-6c53fcee41c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:25:32 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-6e18d309-782b-4ad2-b205-6c53fcee41c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:25:32 devstack sudo[76254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 14:25:32 devstack sudo[76254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:25:32 devstack sudo[76254]: pam_unix(sudo:session): session closed for user root Sep 23 14:25:32 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-6e18d309-782b-4ad2-b205-6c53fcee41c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.293s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:25:32 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-6e18d309-782b-4ad2-b205-6c53fcee41c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:25:32 devstack sudo[76263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 23 14:25:32 devstack sudo[76263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:25:32 devstack sudo[76263]: pam_unix(sudo:session): session closed for user root Sep 23 14:25:32 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-6e18d309-782b-4ad2-b205-6c53fcee41c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.259s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:25:32 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-6e18d309-782b-4ad2-b205-6c53fcee41c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:25:32 devstack sudo[76266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 14:25:32 devstack sudo[76266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:25:32 devstack sudo[76266]: pam_unix(sudo:session): session closed for user root Sep 23 14:25:32 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-6e18d309-782b-4ad2-b205-6c53fcee41c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:25:32 devstack cinder-volume[75453]: DEBUG cinder.manager [None req-6e18d309-782b-4ad2-b205-6c53fcee41c1 None None] Notifying Schedulers of capabilities ... {{(pid=75453) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:25:32 devstack cinder-volume[75453]: INFO cinder.volume.manager [None req-6e18d309-782b-4ad2-b205-6c53fcee41c1 None None] Driver initialization completed successfully. Sep 23 14:25:32 devstack cinder-volume[75453]: INFO cinder.manager [None req-6e18d309-782b-4ad2-b205-6c53fcee41c1 None None] Initiating service 2 cleanup Sep 23 14:25:32 devstack cinder-volume[75453]: INFO cinder.manager [None req-6e18d309-782b-4ad2-b205-6c53fcee41c1 None None] Service 2 cleanup completed. Sep 23 14:25:32 devstack cinder-volume[75453]: DEBUG cinder.service [None req-6e18d309-782b-4ad2-b205-6c53fcee41c1 None None] Creating RPC server for service cinder-volume {{(pid=75453) start /opt/stack/cinder/cinder/service.py:231}} Sep 23 14:25:32 devstack cinder-volume[75453]: DEBUG cinder.service [None req-6e18d309-782b-4ad2-b205-6c53fcee41c1 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75453) start /opt/stack/cinder/cinder/service.py:237}} Sep 23 14:25:32 devstack cinder-volume[75453]: INFO cinder.volume.manager [None req-6e18d309-782b-4ad2-b205-6c53fcee41c1 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 23 14:25:32 devstack cinder-volume[75453]: DEBUG cinder.volume.drivers.lvm [None req-6e18d309-782b-4ad2-b205-6c53fcee41c1 None None] Updating volume stats {{(pid=75453) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 23 14:25:32 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-6e18d309-782b-4ad2-b205-6c53fcee41c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:25:33 devstack sudo[76269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 23 14:25:33 devstack sudo[76269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:25:33 devstack sudo[76269]: pam_unix(sudo:session): session closed for user root Sep 23 14:25:33 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-6e18d309-782b-4ad2-b205-6c53fcee41c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.281s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:25:33 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-6e18d309-782b-4ad2-b205-6c53fcee41c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:25:33 devstack sudo[76277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 14:25:33 devstack sudo[76277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:25:33 devstack sudo[76277]: pam_unix(sudo:session): session closed for user root Sep 23 14:25:33 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-6e18d309-782b-4ad2-b205-6c53fcee41c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:25:33 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-6e18d309-782b-4ad2-b205-6c53fcee41c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:25:33 devstack sudo[76280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 23 14:25:33 devstack sudo[76280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:25:33 devstack sudo[76280]: pam_unix(sudo:session): session closed for user root Sep 23 14:25:33 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-6e18d309-782b-4ad2-b205-6c53fcee41c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.256s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:25:33 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-6e18d309-782b-4ad2-b205-6c53fcee41c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:25:33 devstack sudo[76283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 14:25:33 devstack sudo[76283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:25:34 devstack sudo[76283]: pam_unix(sudo:session): session closed for user root Sep 23 14:25:34 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-6e18d309-782b-4ad2-b205-6c53fcee41c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.279s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:25:34 devstack cinder-volume[75453]: INFO cinder.volume.manager [None req-6e18d309-782b-4ad2-b205-6c53fcee41c1 None None] Driver post RPC initialization completed successfully. Sep 23 14:25:36 devstack cinder-volume[75285]: DEBUG dbcounter [-] [75285] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75285) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 14:25:44 devstack cinder-volume[75453]: DEBUG dbcounter [-] [75453] Writing DB stats cinder:SELECT=3 {{(pid=75453) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 14:25:44 devstack cinder-volume[75453]: DEBUG dbcounter [-] [75453] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=75453) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 14:26:19 devstack cinder-volume[75453]: DEBUG oslo_service.periodic_task [None req-b01297c5-47bd-402b-89eb-f8d570ee2af5 None None] Running periodic task VolumeManager._thread_info {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 14:26:19 devstack cinder-volume[75453]: DEBUG cinder.volume.manager [None req-b01297c5-47bd-402b-89eb-f8d570ee2af5 None None] thread count: 6 {{(pid=75453) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 14:26:19 devstack cinder-volume[75453]: DEBUG cinder.volume.manager [None req-b01297c5-47bd-402b-89eb-f8d570ee2af5 None None] thread info: [<_MainThread(MainThread, started 127747425890432)>, , , , , ] {{(pid=75453) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 14:27:19 devstack cinder-volume[75453]: DEBUG oslo_service.periodic_task [None req-b01297c5-47bd-402b-89eb-f8d570ee2af5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 14:27:19 devstack cinder-volume[75453]: DEBUG cinder.volume.drivers.lvm [None req-b01297c5-47bd-402b-89eb-f8d570ee2af5 None None] Updating volume stats {{(pid=75453) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 23 14:27:19 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-b01297c5-47bd-402b-89eb-f8d570ee2af5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:27:19 devstack sudo[81502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 23 14:27:19 devstack sudo[81502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:27:19 devstack sudo[81502]: pam_unix(sudo:session): session closed for user root Sep 23 14:27:19 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-b01297c5-47bd-402b-89eb-f8d570ee2af5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:27:19 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-b01297c5-47bd-402b-89eb-f8d570ee2af5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:27:19 devstack sudo[81505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 14:27:19 devstack sudo[81505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:27:19 devstack sudo[81505]: pam_unix(sudo:session): session closed for user root Sep 23 14:27:19 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-b01297c5-47bd-402b-89eb-f8d570ee2af5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.245s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:27:19 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-b01297c5-47bd-402b-89eb-f8d570ee2af5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:27:19 devstack sudo[81508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 23 14:27:19 devstack sudo[81508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:27:19 devstack sudo[81508]: pam_unix(sudo:session): session closed for user root Sep 23 14:27:19 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-b01297c5-47bd-402b-89eb-f8d570ee2af5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.252s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:27:19 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-b01297c5-47bd-402b-89eb-f8d570ee2af5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:27:19 devstack sudo[81511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 14:27:19 devstack sudo[81511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:27:20 devstack sudo[81511]: pam_unix(sudo:session): session closed for user root Sep 23 14:27:20 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-b01297c5-47bd-402b-89eb-f8d570ee2af5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:27:20 devstack cinder-volume[75453]: DEBUG cinder.manager [None req-b01297c5-47bd-402b-89eb-f8d570ee2af5 None None] Notifying Schedulers of capabilities ... {{(pid=75453) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:27:20 devstack cinder-volume[75453]: DEBUG oslo_service.periodic_task [None req-b01297c5-47bd-402b-89eb-f8d570ee2af5 None None] Running periodic task VolumeManager._thread_info {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 14:27:20 devstack cinder-volume[75453]: DEBUG cinder.volume.manager [None req-b01297c5-47bd-402b-89eb-f8d570ee2af5 None None] thread count: 6 {{(pid=75453) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 14:27:20 devstack cinder-volume[75453]: DEBUG cinder.volume.manager [None req-b01297c5-47bd-402b-89eb-f8d570ee2af5 None None] thread info: [<_MainThread(MainThread, started 127747425890432)>, , , , , ] {{(pid=75453) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 14:27:44 devstack cinder-volume[75453]: DEBUG dbcounter [-] [75453] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=75453) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 14:28:19 devstack cinder-volume[75453]: DEBUG oslo_service.periodic_task [None req-b01297c5-47bd-402b-89eb-f8d570ee2af5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 14:28:19 devstack cinder-volume[75453]: DEBUG cinder.volume.drivers.lvm [None req-b01297c5-47bd-402b-89eb-f8d570ee2af5 None None] Updating volume stats {{(pid=75453) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 23 14:28:19 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-b01297c5-47bd-402b-89eb-f8d570ee2af5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:28:19 devstack sudo[83212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 23 14:28:19 devstack sudo[83212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:28:19 devstack sudo[83212]: pam_unix(sudo:session): session closed for user root Sep 23 14:28:19 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-b01297c5-47bd-402b-89eb-f8d570ee2af5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:28:19 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-b01297c5-47bd-402b-89eb-f8d570ee2af5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:28:19 devstack sudo[83231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 14:28:19 devstack sudo[83231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:28:19 devstack sudo[83231]: pam_unix(sudo:session): session closed for user root Sep 23 14:28:19 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-b01297c5-47bd-402b-89eb-f8d570ee2af5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:28:19 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-b01297c5-47bd-402b-89eb-f8d570ee2af5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:28:19 devstack sudo[83236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 23 14:28:19 devstack sudo[83236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:28:19 devstack sudo[83236]: pam_unix(sudo:session): session closed for user root Sep 23 14:28:19 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-b01297c5-47bd-402b-89eb-f8d570ee2af5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.257s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:28:19 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-b01297c5-47bd-402b-89eb-f8d570ee2af5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:28:19 devstack sudo[83239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 14:28:19 devstack sudo[83239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:28:20 devstack sudo[83239]: pam_unix(sudo:session): session closed for user root Sep 23 14:28:20 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-b01297c5-47bd-402b-89eb-f8d570ee2af5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.286s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:28:20 devstack cinder-volume[75453]: DEBUG cinder.manager [None req-b01297c5-47bd-402b-89eb-f8d570ee2af5 None None] Notifying Schedulers of capabilities ... {{(pid=75453) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:28:20 devstack cinder-volume[75453]: DEBUG oslo_service.periodic_task [None req-b01297c5-47bd-402b-89eb-f8d570ee2af5 None None] Running periodic task VolumeManager._thread_info {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 14:28:20 devstack cinder-volume[75453]: DEBUG cinder.volume.manager [None req-b01297c5-47bd-402b-89eb-f8d570ee2af5 None None] thread count: 6 {{(pid=75453) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 14:28:20 devstack cinder-volume[75453]: DEBUG cinder.volume.manager [None req-b01297c5-47bd-402b-89eb-f8d570ee2af5 None None] thread info: [<_MainThread(MainThread, started 127747425890432)>, , , , , ] {{(pid=75453) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 14:29:19 devstack cinder-volume[75453]: DEBUG oslo_service.periodic_task [None req-b01297c5-47bd-402b-89eb-f8d570ee2af5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 14:29:19 devstack cinder-volume[75453]: DEBUG cinder.volume.drivers.lvm [None req-b01297c5-47bd-402b-89eb-f8d570ee2af5 None None] Updating volume stats {{(pid=75453) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 23 14:29:19 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-b01297c5-47bd-402b-89eb-f8d570ee2af5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:29:19 devstack sudo[84573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 23 14:29:19 devstack sudo[84573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:29:19 devstack sudo[84573]: pam_unix(sudo:session): session closed for user root Sep 23 14:29:19 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-b01297c5-47bd-402b-89eb-f8d570ee2af5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:29:19 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-b01297c5-47bd-402b-89eb-f8d570ee2af5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:29:19 devstack sudo[84576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 14:29:19 devstack sudo[84576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:29:19 devstack sudo[84576]: pam_unix(sudo:session): session closed for user root Sep 23 14:29:19 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-b01297c5-47bd-402b-89eb-f8d570ee2af5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:29:19 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-b01297c5-47bd-402b-89eb-f8d570ee2af5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:29:19 devstack sudo[84590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 23 14:29:19 devstack sudo[84590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:29:19 devstack sudo[84590]: pam_unix(sudo:session): session closed for user root Sep 23 14:29:19 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-b01297c5-47bd-402b-89eb-f8d570ee2af5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.248s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:29:19 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-b01297c5-47bd-402b-89eb-f8d570ee2af5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:29:19 devstack sudo[84593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 14:29:19 devstack sudo[84593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:29:20 devstack sudo[84593]: pam_unix(sudo:session): session closed for user root Sep 23 14:29:20 devstack cinder-volume[75453]: DEBUG oslo_concurrency.processutils [None req-b01297c5-47bd-402b-89eb-f8d570ee2af5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.247s {{(pid=75453) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:29:20 devstack cinder-volume[75453]: DEBUG cinder.manager [None req-b01297c5-47bd-402b-89eb-f8d570ee2af5 None None] Notifying Schedulers of capabilities ... {{(pid=75453) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:29:20 devstack cinder-volume[75453]: DEBUG oslo_service.periodic_task [None req-b01297c5-47bd-402b-89eb-f8d570ee2af5 None None] Running periodic task VolumeManager._thread_info {{(pid=75453) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 14:29:20 devstack cinder-volume[75453]: DEBUG cinder.volume.manager [None req-b01297c5-47bd-402b-89eb-f8d570ee2af5 None None] thread count: 6 {{(pid=75453) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 14:29:20 devstack cinder-volume[75453]: DEBUG cinder.volume.manager [None req-b01297c5-47bd-402b-89eb-f8d570ee2af5 None None] thread info: [<_MainThread(MainThread, started 127747425890432)>, , , , , ] {{(pid=75453) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 14:29:44 devstack cinder-volume[75453]: DEBUG dbcounter [-] [75453] Writing DB stats cinder:SELECT=1 {{(pid=75453) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 14:29:44 devstack cinder-volume[75453]: DEBUG dbcounter [-] [75453] Writing DB stats cinder:UPDATE=1 {{(pid=75453) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 14:29:57 devstack cinder-volume[75285]: INFO oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] Caught SIGTERM, stopping children Sep 23 14:29:57 devstack cinder-volume[75285]: DEBUG oslo_concurrency.lockutils [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] Acquiring lock "singleton_lock" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 23 14:29:57 devstack cinder-volume[75285]: DEBUG oslo_concurrency.lockutils [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] Acquired lock "singleton_lock" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 23 14:29:57 devstack cinder-volume[75285]: DEBUG oslo_concurrency.lockutils [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] Releasing lock "singleton_lock" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 23 14:29:57 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] Stop services. {{(pid=75285) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 23 14:29:57 devstack cinder-volume[75285]: DEBUG oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] Killing children. {{(pid=75285) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 23 14:29:57 devstack cinder-volume[75285]: INFO oslo_service.backend._eventlet.service [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] Waiting on 1 children to exit Sep 23 14:30:03 devstack cinder-volume[75453]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Sep 23 14:30:03 devstack cinder-volume[85413]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 23 14:30:03 devstack cinder-volume[85413]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 23 14:30:03 devstack cinder-volume[85413]: we strongly recommend against using it for new projects. Sep 23 14:30:03 devstack cinder-volume[85413]: If you are already using Eventlet, we recommend migrating to a different Sep 23 14:30:03 devstack cinder-volume[85413]: framework. For more detail see Sep 23 14:30:03 devstack cinder-volume[85413]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 23 14:30:03 devstack cinder-volume[85413]: import eventlet # noqa Sep 23 14:30:05 devstack cinder-volume[85413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85413) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 23 14:30:05 devstack cinder-volume[85413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85413) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 23 14:30:05 devstack cinder-volume[85413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85413) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 23 14:30:06 devstack cinder-volume[85413]: INFO dbcounter [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] Registered counter for database cinder Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_db.sqlalchemy.engines [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85413) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG dbcounter [-] [85413] Writer thread running {{(pid=85413) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 23 14:30:06 devstack cinder-volume[85413]: INFO cinder.rpc [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 23 14:30:06 devstack cinder-volume[85413]: INFO cinder.rpc [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_db.sqlalchemy.engines [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85413) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 14:30:06 devstack cinder-volume[85413]: INFO cinder.volume.manager [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] Determined volume DB was empty at startup. Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG cinder.volume.manager [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85413) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 23 14:30:06 devstack cinder-volume[85413]: INFO cinder.volume.manager [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 23 14:30:06 devstack cinder-volume[85413]: WARNING stevedore.named [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 23 14:30:06 devstack cinder-volume[85413]: WARNING castellan.key_manager [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 23 14:30:06 devstack cinder-volume[85413]: WARNING cinder.keymgr.conf_key_mgr [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 23 14:30:06 devstack cinder-volume[85413]: INFO cinder.volume.manager [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_db.sqlalchemy.engines [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85413) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 14:30:06 devstack cinder-volume[85413]: INFO oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] Starting 1 workers Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] Started child 85627 {{(pid=85413) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] Full set of CONF: {{(pid=85413) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] ******************************************************************************** {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] Configuration options gathered from: {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] ================================================================================ {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 23 14:30:06 devstack cinder-volume[85627]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] allow_availability_zone_fallback = False {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] allow_compression_on_image_upload = False {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] allowed_direct_url_schemes = [] {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] api_rate_limit = True {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] auth_strategy = keystone {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] backend_availability_zone = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] backend_host = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] backend_name = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] backend_stats_polling_interval = 60 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] backup_api_class = cinder.backup.api.API {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] backup_name_template = backup-%s {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] backup_use_same_host = False {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] backup_use_temp_snapshot = False {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] chap_password = **** {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] chap_username = {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] cinder_internal_tenant_project_id = e43c14861cd0490cbe3f1660a41537bd {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] cinder_internal_tenant_user_id = 86da715c14a942a09f0363264393ee15 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] cluster = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] compression_format = gzip {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] compute_api_class = cinder.compute.nova.API {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] config_dir = [] {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] config_source = [] {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] control_exchange = openstack {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] debug = True {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] default_availability_zone = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] default_group_type = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] default_volume_type = QuobyteHD {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] disk_geometry = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] driver_client_cert = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] driver_client_cert_key = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] driver_data_namespace = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] driver_ssl_cert_path = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] driver_ssl_cert_verify = False {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] driver_use_ssl = False {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] enable_new_services = True {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] enable_unsupported_driver = False {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] enabled_backends = ['QuobyteHD'] {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] enforce_multipath_for_image_xfer = False {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] filter_function = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] glance_api_insecure = False {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] glance_api_servers = ['http://192.168.122.235/image'] {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] glance_api_ssl_compression = False {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] glance_ca_certificates_file = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] glance_catalog_info = image:glance:publicURL {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] glance_certfile = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] glance_keyfile = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] glance_num_retries = 3 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] glance_request_timeout = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] goodness_function = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] graceful_shutdown_timeout = 5 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] group_api_class = cinder.group.api.API {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] host = devstack {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] image_compress_on_upload = True {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] image_conversion_address_space_limit = 1 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] image_conversion_cpu_limit = 60 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] image_conversion_disable = False {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85627]: INFO cinder.volume.manager [None req-1231b8ef-b95b-466c-a4d0-90c3654e8995 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 23 14:30:06 devstack cinder-volume[85627]: DEBUG cinder.volume.drivers.remotefs [None req-1231b8ef-b95b-466c-a4d0-90c3654e8995 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=85627) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] image_introspection_address_space_limit = 1 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] image_introspection_cpu_limit = 60 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] image_upload_use_cinder_backend = False {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] image_upload_use_internal_tenant = False {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] image_volume_cache_enabled = False {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] image_volume_cache_max_count = 0 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] image_volume_cache_max_size_gb = 0 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] init_host_max_objects_retrieval = 0 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] instance_format = [instance: %(uuid)s] {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] iscsi_target_flags = {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] iscsi_write_cache = on {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] iser_helper = tgtadm {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] iser_ip_address = 192.168.122.235 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] iser_port = 3260 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] log_color = False {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] log_config_append = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] log_dir = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] log_file = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] log_options = True {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] log_rotate_interval = 1 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] log_rotate_interval_type = days {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] log_rotation_type = none {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] max_age = 0 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] max_logfile_count = 30 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] max_logfile_size_mb = 200 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] max_over_subscription_ratio = 20.0 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] message_reap_interval = 86400 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] message_ttl = 2592000 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] migration_create_volume_timeout_secs = 300 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] monkey_patch = False {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] monkey_patch_modules = [] {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] my_ip = 192.168.122.235 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] no_snapshot_gb_quota = False {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] num_iser_scan_tries = 3 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] num_shell_tries = 3 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] num_volume_device_scan_tries = 3 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] nvmeof_conn_info_version = 1 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] nvmet_ns_id = 10 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] nvmet_port_id = 1 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] osapi_max_limit = 1000 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] osapi_volume_ext_list = [] {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] osapi_volume_listen = 0.0.0.0 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] osapi_volume_listen_port = 8776 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] osapi_volume_use_ssl = False {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] osapi_volume_workers = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] per_volume_size_limit = -1 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] periodic_fuzzy_delay = 60 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] periodic_interval = 60 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] project_id_regex = [0-9a-f\-]+ {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] public_endpoint = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] publish_errors = False {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] quota_backup_gigabytes = 1000 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] quota_backups = 10 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] quota_gigabytes = 1000 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] quota_groups = 10 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] quota_snapshots = 10 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] quota_volumes = 10 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] rate_limit_burst = 0 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] rate_limit_except_level = CRITICAL {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] rate_limit_interval = 0 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] reinit_driver_count = 3 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] replication_device = **** {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85627]: DEBUG cinder.volume.drivers.quobyte [None req-1231b8ef-b95b-466c-a4d0-90c3654e8995 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=85627) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 23 14:30:06 devstack cinder-volume[85627]: WARNING cinder.volume.drivers.quobyte [None req-1231b8ef-b95b-466c-a4d0-90c3654e8995 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 23 14:30:06 devstack cinder-volume[85627]: WARNING cinder.volume.drivers.quobyte [None req-1231b8ef-b95b-466c-a4d0-90c3654e8995 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 23 14:30:06 devstack cinder-volume[85627]: DEBUG oslo_concurrency.processutils [None req-1231b8ef-b95b-466c-a4d0-90c3654e8995 None None] Running cmd (subprocess): mount.quobyte {{(pid=85627) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] report_discard_supported = False {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] report_interval = 120 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] reservation_clean_interval = 86400 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] reservation_expire = 86400 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] reserved_image_namespaces = [] {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] reserved_percentage = 0 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] rpc_response_timeout = 120 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] run_external_periodic_tasks = True {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] scst_target_driver = iscsi {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] scst_target_iqn_name = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] service_down_time = 720 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] shell_completion = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] snapshot_name_template = snapshot-%s {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] split_loggers = False {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] state_path = /opt/stack/data/cinder {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] storage_availability_zone = nova {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] storage_protocol = iSCSI {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] syslog_log_facility = LOG_USER {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] target_helper = lioadm {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] target_ip_address = 192.168.122.235 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] target_port = 3260 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] target_protocol = iscsi {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] target_secondary_ip_addresses = [] {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] trace_flags = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] transfer_api_class = cinder.transfer.api.API {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] transport_url = **** {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] until_refresh = 0 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] use_chap_auth = False {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] use_default_quota_class = True {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] use_journal = False {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] use_json = False {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] use_multipath_for_image_xfer = False {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] use_stderr = False {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] use_syslog = False {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] verify_glance_signatures = enabled {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] volume_api_class = cinder.volume.api.API {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] volume_backend_name = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] volume_clear = zero {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] volume_clear_ionice = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] volume_clear_size = 0 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] volume_copy_bps_limit = 0 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] volume_dd_blocksize = 1M {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] volume_name_template = volume-%s {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] volume_service_inithost_offload = False {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] volume_usage_audit_period = month {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] zoning_mode = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] oslo_concurrency.disable_process_locking = False {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] keystone_authtoken.auth_section = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] keystone_authtoken.auth_type = password {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] keystone_authtoken.auth_version = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] keystone_authtoken.cache = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] keystone_authtoken.certfile = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] keystone_authtoken.delay_auth_decision = False {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] keystone_authtoken.http_connect_timeout = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] keystone_authtoken.include_service_catalog = True {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] keystone_authtoken.insecure = False {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] keystone_authtoken.interface = public {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] keystone_authtoken.keyfile = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] keystone_authtoken.memcache_password = **** {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:06 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack quobyte-client[85628]: Reading configuration file: /etc/quobyte/client.cfg Sep 23 14:30:07 devstack quobyte-client[85628]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] keystone_authtoken.memcache_username = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85627]: DEBUG oslo_concurrency.processutils [None req-1231b8ef-b95b-466c-a4d0-90c3654e8995 None None] CMD "mount.quobyte" returned: 1 in 0.092s {{(pid=85627) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] keystone_authtoken.region_name = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] keystone_authtoken.service_token_roles_required = True {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] keystone_authtoken.service_type = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] keystone_authtoken.token_cache_time = 300 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.235/identity {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] cache.backend = dogpile.cache.null {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] cache.backend_argument = **** {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] cache.backend_expiration_time = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] cache.config_prefix = cache.oslo {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] cache.debug_cache_backend = False {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] cache.enable_retry_client = False {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] cache.enable_socket_keepalive = False {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] cache.enabled = False {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] cache.expiration_time = 600 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] cache.hashclient_retry_attempts = 2 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] cache.memcache_dead_retry = 300 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] cache.memcache_pool_maxsize = 10 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] cache.memcache_sasl_enabled = False {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] cache.password = **** {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] cache.proxies = [] {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] cache.redis_db = 0 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85627]: DEBUG oslo_concurrency.lockutils [None req-1231b8ef-b95b-466c-a4d0-90c3654e8995 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85627) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] cache.redis_sentinel_service_name = mymaster {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85627]: DEBUG oslo_concurrency.lockutils [None req-1231b8ef-b95b-466c-a4d0-90c3654e8995 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85627) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85627]: DEBUG cinder.volume.drivers.quobyte [None req-1231b8ef-b95b-466c-a4d0-90c3654e8995 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=85627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] cache.redis_server = localhost:6379 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] cache.retry_attempts = 2 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] cache.retry_delay = 0.0 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] cache.socket_keepalive_count = 1 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] cache.socket_keepalive_idle = 1 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85627]: INFO cinder.volume.drivers.quobyte [None req-1231b8ef-b95b-466c-a4d0-90c3654e8995 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 ... Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] cache.socket_keepalive_interval = 1 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] cache.socket_timeout = 1.0 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] cache.tls_allowed_ciphers = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] cache.tls_cafile = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] cache.tls_certfile = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] cache.tls_enabled = False {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] cache.tls_keyfile = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] cache.username = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85627]: DEBUG oslo_concurrency.processutils [None req-1231b8ef-b95b-466c-a4d0-90c3654e8995 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd -c /etc/quobyte/client-cinder.cfg {{(pid=85627) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] coordination.backend_url = **** {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] database.asyncio_connection = **** {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] database.asyncio_slave_connection = **** {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] database.backend = sqlalchemy {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] database.connection = **** {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] database.connection_debug = 0 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] database.connection_parameters = {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] database.connection_recycle_time = 3600 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] database.connection_trace = False {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] database.db_inc_retry_interval = True {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] database.db_max_retries = 20 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] database.db_max_retry_interval = 10 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] database.db_retry_interval = 1 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] database.max_overflow = 50 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] database.max_pool_size = 5 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] database.max_retries = 10 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] database.mysql_wsrep_sync_wait = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] database.pool_timeout = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] database.retry_interval = 10 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] database.slave_connection = **** {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] database.sqlite_synchronous = True {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] database.synchronous_reader = True {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] database.use_db_reconnect = False {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] oslo_messaging_tracing.insecure = False {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] profiler.connection_string = messaging:// {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] profiler.enabled = False {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] profiler.es_doc_type = notification {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] profiler.es_scroll_size = 10000 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack sudo[85631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd -c /etc/quobyte/client-cinder.cfg Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] profiler.es_scroll_time = 2m {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] profiler.filter_error_trace = False {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] profiler.hmac_keys = **** {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] profiler.sentinel_service_name = mymaster {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack sudo[85631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] profiler.socket_timeout = 0.1 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] profiler.trace_requests = False {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] profiler.trace_sqlalchemy = False {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] profiler_jaeger.process_tags = {} {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] profiler_jaeger.service_name_prefix = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] profiler_otlp.service_name_prefix = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] oslo_policy.enforce_new_defaults = True {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] oslo_policy.policy_default_rule = default {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] oslo_policy.policy_file = policy.yaml {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] oslo_policy.remote_timeout = 60.0 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] privsep_osbrick.group = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] privsep_osbrick.helper_command = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] privsep_osbrick.user = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] cinder_sys_admin.group = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] cinder_sys_admin.helper_command = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] cinder_sys_admin.user = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] service_user.auth_section = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] service_user.auth_type = password {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] service_user.cafile = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] service_user.certfile = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] service_user.collect_timing = False {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] service_user.insecure = False {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] service_user.keyfile = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] service_user.send_service_user_token = True {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] service_user.split_loggers = False {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] service_user.timeout = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] service_user.tls_ciphers = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] service_user.tls_min_version = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] glance.auth_section = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] glance.auth_type = password {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] glance.certfile = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] glance.collect_timing = False {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] glance.insecure = False {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] glance.keyfile = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] glance.region_name = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] glance.split_loggers = False {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] glance.timeout = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] glance.tls_ciphers = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] glance.tls_min_version = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] backend_defaults.backend_availability_zone = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] backend_defaults.chap_password = **** {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] backend_defaults.chap_username = {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] backend_defaults.disk_geometry = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] backend_defaults.driver_client_cert = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] backend_defaults.driver_client_cert_key = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] backend_defaults.driver_data_namespace = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] backend_defaults.driver_use_ssl = False {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] backend_defaults.enable_unsupported_driver = False {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] backend_defaults.extra_capabilities = {} {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] backend_defaults.filter_function = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] backend_defaults.goodness_function = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] backend_defaults.iscsi_target_flags = {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] backend_defaults.iscsi_write_cache = on {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] backend_defaults.iser_helper = tgtadm {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] backend_defaults.iser_ip_address = 192.168.122.235 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] backend_defaults.iser_port = 3260 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] backend_defaults.nas_host = {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] backend_defaults.nas_login = admin {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] backend_defaults.nas_mount_options = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] backend_defaults.nas_password = **** {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] backend_defaults.nas_private_key = {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] backend_defaults.nas_share_path = {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] backend_defaults.nas_ssh_port = 22 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] backend_defaults.num_shell_tries = 3 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] backend_defaults.nvmet_port_id = 1 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] backend_defaults.quobyte_client_cfg = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] backend_defaults.quobyte_volume_url = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] backend_defaults.replication_device = **** {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] backend_defaults.report_discard_supported = False {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] backend_defaults.reserved_percentage = 0 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] backend_defaults.scst_target_driver = iscsi {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] backend_defaults.scst_target_iqn_name = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] backend_defaults.storage_protocol = iSCSI {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] backend_defaults.target_helper = tgtadm {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] backend_defaults.target_ip_address = 192.168.122.235 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] backend_defaults.target_port = 3260 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] backend_defaults.target_protocol = iscsi {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] backend_defaults.trace_flags = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] backend_defaults.unique_fqdn_network = True {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] backend_defaults.use_chap_auth = False {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] backend_defaults.volume_backend_name = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] backend_defaults.volume_clear = zero {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] backend_defaults.volume_clear_ionice = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] backend_defaults.volume_clear_size = 0 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] oslo_reports.file_event_handler = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] oslo_reports.log_dir = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] QuobyteHD.backend_availability_zone = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] QuobyteHD.backend_host = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] QuobyteHD.chap_password = **** {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] QuobyteHD.chap_username = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] QuobyteHD.chiscsi_conf = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] QuobyteHD.disk_geometry = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] QuobyteHD.driver_client_cert = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] QuobyteHD.driver_client_cert_key = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] QuobyteHD.driver_data_namespace = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] QuobyteHD.driver_use_ssl = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] QuobyteHD.extra_capabilities = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] QuobyteHD.filter_function = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] QuobyteHD.goodness_function = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] QuobyteHD.iscsi_target_flags = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] QuobyteHD.iscsi_write_cache = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] QuobyteHD.iser_helper = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] QuobyteHD.iser_ip_address = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] QuobyteHD.iser_port = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] QuobyteHD.iser_target_prefix = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] QuobyteHD.nas_host = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] QuobyteHD.nas_login = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] QuobyteHD.nas_mount_options = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] QuobyteHD.nas_password = **** {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] QuobyteHD.nas_private_key = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] QuobyteHD.nas_share_path = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] QuobyteHD.nas_ssh_port = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] QuobyteHD.num_shell_tries = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] QuobyteHD.nvmet_ns_id = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] QuobyteHD.nvmet_port_id = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] QuobyteHD.replication_device = **** {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] QuobyteHD.report_discard_supported = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] QuobyteHD.reserved_percentage = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] QuobyteHD.scst_target_driver = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] QuobyteHD.storage_protocol = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] QuobyteHD.target_helper = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] QuobyteHD.target_ip_address = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] QuobyteHD.target_port = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] QuobyteHD.target_prefix = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] QuobyteHD.target_protocol = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] QuobyteHD.trace_flags = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] QuobyteHD.unique_fqdn_network = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] QuobyteHD.use_chap_auth = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] QuobyteHD.volume_clear = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] QuobyteHD.volume_clear_ionice = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] QuobyteHD.volume_clear_size = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] QuobyteHD.volumes_dir = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] oslo_messaging_rabbit.ssl = False {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] oslo_messaging_rabbit.ssl_version = {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] oslo_messaging_notifications.driver = [] {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] oslo_messaging_notifications.retry = -1 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] oslo_messaging_notifications.transport_url = **** {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] key_manager.fixed_key = **** {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] barbican.barbican_api_version = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] barbican.barbican_endpoint = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] barbican.barbican_endpoint_type = public {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] barbican.barbican_region_name = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] barbican.cafile = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] barbican.certfile = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] barbican.collect_timing = False {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] barbican.insecure = False {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] barbican.keyfile = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] barbican.number_of_retries = 60 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] barbican.retry_delay = 1 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] barbican.send_service_user_token = False {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] barbican.split_loggers = False {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] barbican.timeout = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] barbican.tls_ciphers = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] barbican.tls_min_version = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] barbican.verify_ssl = True {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] barbican.verify_ssl_path = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] barbican_service_user.auth_section = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] barbican_service_user.auth_type = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] barbican_service_user.cafile = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] barbican_service_user.certfile = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] barbican_service_user.collect_timing = False {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] barbican_service_user.insecure = False {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] barbican_service_user.keyfile = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] barbican_service_user.split_loggers = False {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] barbican_service_user.timeout = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] barbican_service_user.tls_ciphers = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] barbican_service_user.tls_min_version = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] vault.approle_role_id = **** {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] vault.approle_secret_id = **** {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] vault.auth_method = approle {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] vault.auth_path = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] vault.kv_mountpoint = secret {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] vault.kv_path = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] vault.kv_version = 2 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] vault.namespace = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] vault.root_token_id = **** {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] vault.ssl_ca_crt_file = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] vault.timeout = 60.0 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] vault.token_file = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] vault.token_role = None {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] vault.use_ssl = False {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:07 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] ******************************************************************************** {{(pid=85413) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 23 14:30:07 devstack sudo[85631]: pam_unix(sudo:session): session closed for user root Sep 23 14:30:07 devstack cinder-volume[85627]: DEBUG oslo_concurrency.processutils [None req-1231b8ef-b95b-466c-a4d0-90c3654e8995 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.407s {{(pid=85627) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:30:07 devstack cinder-volume[85627]: INFO cinder.volume.drivers.quobyte [None req-1231b8ef-b95b-466c-a4d0-90c3654e8995 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 succeeded Sep 23 14:30:07 devstack cinder-volume[85627]: DEBUG cinder.volume.drivers.quobyte [None req-1231b8ef-b95b-466c-a4d0-90c3654e8995 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=85627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:30:07 devstack cinder-volume[85627]: DEBUG oslo_concurrency.lockutils [None req-1231b8ef-b95b-466c-a4d0-90c3654e8995 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.449s {{(pid=85627) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:30:07 devstack cinder-volume[85627]: DEBUG oslo_concurrency.processutils [None req-1231b8ef-b95b-466c-a4d0-90c3654e8995 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=85627) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:30:07 devstack sudo[85732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:30:07 devstack sudo[85732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:30:07 devstack sudo[85732]: pam_unix(sudo:session): session closed for user root Sep 23 14:30:07 devstack cinder-volume[85627]: DEBUG oslo_concurrency.processutils [None req-1231b8ef-b95b-466c-a4d0-90c3654e8995 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.235s {{(pid=85627) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:30:07 devstack cinder-volume[85627]: INFO cinder.volume.driver [None req-1231b8ef-b95b-466c-a4d0-90c3654e8995 None None] Driver hasn't implemented _init_vendor_properties() Sep 23 14:30:07 devstack cinder-volume[85627]: DEBUG cinder.volume.driver [None req-1231b8ef-b95b-466c-a4d0-90c3654e8995 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.4513206481934, 'free_capacity_gb': 1775.4513206481934, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85627) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 23 14:30:07 devstack cinder-volume[85627]: DEBUG oslo_db.sqlalchemy.engines [None req-1231b8ef-b95b-466c-a4d0-90c3654e8995 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85627) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 14:30:07 devstack cinder-volume[85627]: DEBUG dbcounter [-] [85627] Writer thread running {{(pid=85627) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 23 14:30:07 devstack cinder-volume[85627]: DEBUG cinder.db.api [None req-1231b8ef-b95b-466c-a4d0-90c3654e8995 None None] Building query based on filter {{(pid=85627) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 23 14:30:07 devstack cinder-volume[85627]: DEBUG cinder.image.image_utils [None req-1231b8ef-b95b-466c-a4d0-90c3654e8995 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=85627) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 23 14:30:07 devstack cinder-volume[85627]: INFO cinder.keymgr.migration [None req-94eeaeb3-8510-4e08-882d-3a53b5ae6554 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 23 14:30:07 devstack cinder-volume[85627]: DEBUG oslo_concurrency.lockutils [None req-1231b8ef-b95b-466c-a4d0-90c3654e8995 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85627) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:30:07 devstack cinder-volume[85627]: DEBUG oslo_concurrency.lockutils [None req-1231b8ef-b95b-466c-a4d0-90c3654e8995 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85627) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:30:07 devstack cinder-volume[85627]: DEBUG cinder.volume.drivers.quobyte [None req-1231b8ef-b95b-466c-a4d0-90c3654e8995 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=85627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:30:07 devstack cinder-volume[85627]: DEBUG cinder.volume.drivers.quobyte [None req-1231b8ef-b95b-466c-a4d0-90c3654e8995 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=85627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:30:07 devstack cinder-volume[85627]: DEBUG oslo_concurrency.lockutils [None req-1231b8ef-b95b-466c-a4d0-90c3654e8995 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85627) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:30:07 devstack cinder-volume[85627]: DEBUG oslo_concurrency.processutils [None req-1231b8ef-b95b-466c-a4d0-90c3654e8995 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=85627) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:30:07 devstack sudo[85735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:30:07 devstack sudo[85735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:30:07 devstack cinder-volume[75453]: DEBUG oslo_concurrency.lockutils [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] Acquiring lock "singleton_lock" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 23 14:30:07 devstack cinder-volume[75453]: DEBUG oslo_concurrency.lockutils [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] Acquired lock "singleton_lock" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 23 14:30:07 devstack cinder-volume[75453]: DEBUG oslo_concurrency.lockutils [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] Releasing lock "singleton_lock" {{(pid=75453) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 23 14:30:07 devstack cinder-volume[75453]: WARNING amqp [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 23 14:30:08 devstack cinder-volume[75453]: WARNING amqp [None req-7d457286-3ddd-48b9-9669-53ef220a18d6 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 23 14:30:08 devstack sudo[85735]: pam_unix(sudo:session): session closed for user root Sep 23 14:30:08 devstack cinder-volume[85627]: DEBUG oslo_concurrency.processutils [None req-1231b8ef-b95b-466c-a4d0-90c3654e8995 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.296s {{(pid=85627) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:30:08 devstack cinder-volume[85627]: DEBUG cinder.manager [None req-1231b8ef-b95b-466c-a4d0-90c3654e8995 None None] Notifying Schedulers of capabilities ... {{(pid=85627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:30:08 devstack cinder-volume[85627]: INFO cinder.volume.manager [None req-1231b8ef-b95b-466c-a4d0-90c3654e8995 None None] Driver initialization completed successfully. Sep 23 14:30:08 devstack cinder-volume[85627]: INFO cinder.manager [None req-1231b8ef-b95b-466c-a4d0-90c3654e8995 None None] Initiating service 3 cleanup Sep 23 14:30:08 devstack cinder-volume[85627]: INFO cinder.manager [None req-1231b8ef-b95b-466c-a4d0-90c3654e8995 None None] Service 3 cleanup completed. Sep 23 14:30:08 devstack cinder-volume[85627]: DEBUG cinder.service [None req-1231b8ef-b95b-466c-a4d0-90c3654e8995 None None] Creating RPC server for service cinder-volume {{(pid=85627) start /opt/stack/cinder/cinder/service.py:231}} Sep 23 14:30:08 devstack cinder-volume[85627]: DEBUG cinder.service [None req-1231b8ef-b95b-466c-a4d0-90c3654e8995 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=85627) start /opt/stack/cinder/cinder/service.py:237}} Sep 23 14:30:08 devstack cinder-volume[85627]: INFO cinder.volume.manager [None req-1231b8ef-b95b-466c-a4d0-90c3654e8995 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 23 14:30:08 devstack cinder-volume[85627]: DEBUG oslo_concurrency.lockutils [None req-1231b8ef-b95b-466c-a4d0-90c3654e8995 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85627) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:30:08 devstack cinder-volume[85627]: DEBUG oslo_concurrency.lockutils [None req-1231b8ef-b95b-466c-a4d0-90c3654e8995 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85627) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:30:08 devstack cinder-volume[85627]: DEBUG cinder.volume.drivers.quobyte [None req-1231b8ef-b95b-466c-a4d0-90c3654e8995 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=85627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:30:08 devstack cinder-volume[85627]: DEBUG cinder.volume.drivers.quobyte [None req-1231b8ef-b95b-466c-a4d0-90c3654e8995 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=85627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:30:08 devstack cinder-volume[85627]: DEBUG oslo_concurrency.lockutils [None req-1231b8ef-b95b-466c-a4d0-90c3654e8995 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85627) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:30:08 devstack cinder-volume[85627]: DEBUG oslo_concurrency.processutils [None req-1231b8ef-b95b-466c-a4d0-90c3654e8995 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=85627) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:30:08 devstack sudo[85743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:30:08 devstack sudo[85743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:30:08 devstack sudo[85743]: pam_unix(sudo:session): session closed for user root Sep 23 14:30:08 devstack cinder-volume[85627]: DEBUG oslo_concurrency.processutils [None req-1231b8ef-b95b-466c-a4d0-90c3654e8995 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.324s {{(pid=85627) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:30:08 devstack cinder-volume[85627]: INFO cinder.volume.manager [None req-1231b8ef-b95b-466c-a4d0-90c3654e8995 None None] Driver post RPC initialization completed successfully. Sep 23 14:30:13 devstack cinder-volume[85627]: DEBUG oslo_concurrency.lockutils [None req-373f07c9-9547-48d8-a191-4f6307093f77 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85627) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:30:13 devstack cinder-volume[85627]: DEBUG oslo_concurrency.lockutils [None req-373f07c9-9547-48d8-a191-4f6307093f77 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85627) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:30:13 devstack cinder-volume[85627]: DEBUG cinder.volume.drivers.quobyte [None req-373f07c9-9547-48d8-a191-4f6307093f77 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=85627) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:30:13 devstack cinder-volume[85627]: DEBUG cinder.volume.drivers.quobyte [None req-373f07c9-9547-48d8-a191-4f6307093f77 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=85627) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:30:13 devstack cinder-volume[85627]: DEBUG oslo_concurrency.lockutils [None req-373f07c9-9547-48d8-a191-4f6307093f77 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85627) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:30:13 devstack cinder-volume[85627]: DEBUG oslo_concurrency.processutils [None req-373f07c9-9547-48d8-a191-4f6307093f77 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=85627) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:30:13 devstack sudo[85902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:30:13 devstack sudo[85902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:30:13 devstack sudo[85902]: pam_unix(sudo:session): session closed for user root Sep 23 14:30:13 devstack cinder-volume[85627]: DEBUG oslo_concurrency.processutils [None req-373f07c9-9547-48d8-a191-4f6307093f77 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.231s {{(pid=85627) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:30:13 devstack cinder-volume[85627]: DEBUG cinder.manager [None req-373f07c9-9547-48d8-a191-4f6307093f77 None None] Notifying Schedulers of capabilities ... {{(pid=85627) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:30:16 devstack cinder-volume[85413]: INFO oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] Caught SIGTERM, stopping children Sep 23 14:30:16 devstack cinder-volume[85413]: DEBUG oslo_concurrency.lockutils [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] Acquiring lock "singleton_lock" {{(pid=85413) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 23 14:30:16 devstack cinder-volume[85413]: DEBUG oslo_concurrency.lockutils [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] Acquired lock "singleton_lock" {{(pid=85413) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 23 14:30:16 devstack cinder-volume[85413]: DEBUG oslo_concurrency.lockutils [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] Releasing lock "singleton_lock" {{(pid=85413) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 23 14:30:16 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] Stop services. {{(pid=85413) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 23 14:30:16 devstack cinder-volume[85413]: DEBUG oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] Killing children. {{(pid=85413) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 23 14:30:16 devstack cinder-volume[85413]: INFO oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] Waiting on 1 children to exit Sep 23 14:30:18 devstack cinder-volume[85627]: DEBUG dbcounter [-] [85627] Writing DB stats cinder:SELECT=3 {{(pid=85627) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 14:30:18 devstack cinder-volume[85627]: DEBUG dbcounter [-] [85627] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=85627) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 14:30:21 devstack cinder-volume[85627]: DEBUG oslo_concurrency.lockutils [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] Acquiring lock "singleton_lock" {{(pid=85627) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 23 14:30:21 devstack cinder-volume[85627]: DEBUG oslo_concurrency.lockutils [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] Acquired lock "singleton_lock" {{(pid=85627) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 23 14:30:21 devstack cinder-volume[85627]: DEBUG oslo_concurrency.lockutils [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] Releasing lock "singleton_lock" {{(pid=85627) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 23 14:30:21 devstack cinder-volume[85627]: WARNING amqp [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 23 14:30:21 devstack cinder-volume[85627]: WARNING amqp [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 23 14:30:21 devstack cinder-volume[85413]: INFO oslo_service.backend._eventlet.service [None req-89e6a519-b40a-4969-b7ec-382a50d7ec88 None None] Child 85627 exited with status 0 Sep 23 14:30:22 devstack cinder-volume[86009]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 23 14:30:22 devstack cinder-volume[86009]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 23 14:30:22 devstack cinder-volume[86009]: we strongly recommend against using it for new projects. Sep 23 14:30:22 devstack cinder-volume[86009]: If you are already using Eventlet, we recommend migrating to a different Sep 23 14:30:22 devstack cinder-volume[86009]: framework. For more detail see Sep 23 14:30:22 devstack cinder-volume[86009]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 23 14:30:22 devstack cinder-volume[86009]: import eventlet # noqa Sep 23 14:30:24 devstack cinder-volume[86009]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86009) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 23 14:30:24 devstack cinder-volume[86009]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86009) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 23 14:30:24 devstack cinder-volume[86009]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86009) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 23 14:30:25 devstack cinder-volume[86009]: INFO dbcounter [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] Registered counter for database cinder Sep 23 14:30:25 devstack cinder-volume[86009]: DEBUG oslo_db.sqlalchemy.engines [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86009) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 14:30:25 devstack cinder-volume[86009]: DEBUG dbcounter [-] [86009] Writer thread running {{(pid=86009) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 23 14:30:25 devstack cinder-volume[86009]: INFO cinder.rpc [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 23 14:30:25 devstack cinder-volume[86009]: INFO cinder.rpc [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 23 14:30:25 devstack cinder-volume[86009]: DEBUG oslo_db.sqlalchemy.engines [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86009) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 14:30:25 devstack cinder-volume[86009]: INFO cinder.volume.manager [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] Determined volume DB was empty at startup. Sep 23 14:30:25 devstack cinder-volume[86009]: DEBUG cinder.volume.manager [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86009) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 23 14:30:25 devstack cinder-volume[86009]: WARNING stevedore.named [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 23 14:30:25 devstack cinder-volume[86009]: WARNING castellan.key_manager [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 23 14:30:25 devstack cinder-volume[86009]: WARNING cinder.keymgr.conf_key_mgr [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 23 14:30:25 devstack cinder-volume[86009]: INFO cinder.volume.manager [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_db.sqlalchemy.engines [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86009) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 14:30:26 devstack cinder-volume[86009]: INFO oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] Starting 1 workers Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] Started child 86310 {{(pid=86009) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] Full set of CONF: {{(pid=86009) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] ******************************************************************************** {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] Configuration options gathered from: {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] ================================================================================ {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] allow_availability_zone_fallback = False {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] allow_compression_on_image_upload = False {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] allowed_direct_url_schemes = [] {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] api_rate_limit = True {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] auth_strategy = keystone {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] backend_availability_zone = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] backend_host = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] backend_name = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] backend_stats_polling_interval = 60 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] backup_api_class = cinder.backup.api.API {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] backup_name_template = backup-%s {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] backup_use_same_host = False {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] backup_use_temp_snapshot = False {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86310]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] chap_password = **** {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] chap_username = {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] cinder_internal_tenant_project_id = e43c14861cd0490cbe3f1660a41537bd {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] cinder_internal_tenant_user_id = 86da715c14a942a09f0363264393ee15 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] cluster = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] compression_format = gzip {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] compute_api_class = cinder.compute.nova.API {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] config_dir = [] {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] config_source = [] {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] control_exchange = openstack {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] debug = True {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] default_availability_zone = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] default_group_type = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] default_volume_type = QuobyteHD {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] disk_geometry = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] driver_client_cert = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] driver_client_cert_key = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] driver_data_namespace = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] driver_ssl_cert_path = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] driver_ssl_cert_verify = False {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] driver_use_ssl = False {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] enable_new_services = True {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] enable_unsupported_driver = False {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] enabled_backends = ['QuobyteHD'] {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] enforce_multipath_for_image_xfer = False {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] filter_function = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] glance_api_insecure = False {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] glance_api_servers = ['http://192.168.122.235/image'] {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] glance_api_ssl_compression = False {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] glance_ca_certificates_file = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] glance_catalog_info = image:glance:publicURL {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] glance_certfile = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] glance_keyfile = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] glance_num_retries = 3 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] glance_request_timeout = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] goodness_function = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] graceful_shutdown_timeout = 5 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] group_api_class = cinder.group.api.API {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] host = devstack {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] image_compress_on_upload = True {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] image_conversion_address_space_limit = 1 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] image_conversion_cpu_limit = 60 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] image_conversion_disable = False {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] image_introspection_address_space_limit = 1 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] image_introspection_cpu_limit = 60 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] image_upload_use_cinder_backend = False {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] image_upload_use_internal_tenant = False {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] image_volume_cache_enabled = False {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] image_volume_cache_max_count = 0 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] image_volume_cache_max_size_gb = 0 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] init_host_max_objects_retrieval = 0 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] instance_format = [instance: %(uuid)s] {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] iscsi_target_flags = {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] iscsi_write_cache = on {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] iser_helper = tgtadm {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] iser_ip_address = 192.168.122.235 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] iser_port = 3260 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] log_color = False {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] log_config_append = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] log_dir = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] log_file = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] log_options = True {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] log_rotate_interval = 1 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] log_rotate_interval_type = days {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] log_rotation_type = none {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] max_age = 0 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] max_logfile_count = 30 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] max_logfile_size_mb = 200 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] max_over_subscription_ratio = 20.0 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] message_reap_interval = 86400 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] message_ttl = 2592000 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] migration_create_volume_timeout_secs = 300 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] monkey_patch = False {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] monkey_patch_modules = [] {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] my_ip = 192.168.122.235 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] no_snapshot_gb_quota = False {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] num_iser_scan_tries = 3 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] num_shell_tries = 3 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] num_volume_device_scan_tries = 3 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] nvmeof_conn_info_version = 1 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] nvmet_ns_id = 10 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] nvmet_port_id = 1 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] osapi_max_limit = 1000 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] osapi_volume_ext_list = [] {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] osapi_volume_listen = 0.0.0.0 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] osapi_volume_listen_port = 8776 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] osapi_volume_use_ssl = False {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] osapi_volume_workers = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] per_volume_size_limit = -1 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] periodic_fuzzy_delay = 60 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] periodic_interval = 60 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] project_id_regex = [0-9a-f\-]+ {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] public_endpoint = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] publish_errors = False {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] quota_backup_gigabytes = 1000 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] quota_backups = 10 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] quota_gigabytes = 1000 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] quota_groups = 10 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] quota_snapshots = 10 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] quota_volumes = 10 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] rate_limit_burst = 0 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] rate_limit_except_level = CRITICAL {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] rate_limit_interval = 0 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] reinit_driver_count = 3 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] replication_device = **** {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] report_discard_supported = False {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] report_interval = 120 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] reservation_clean_interval = 86400 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] reservation_expire = 86400 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] reserved_image_namespaces = [] {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] reserved_percentage = 0 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] rpc_response_timeout = 120 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] run_external_periodic_tasks = True {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] scst_target_driver = iscsi {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] scst_target_iqn_name = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] service_down_time = 720 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] shell_completion = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] snapshot_name_template = snapshot-%s {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] split_loggers = False {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] state_path = /opt/stack/data/cinder {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] storage_availability_zone = nova {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] storage_protocol = iSCSI {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] syslog_log_facility = LOG_USER {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] target_helper = lioadm {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] target_ip_address = 192.168.122.235 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] target_port = 3260 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] target_protocol = iscsi {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] target_secondary_ip_addresses = [] {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] trace_flags = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] transfer_api_class = cinder.transfer.api.API {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] transport_url = **** {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] until_refresh = 0 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] use_chap_auth = False {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] use_default_quota_class = True {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] use_journal = False {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] use_json = False {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] use_multipath_for_image_xfer = False {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] use_stderr = False {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] use_syslog = False {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] verify_glance_signatures = enabled {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] volume_api_class = cinder.volume.api.API {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] volume_backend_name = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] volume_clear = zero {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] volume_clear_ionice = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] volume_clear_size = 0 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] volume_copy_bps_limit = 0 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] volume_dd_blocksize = 1M {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] volume_name_template = volume-%s {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] volume_service_inithost_offload = False {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] volume_usage_audit_period = month {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] zoning_mode = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] oslo_concurrency.disable_process_locking = False {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] keystone_authtoken.auth_section = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] keystone_authtoken.auth_type = password {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] keystone_authtoken.auth_version = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] keystone_authtoken.cache = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] keystone_authtoken.certfile = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] keystone_authtoken.delay_auth_decision = False {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-2259da3e-cffd-43a6-9de3-2065780b44c4 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-2259da3e-cffd-43a6-9de3-2065780b44c4 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86310) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] keystone_authtoken.http_connect_timeout = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] keystone_authtoken.include_service_catalog = True {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] keystone_authtoken.insecure = False {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] keystone_authtoken.interface = public {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] keystone_authtoken.keyfile = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] keystone_authtoken.memcache_password = **** {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] keystone_authtoken.memcache_username = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] keystone_authtoken.region_name = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] keystone_authtoken.service_token_roles_required = True {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] keystone_authtoken.service_type = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] keystone_authtoken.token_cache_time = 300 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.235/identity {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] cache.backend = dogpile.cache.null {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] cache.backend_argument = **** {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] cache.backend_expiration_time = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] cache.config_prefix = cache.oslo {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] cache.debug_cache_backend = False {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] cache.enable_retry_client = False {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] cache.enable_socket_keepalive = False {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] cache.enabled = False {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] cache.expiration_time = 600 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] cache.hashclient_retry_attempts = 2 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] cache.memcache_dead_retry = 300 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] cache.memcache_pool_maxsize = 10 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] cache.memcache_sasl_enabled = False {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] cache.password = **** {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] cache.proxies = [] {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] cache.redis_db = 0 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] cache.redis_sentinel_service_name = mymaster {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] cache.redis_server = localhost:6379 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] cache.retry_attempts = 2 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] cache.retry_delay = 0.0 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] cache.socket_keepalive_count = 1 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] cache.socket_keepalive_idle = 1 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] cache.socket_keepalive_interval = 1 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] cache.socket_timeout = 1.0 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] cache.tls_allowed_ciphers = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] cache.tls_cafile = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] cache.tls_certfile = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] cache.tls_enabled = False {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] cache.tls_keyfile = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] cache.username = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] coordination.backend_url = **** {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] database.asyncio_connection = **** {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] database.asyncio_slave_connection = **** {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] database.backend = sqlalchemy {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] database.connection = **** {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] database.connection_debug = 0 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] database.connection_parameters = {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] database.connection_recycle_time = 3600 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] database.connection_trace = False {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] database.db_inc_retry_interval = True {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] database.db_max_retries = 20 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] database.db_max_retry_interval = 10 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] database.db_retry_interval = 1 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] database.max_overflow = 50 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] database.max_pool_size = 5 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] database.max_retries = 10 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] database.mysql_wsrep_sync_wait = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] database.pool_timeout = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] database.retry_interval = 10 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] database.slave_connection = **** {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] database.sqlite_synchronous = True {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] database.synchronous_reader = True {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] database.use_db_reconnect = False {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] oslo_messaging_tracing.insecure = False {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] profiler.connection_string = messaging:// {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] profiler.enabled = False {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] profiler.es_doc_type = notification {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] profiler.es_scroll_size = 10000 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] profiler.es_scroll_time = 2m {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] profiler.filter_error_trace = False {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] profiler.hmac_keys = **** {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] profiler.sentinel_service_name = mymaster {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] profiler.socket_timeout = 0.1 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] profiler.trace_requests = False {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] profiler.trace_sqlalchemy = False {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] profiler_jaeger.process_tags = {} {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] profiler_jaeger.service_name_prefix = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] profiler_otlp.service_name_prefix = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] oslo_policy.enforce_new_defaults = True {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] oslo_policy.policy_default_rule = default {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] oslo_policy.policy_file = policy.yaml {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] oslo_policy.remote_timeout = 60.0 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] privsep_osbrick.group = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] privsep_osbrick.helper_command = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] privsep_osbrick.user = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] cinder_sys_admin.group = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] cinder_sys_admin.helper_command = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] cinder_sys_admin.user = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] service_user.auth_section = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] service_user.auth_type = password {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] service_user.cafile = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] service_user.certfile = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] service_user.collect_timing = False {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] service_user.insecure = False {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] service_user.keyfile = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] service_user.send_service_user_token = True {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] service_user.split_loggers = False {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] service_user.timeout = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] service_user.tls_ciphers = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] service_user.tls_min_version = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] glance.auth_section = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] glance.auth_type = password {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] glance.certfile = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] glance.collect_timing = False {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] glance.insecure = False {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] glance.keyfile = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] glance.region_name = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] glance.split_loggers = False {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] glance.timeout = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] glance.tls_ciphers = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] glance.tls_min_version = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] backend_defaults.backend_availability_zone = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] backend_defaults.chap_password = **** {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] backend_defaults.chap_username = {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] backend_defaults.disk_geometry = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] backend_defaults.driver_client_cert = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] backend_defaults.driver_client_cert_key = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] backend_defaults.driver_data_namespace = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] backend_defaults.driver_use_ssl = False {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] backend_defaults.enable_unsupported_driver = False {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] backend_defaults.extra_capabilities = {} {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] backend_defaults.filter_function = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] backend_defaults.goodness_function = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] backend_defaults.iscsi_target_flags = {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] backend_defaults.iscsi_write_cache = on {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] backend_defaults.iser_helper = tgtadm {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] backend_defaults.iser_ip_address = 192.168.122.235 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] backend_defaults.iser_port = 3260 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] backend_defaults.nas_host = {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] backend_defaults.nas_login = admin {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] backend_defaults.nas_mount_options = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] backend_defaults.nas_password = **** {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] backend_defaults.nas_private_key = {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] backend_defaults.nas_share_path = {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] backend_defaults.nas_ssh_port = 22 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] backend_defaults.num_shell_tries = 3 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] backend_defaults.nvmet_port_id = 1 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] backend_defaults.quobyte_client_cfg = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] backend_defaults.quobyte_volume_url = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] backend_defaults.replication_device = **** {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] backend_defaults.report_discard_supported = False {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] backend_defaults.reserved_percentage = 0 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] backend_defaults.scst_target_driver = iscsi {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] backend_defaults.scst_target_iqn_name = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] backend_defaults.storage_protocol = iSCSI {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] backend_defaults.target_helper = tgtadm {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] backend_defaults.target_ip_address = 192.168.122.235 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] backend_defaults.target_port = 3260 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-2259da3e-cffd-43a6-9de3-2065780b44c4 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86310) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] backend_defaults.target_protocol = iscsi {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] backend_defaults.trace_flags = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] backend_defaults.unique_fqdn_network = True {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] backend_defaults.use_chap_auth = False {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] backend_defaults.volume_backend_name = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] backend_defaults.volume_clear = zero {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86310]: WARNING cinder.volume.drivers.quobyte [None req-2259da3e-cffd-43a6-9de3-2065780b44c4 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] backend_defaults.volume_clear_ionice = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86310]: WARNING cinder.volume.drivers.quobyte [None req-2259da3e-cffd-43a6-9de3-2065780b44c4 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] backend_defaults.volume_clear_size = 0 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] oslo_reports.file_event_handler = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] oslo_reports.log_dir = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] QuobyteHD.backend_availability_zone = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] QuobyteHD.backend_host = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-2259da3e-cffd-43a6-9de3-2065780b44c4 None None] Running cmd (subprocess): mount.quobyte {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] QuobyteHD.chap_password = **** {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] QuobyteHD.chap_username = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] QuobyteHD.chiscsi_conf = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] QuobyteHD.disk_geometry = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] QuobyteHD.driver_client_cert = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] QuobyteHD.driver_client_cert_key = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] QuobyteHD.driver_data_namespace = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] QuobyteHD.driver_use_ssl = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] QuobyteHD.extra_capabilities = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] QuobyteHD.filter_function = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] QuobyteHD.goodness_function = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] QuobyteHD.iscsi_target_flags = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] QuobyteHD.iscsi_write_cache = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] QuobyteHD.iser_helper = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] QuobyteHD.iser_ip_address = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] QuobyteHD.iser_port = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] QuobyteHD.iser_target_prefix = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] QuobyteHD.nas_host = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] QuobyteHD.nas_login = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] QuobyteHD.nas_mount_options = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] QuobyteHD.nas_password = **** {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] QuobyteHD.nas_private_key = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] QuobyteHD.nas_share_path = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] QuobyteHD.nas_ssh_port = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] QuobyteHD.num_shell_tries = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] QuobyteHD.nvmet_ns_id = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] QuobyteHD.nvmet_port_id = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] QuobyteHD.replication_device = **** {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] QuobyteHD.report_discard_supported = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] QuobyteHD.reserved_percentage = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] QuobyteHD.scst_target_driver = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] QuobyteHD.storage_protocol = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] QuobyteHD.target_helper = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] QuobyteHD.target_ip_address = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] QuobyteHD.target_port = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] QuobyteHD.target_prefix = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] QuobyteHD.target_protocol = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] QuobyteHD.trace_flags = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] QuobyteHD.unique_fqdn_network = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] QuobyteHD.use_chap_auth = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] QuobyteHD.volume_clear = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] QuobyteHD.volume_clear_ionice = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] QuobyteHD.volume_clear_size = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] QuobyteHD.volumes_dir = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] oslo_messaging_rabbit.ssl = False {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] oslo_messaging_rabbit.ssl_version = {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] oslo_messaging_notifications.driver = [] {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] oslo_messaging_notifications.retry = -1 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] oslo_messaging_notifications.transport_url = **** {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] key_manager.fixed_key = **** {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] barbican.barbican_api_version = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] barbican.barbican_endpoint = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] barbican.barbican_endpoint_type = public {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] barbican.barbican_region_name = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] barbican.cafile = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] barbican.certfile = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] barbican.collect_timing = False {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] barbican.insecure = False {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] barbican.keyfile = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] barbican.number_of_retries = 60 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] barbican.retry_delay = 1 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] barbican.send_service_user_token = False {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] barbican.split_loggers = False {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack quobyte-client[86311]: Reading configuration file: /etc/quobyte/client.cfg Sep 23 14:30:26 devstack quobyte-client[86311]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] barbican.timeout = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] barbican.tls_ciphers = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] barbican.tls_min_version = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] barbican.verify_ssl = True {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] barbican.verify_ssl_path = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] barbican_service_user.auth_section = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] barbican_service_user.auth_type = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] barbican_service_user.cafile = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] barbican_service_user.certfile = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] barbican_service_user.collect_timing = False {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] barbican_service_user.insecure = False {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] barbican_service_user.keyfile = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-2259da3e-cffd-43a6-9de3-2065780b44c4 None None] CMD "mount.quobyte" returned: 1 in 0.082s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:30:26 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-2259da3e-cffd-43a6-9de3-2065780b44c4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] barbican_service_user.split_loggers = False {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] barbican_service_user.timeout = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] barbican_service_user.tls_ciphers = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-2259da3e-cffd-43a6-9de3-2065780b44c4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:30:26 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-2259da3e-cffd-43a6-9de3-2065780b44c4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] barbican_service_user.tls_min_version = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] vault.approle_role_id = **** {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] vault.approle_secret_id = **** {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] vault.auth_method = approle {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] vault.auth_path = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] vault.kv_mountpoint = secret {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] vault.kv_path = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] vault.kv_version = 2 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] vault.namespace = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] vault.root_token_id = **** {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] vault.ssl_ca_crt_file = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] vault.timeout = 60.0 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] vault.token_file = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] vault.token_role = None {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] vault.use_ssl = False {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 14:30:26 devstack cinder-volume[86009]: DEBUG oslo_service.backend._eventlet.service [None req-cf4142b5-004c-4462-ba39-6290e06a3e3e None None] ******************************************************************************** {{(pid=86009) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 23 14:30:26 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-2259da3e-cffd-43a6-9de3-2065780b44c4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:30:26 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-2259da3e-cffd-43a6-9de3-2065780b44c4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:30:26 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-2259da3e-cffd-43a6-9de3-2065780b44c4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:30:26 devstack sudo[86312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:30:26 devstack sudo[86312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:30:26 devstack sudo[86312]: pam_unix(sudo:session): session closed for user root Sep 23 14:30:26 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-2259da3e-cffd-43a6-9de3-2065780b44c4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.245s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:30:26 devstack cinder-volume[86310]: INFO cinder.volume.driver [None req-2259da3e-cffd-43a6-9de3-2065780b44c4 None None] Driver hasn't implemented _init_vendor_properties() Sep 23 14:30:26 devstack cinder-volume[86310]: DEBUG cinder.volume.driver [None req-2259da3e-cffd-43a6-9de3-2065780b44c4 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.4513206481934, 'free_capacity_gb': 1775.4513206481934, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86310) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 23 14:30:26 devstack cinder-volume[86310]: DEBUG oslo_db.sqlalchemy.engines [None req-2259da3e-cffd-43a6-9de3-2065780b44c4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86310) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 14:30:26 devstack cinder-volume[86310]: DEBUG dbcounter [-] [86310] Writer thread running {{(pid=86310) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 23 14:30:26 devstack cinder-volume[86310]: DEBUG cinder.db.api [None req-2259da3e-cffd-43a6-9de3-2065780b44c4 None None] Building query based on filter {{(pid=86310) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 23 14:30:26 devstack cinder-volume[86310]: DEBUG cinder.image.image_utils [None req-2259da3e-cffd-43a6-9de3-2065780b44c4 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86310) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 23 14:30:26 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-2259da3e-cffd-43a6-9de3-2065780b44c4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:30:26 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-2259da3e-cffd-43a6-9de3-2065780b44c4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:30:26 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-2259da3e-cffd-43a6-9de3-2065780b44c4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:30:26 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-2259da3e-cffd-43a6-9de3-2065780b44c4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:30:26 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-2259da3e-cffd-43a6-9de3-2065780b44c4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:30:26 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-2259da3e-cffd-43a6-9de3-2065780b44c4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:30:26 devstack cinder-volume[86310]: INFO cinder.keymgr.migration [None req-f7861d8e-ddc2-4d3d-a40a-477fe1ba66b8 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 23 14:30:26 devstack sudo[86325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:30:26 devstack sudo[86325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:30:26 devstack sudo[86325]: pam_unix(sudo:session): session closed for user root Sep 23 14:30:26 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-2259da3e-cffd-43a6-9de3-2065780b44c4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.234s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:30:26 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-2259da3e-cffd-43a6-9de3-2065780b44c4 None None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:30:26 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-2259da3e-cffd-43a6-9de3-2065780b44c4 None None] Driver initialization completed successfully. Sep 23 14:30:26 devstack cinder-volume[86310]: INFO cinder.manager [None req-2259da3e-cffd-43a6-9de3-2065780b44c4 None None] Initiating service 3 cleanup Sep 23 14:30:27 devstack cinder-volume[86310]: INFO cinder.manager [None req-2259da3e-cffd-43a6-9de3-2065780b44c4 None None] Service 3 cleanup completed. Sep 23 14:30:27 devstack cinder-volume[86310]: DEBUG cinder.service [None req-2259da3e-cffd-43a6-9de3-2065780b44c4 None None] Creating RPC server for service cinder-volume {{(pid=86310) start /opt/stack/cinder/cinder/service.py:231}} Sep 23 14:30:27 devstack cinder-volume[86310]: DEBUG cinder.service [None req-2259da3e-cffd-43a6-9de3-2065780b44c4 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86310) start /opt/stack/cinder/cinder/service.py:237}} Sep 23 14:30:27 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-2259da3e-cffd-43a6-9de3-2065780b44c4 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 23 14:30:27 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-2259da3e-cffd-43a6-9de3-2065780b44c4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:30:27 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-2259da3e-cffd-43a6-9de3-2065780b44c4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:30:27 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-2259da3e-cffd-43a6-9de3-2065780b44c4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:30:27 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-2259da3e-cffd-43a6-9de3-2065780b44c4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:30:27 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-2259da3e-cffd-43a6-9de3-2065780b44c4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:30:27 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-2259da3e-cffd-43a6-9de3-2065780b44c4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:30:27 devstack sudo[86338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:30:27 devstack sudo[86338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:30:27 devstack sudo[86338]: pam_unix(sudo:session): session closed for user root Sep 23 14:30:27 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-2259da3e-cffd-43a6-9de3-2065780b44c4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.252s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:30:27 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-2259da3e-cffd-43a6-9de3-2065780b44c4 None None] Driver post RPC initialization completed successfully. Sep 23 14:30:36 devstack cinder-volume[86009]: DEBUG dbcounter [-] [86009] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86009) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 14:30:37 devstack cinder-volume[86310]: DEBUG dbcounter [-] [86310] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=86310) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 14:30:37 devstack cinder-volume[86310]: DEBUG dbcounter [-] [86310] Writing DB stats cinder:SELECT=2 {{(pid=86310) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 14:30:51 devstack cinder-volume[86310]: DEBUG oslo_service.periodic_task [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Running periodic task VolumeManager._thread_info {{(pid=86310) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 14:30:51 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] thread count: 6 {{(pid=86310) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 14:30:51 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] thread info: [<_MainThread(MainThread, started 128854208852096)>, , , , , ] {{(pid=86310) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 14:31:39 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b35ac6f-1d55-4682-81c0-f9ebed8d8378 tempest-DeleteServersTestJSON-619617090 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:31:39 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-7b35ac6f-1d55-4682-81c0-f9ebed8d8378 tempest-DeleteServersTestJSON-619617090 None] Flow 'volume_create_manager' (c380b30c-168c-4949-ac18-2877ddee33e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:31:39 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-7b35ac6f-1d55-4682-81c0-f9ebed8d8378 tempest-DeleteServersTestJSON-619617090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98a6647e-5648-442e-9cab-5859df668a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:31:39 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-7b35ac6f-1d55-4682-81c0-f9ebed8d8378 tempest-DeleteServersTestJSON-619617090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98a6647e-5648-442e-9cab-5859df668a5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:31:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-2000707939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a3da6aa-ab94-49aa-a3c3-f8357d290163,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4dd8c687d9748a9a9a6b6280165a9d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:31:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:31:39Z,use_quota=True,user_id='ceb4a6f5155746978fab8db53ba1e7b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:31:39 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-7b35ac6f-1d55-4682-81c0-f9ebed8d8378 tempest-DeleteServersTestJSON-619617090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43acbb57-4f38-401b-8d83-62133a80cddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:31:39 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-7b35ac6f-1d55-4682-81c0-f9ebed8d8378 tempest-DeleteServersTestJSON-619617090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43acbb57-4f38-401b-8d83-62133a80cddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:31:39 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-7b35ac6f-1d55-4682-81c0-f9ebed8d8378 tempest-DeleteServersTestJSON-619617090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8602b1bf-8c88-4cbe-8a7e-7ea6ed0a1b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:31:39 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-7b35ac6f-1d55-4682-81c0-f9ebed8d8378 tempest-DeleteServersTestJSON-619617090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8602b1bf-8c88-4cbe-8a7e-7ea6ed0a1b2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a3da6aa-ab94-49aa-a3c3-f8357d290163', 'volume_name': 'volume-1a3da6aa-ab94-49aa-a3c3-f8357d290163', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:31:39 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-7b35ac6f-1d55-4682-81c0-f9ebed8d8378 tempest-DeleteServersTestJSON-619617090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42d101f8-914c-4e3f-8629-b26150e0b29f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:31:39 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-7b35ac6f-1d55-4682-81c0-f9ebed8d8378 tempest-DeleteServersTestJSON-619617090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42d101f8-914c-4e3f-8629-b26150e0b29f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:31:39 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-7b35ac6f-1d55-4682-81c0-f9ebed8d8378 tempest-DeleteServersTestJSON-619617090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebd77a8a-09ea-4928-9462-02ed67f63dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:31:39 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-7b35ac6f-1d55-4682-81c0-f9ebed8d8378 tempest-DeleteServersTestJSON-619617090 None] Volume 1a3da6aa-ab94-49aa-a3c3-f8357d290163: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a3da6aa-ab94-49aa-a3c3-f8357d290163', 'volume_size': 1} Sep 23 14:31:39 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-7b35ac6f-1d55-4682-81c0-f9ebed8d8378 tempest-DeleteServersTestJSON-619617090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:31:39 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-7b35ac6f-1d55-4682-81c0-f9ebed8d8378 tempest-DeleteServersTestJSON-619617090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:31:39 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-7b35ac6f-1d55-4682-81c0-f9ebed8d8378 tempest-DeleteServersTestJSON-619617090 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:31:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-2000707939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a3da6aa-ab94-49aa-a3c3-f8357d290163,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4dd8c687d9748a9a9a6b6280165a9d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:31:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:31:39Z,use_quota=True,user_id='ceb4a6f5155746978fab8db53ba1e7b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:31:39 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-7b35ac6f-1d55-4682-81c0-f9ebed8d8378 tempest-DeleteServersTestJSON-619617090 None] Creating volume 1a3da6aa-ab94-49aa-a3c3-f8357d290163 {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:31:39 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-7b35ac6f-1d55-4682-81c0-f9ebed8d8378 tempest-DeleteServersTestJSON-619617090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:31:39 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-7b35ac6f-1d55-4682-81c0-f9ebed8d8378 tempest-DeleteServersTestJSON-619617090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:31:39 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-7b35ac6f-1d55-4682-81c0-f9ebed8d8378 tempest-DeleteServersTestJSON-619617090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:31:39 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-7b35ac6f-1d55-4682-81c0-f9ebed8d8378 tempest-DeleteServersTestJSON-619617090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:31:39 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-7b35ac6f-1d55-4682-81c0-f9ebed8d8378 tempest-DeleteServersTestJSON-619617090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:31:39 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-7b35ac6f-1d55-4682-81c0-f9ebed8d8378 tempest-DeleteServersTestJSON-619617090 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:31:39 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-7b35ac6f-1d55-4682-81c0-f9ebed8d8378 tempest-DeleteServersTestJSON-619617090 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:31:39 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-7b35ac6f-1d55-4682-81c0-f9ebed8d8378 tempest-DeleteServersTestJSON-619617090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-1a3da6aa-ab94-49aa-a3c3-f8357d290163 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:31:39 devstack sudo[87070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-1a3da6aa-ab94-49aa-a3c3-f8357d290163 1073741824 Sep 23 14:31:39 devstack sudo[87070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:31:40 devstack sudo[87070]: pam_unix(sudo:session): session closed for user root Sep 23 14:31:40 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-7b35ac6f-1d55-4682-81c0-f9ebed8d8378 tempest-DeleteServersTestJSON-619617090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-1a3da6aa-ab94-49aa-a3c3-f8357d290163 1073741824" returned: 0 in 1.260s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:31:41 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-7b35ac6f-1d55-4682-81c0-f9ebed8d8378 tempest-DeleteServersTestJSON-619617090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-1a3da6aa-ab94-49aa-a3c3-f8357d290163 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:31:41 devstack sudo[87390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-1a3da6aa-ab94-49aa-a3c3-f8357d290163 Sep 23 14:31:41 devstack sudo[87390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:31:41 devstack sudo[87390]: pam_unix(sudo:session): session closed for user root Sep 23 14:31:41 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-7b35ac6f-1d55-4682-81c0-f9ebed8d8378 tempest-DeleteServersTestJSON-619617090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-1a3da6aa-ab94-49aa-a3c3-f8357d290163" returned: 0 in 0.483s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:31:41 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-7b35ac6f-1d55-4682-81c0-f9ebed8d8378 tempest-DeleteServersTestJSON-619617090 None] <== create_volume: return (1848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:31:41 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-7b35ac6f-1d55-4682-81c0-f9ebed8d8378 tempest-DeleteServersTestJSON-619617090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.853s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:31:41 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-7b35ac6f-1d55-4682-81c0-f9ebed8d8378 tempest-DeleteServersTestJSON-619617090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebd77a8a-09ea-4928-9462-02ed67f63dc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a3da6aa-ab94-49aa-a3c3-f8357d290163', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:31:41 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-7b35ac6f-1d55-4682-81c0-f9ebed8d8378 tempest-DeleteServersTestJSON-619617090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80558e27-1d2e-47c9-af39-aafcdbe0559a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:31:41 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-7b35ac6f-1d55-4682-81c0-f9ebed8d8378 tempest-DeleteServersTestJSON-619617090 None] Volume volume-1a3da6aa-ab94-49aa-a3c3-f8357d290163 (1a3da6aa-ab94-49aa-a3c3-f8357d290163): created successfully Sep 23 14:31:41 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-7b35ac6f-1d55-4682-81c0-f9ebed8d8378 tempest-DeleteServersTestJSON-619617090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80558e27-1d2e-47c9-af39-aafcdbe0559a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:31:41 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-7b35ac6f-1d55-4682-81c0-f9ebed8d8378 tempest-DeleteServersTestJSON-619617090 None] Flow 'volume_create_manager' (c380b30c-168c-4949-ac18-2877ddee33e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:31:41 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-7b35ac6f-1d55-4682-81c0-f9ebed8d8378 tempest-DeleteServersTestJSON-619617090 None] Created volume successfully. Sep 23 14:31:44 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-1301fe95-1ed2-49a5-ae13-415bb2bc0516 tempest-VolumesAdminNegativeTest-151034585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:31:44 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-1301fe95-1ed2-49a5-ae13-415bb2bc0516 tempest-VolumesAdminNegativeTest-151034585 None] Flow 'volume_create_manager' (e9017fab-3e22-40d2-b647-0bd583288e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:31:44 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-1301fe95-1ed2-49a5-ae13-415bb2bc0516 tempest-VolumesAdminNegativeTest-151034585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47575165-8344-4511-8e82-9623866337d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:31:44 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-1301fe95-1ed2-49a5-ae13-415bb2bc0516 tempest-VolumesAdminNegativeTest-151034585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47575165-8344-4511-8e82-9623866337d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:31:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1352006139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba7e890c-9471-49a4-a072-9e83abc0826f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56a65f7cea6e4a5f8097856d9320f567',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:31:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:31:44Z,use_quota=True,user_id='36eaf823c5f743fdae545eb7ab367011',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:31:44 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-1301fe95-1ed2-49a5-ae13-415bb2bc0516 tempest-VolumesAdminNegativeTest-151034585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6912ec9d-30da-468c-88d1-155078f0537d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:31:44 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-1301fe95-1ed2-49a5-ae13-415bb2bc0516 tempest-VolumesAdminNegativeTest-151034585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6912ec9d-30da-468c-88d1-155078f0537d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:31:44 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-1301fe95-1ed2-49a5-ae13-415bb2bc0516 tempest-VolumesAdminNegativeTest-151034585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84dcad88-cd8e-427e-96da-2e080a1c8ef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:31:44 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-1301fe95-1ed2-49a5-ae13-415bb2bc0516 tempest-VolumesAdminNegativeTest-151034585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84dcad88-cd8e-427e-96da-2e080a1c8ef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba7e890c-9471-49a4-a072-9e83abc0826f', 'volume_name': 'volume-ba7e890c-9471-49a4-a072-9e83abc0826f', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:31:44 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-1301fe95-1ed2-49a5-ae13-415bb2bc0516 tempest-VolumesAdminNegativeTest-151034585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d663a1b-4c7d-4ad7-ad7c-7b0b75de1cdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:31:44 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-1301fe95-1ed2-49a5-ae13-415bb2bc0516 tempest-VolumesAdminNegativeTest-151034585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d663a1b-4c7d-4ad7-ad7c-7b0b75de1cdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:31:44 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-1301fe95-1ed2-49a5-ae13-415bb2bc0516 tempest-VolumesAdminNegativeTest-151034585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bf044cb-79c8-4345-abb9-276989e7d781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:31:44 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-1301fe95-1ed2-49a5-ae13-415bb2bc0516 tempest-VolumesAdminNegativeTest-151034585 None] Volume ba7e890c-9471-49a4-a072-9e83abc0826f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba7e890c-9471-49a4-a072-9e83abc0826f', 'volume_size': 1} Sep 23 14:31:44 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-1301fe95-1ed2-49a5-ae13-415bb2bc0516 tempest-VolumesAdminNegativeTest-151034585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:31:44 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-1301fe95-1ed2-49a5-ae13-415bb2bc0516 tempest-VolumesAdminNegativeTest-151034585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:31:44 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-1301fe95-1ed2-49a5-ae13-415bb2bc0516 tempest-VolumesAdminNegativeTest-151034585 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:31:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1352006139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba7e890c-9471-49a4-a072-9e83abc0826f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56a65f7cea6e4a5f8097856d9320f567',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:31:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:31:44Z,use_quota=True,user_id='36eaf823c5f743fdae545eb7ab367011',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:31:44 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-1301fe95-1ed2-49a5-ae13-415bb2bc0516 tempest-VolumesAdminNegativeTest-151034585 None] Creating volume ba7e890c-9471-49a4-a072-9e83abc0826f {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:31:44 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-1301fe95-1ed2-49a5-ae13-415bb2bc0516 tempest-VolumesAdminNegativeTest-151034585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:31:44 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-1301fe95-1ed2-49a5-ae13-415bb2bc0516 tempest-VolumesAdminNegativeTest-151034585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:31:44 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-1301fe95-1ed2-49a5-ae13-415bb2bc0516 tempest-VolumesAdminNegativeTest-151034585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:31:44 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-1301fe95-1ed2-49a5-ae13-415bb2bc0516 tempest-VolumesAdminNegativeTest-151034585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:31:44 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-1301fe95-1ed2-49a5-ae13-415bb2bc0516 tempest-VolumesAdminNegativeTest-151034585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:31:44 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-1301fe95-1ed2-49a5-ae13-415bb2bc0516 tempest-VolumesAdminNegativeTest-151034585 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:31:44 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-1301fe95-1ed2-49a5-ae13-415bb2bc0516 tempest-VolumesAdminNegativeTest-151034585 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:31:44 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-1301fe95-1ed2-49a5-ae13-415bb2bc0516 tempest-VolumesAdminNegativeTest-151034585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-ba7e890c-9471-49a4-a072-9e83abc0826f 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:31:44 devstack sudo[87401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-ba7e890c-9471-49a4-a072-9e83abc0826f 1073741824 Sep 23 14:31:44 devstack sudo[87401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:31:45 devstack sudo[87401]: pam_unix(sudo:session): session closed for user root Sep 23 14:31:45 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-1301fe95-1ed2-49a5-ae13-415bb2bc0516 tempest-VolumesAdminNegativeTest-151034585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-ba7e890c-9471-49a4-a072-9e83abc0826f 1073741824" returned: 0 in 0.960s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:31:45 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-1301fe95-1ed2-49a5-ae13-415bb2bc0516 tempest-VolumesAdminNegativeTest-151034585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-ba7e890c-9471-49a4-a072-9e83abc0826f {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:31:45 devstack sudo[87411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-ba7e890c-9471-49a4-a072-9e83abc0826f Sep 23 14:31:45 devstack sudo[87411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:31:46 devstack sudo[87411]: pam_unix(sudo:session): session closed for user root Sep 23 14:31:46 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-1301fe95-1ed2-49a5-ae13-415bb2bc0516 tempest-VolumesAdminNegativeTest-151034585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-ba7e890c-9471-49a4-a072-9e83abc0826f" returned: 0 in 0.428s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:31:46 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-1301fe95-1ed2-49a5-ae13-415bb2bc0516 tempest-VolumesAdminNegativeTest-151034585 None] <== create_volume: return (1470ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:31:46 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-1301fe95-1ed2-49a5-ae13-415bb2bc0516 tempest-VolumesAdminNegativeTest-151034585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.481s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:31:46 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-1301fe95-1ed2-49a5-ae13-415bb2bc0516 tempest-VolumesAdminNegativeTest-151034585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bf044cb-79c8-4345-abb9-276989e7d781) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba7e890c-9471-49a4-a072-9e83abc0826f', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:31:46 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-1301fe95-1ed2-49a5-ae13-415bb2bc0516 tempest-VolumesAdminNegativeTest-151034585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4523dc4c-5c23-48f5-8655-39f8f2284095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:31:46 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-1301fe95-1ed2-49a5-ae13-415bb2bc0516 tempest-VolumesAdminNegativeTest-151034585 None] Volume volume-ba7e890c-9471-49a4-a072-9e83abc0826f (ba7e890c-9471-49a4-a072-9e83abc0826f): created successfully Sep 23 14:31:46 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-1301fe95-1ed2-49a5-ae13-415bb2bc0516 tempest-VolumesAdminNegativeTest-151034585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4523dc4c-5c23-48f5-8655-39f8f2284095) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:31:46 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-1301fe95-1ed2-49a5-ae13-415bb2bc0516 tempest-VolumesAdminNegativeTest-151034585 None] Flow 'volume_create_manager' (e9017fab-3e22-40d2-b647-0bd583288e43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:31:46 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-1301fe95-1ed2-49a5-ae13-415bb2bc0516 tempest-VolumesAdminNegativeTest-151034585 None] Created volume successfully. Sep 23 14:31:48 devstack cinder-volume[86310]: WARNING py.warnings [req-82d9b2b0-0468-43ac-884d-93776ef73a0c req-fd259134-12c5-48b5-bd4b-e12cd7fa98cf tempest-DeleteServersTestJSON-619617090 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes_1", "volume_attachment" and FROM element "volumes". Apply join condition(s) between each element to resolve. Sep 23 14:31:48 devstack cinder-volume[86310]: .first() Sep 23 14:31:48 devstack cinder-volume[86310]: Sep 23 14:31:48 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [req-82d9b2b0-0468-43ac-884d-93776ef73a0c req-fd259134-12c5-48b5-bd4b-e12cd7fa98cf tempest-DeleteServersTestJSON-619617090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:31:48 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [req-82d9b2b0-0468-43ac-884d-93776ef73a0c req-fd259134-12c5-48b5-bd4b-e12cd7fa98cf tempest-DeleteServersTestJSON-619617090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:31:48 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [req-82d9b2b0-0468-43ac-884d-93776ef73a0c req-fd259134-12c5-48b5-bd4b-e12cd7fa98cf tempest-DeleteServersTestJSON-619617090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.047s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:31:48 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [req-82d9b2b0-0468-43ac-884d-93776ef73a0c req-fd259134-12c5-48b5-bd4b-e12cd7fa98cf tempest-DeleteServersTestJSON-619617090 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362', 'name': 'volume-1a3da6aa-ab94-49aa-a3c3-f8357d290163', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'db7e4802-0b61-4957-bc00-0c4e7750a197', 'enforce_multipath': True} {{(pid=86310) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 14:31:48 devstack cinder-volume[86310]: INFO cinder.volume.manager [req-82d9b2b0-0468-43ac-884d-93776ef73a0c req-fd259134-12c5-48b5-bd4b-e12cd7fa98cf tempest-DeleteServersTestJSON-619617090 None] attachment_update completed successfully. Sep 23 14:31:48 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-ef79a404-9f43-4723-893f-44c2b31d6125 tempest-VolumesAdminNegativeTest-151034585 None] Acquiring lock "cinder-ba7e890c-9471-49a4-a072-9e83abc0826f-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:31:48 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-ef79a404-9f43-4723-893f-44c2b31d6125 tempest-VolumesAdminNegativeTest-151034585 None] Lock "cinder-ba7e890c-9471-49a4-a072-9e83abc0826f-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:31:48 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-ef79a404-9f43-4723-893f-44c2b31d6125 tempest-VolumesAdminNegativeTest-151034585 None] Acquiring lock "cinder-quobyte-ba7e890c-9471-49a4-a072-9e83abc0826f" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:31:48 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-ef79a404-9f43-4723-893f-44c2b31d6125 tempest-VolumesAdminNegativeTest-151034585 None] Lock "cinder-quobyte-ba7e890c-9471-49a4-a072-9e83abc0826f" acquired by "delete_volume" :: waited 0.030s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:31:48 devstack cinder-volume[86310]: INFO oslo.privsep.daemon [None req-ef79a404-9f43-4723-893f-44c2b31d6125 tempest-VolumesAdminNegativeTest-151034585 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpqofab5w4/privsep.sock'] Sep 23 14:31:48 devstack sudo[87429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpqofab5w4/privsep.sock Sep 23 14:31:48 devstack sudo[87429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:31:50 devstack cinder-volume[86310]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 23 14:31:50 devstack cinder-volume[86310]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 23 14:31:50 devstack cinder-volume[86310]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 23 14:31:50 devstack cinder-volume[86310]: WARNING oslo.privsep.daemon [-] privsep log: Sep 23 14:31:50 devstack cinder-volume[86310]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 23 14:31:50 devstack cinder-volume[86310]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 23 14:31:50 devstack cinder-volume[86310]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 23 14:31:50 devstack cinder-volume[86310]: WARNING oslo.privsep.daemon [-] privsep log: Sep 23 14:31:50 devstack cinder-volume[86310]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 23 14:31:50 devstack sudo[87429]: pam_unix(sudo:session): session closed for user root Sep 23 14:31:50 devstack cinder-volume[86310]: INFO oslo.privsep.daemon [None req-ef79a404-9f43-4723-893f-44c2b31d6125 tempest-VolumesAdminNegativeTest-151034585 None] Spawned new privsep daemon via rootwrap Sep 23 14:31:50 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [None req-ef79a404-9f43-4723-893f-44c2b31d6125 tempest-VolumesAdminNegativeTest-151034585 None] Accepted privsep connection to /tmp/tmpqofab5w4/privsep.sock {{(pid=86310) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 23 14:31:50 devstack cinder-volume[86310]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 23 14:31:50 devstack cinder-volume[86310]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 23 14:31:50 devstack cinder-volume[86310]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 23 14:31:50 devstack cinder-volume[86310]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87848 Sep 23 14:31:50 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6d37b00-acbc-4484-ab8f-5e56623e2882]: (2,) {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:31:50 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[21636020-1700-45b6-80bd-f5e0c114bde9]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:31:50 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ef79a404-9f43-4723-893f-44c2b31d6125 tempest-VolumesAdminNegativeTest-151034585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-ba7e890c-9471-49a4-a072-9e83abc0826f {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:31:50 devstack sudo[87850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-ba7e890c-9471-49a4-a072-9e83abc0826f Sep 23 14:31:50 devstack sudo[87850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:31:51 devstack sudo[87850]: pam_unix(sudo:session): session closed for user root Sep 23 14:31:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ef79a404-9f43-4723-893f-44c2b31d6125 tempest-VolumesAdminNegativeTest-151034585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-ba7e890c-9471-49a4-a072-9e83abc0826f" returned: 0 in 0.734s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:31:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ef79a404-9f43-4723-893f-44c2b31d6125 tempest-VolumesAdminNegativeTest-151034585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-ba7e890c-9471-49a4-a072-9e83abc0826f {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:31:51 devstack sudo[87857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-ba7e890c-9471-49a4-a072-9e83abc0826f Sep 23 14:31:51 devstack sudo[87857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:31:51 devstack cinder-volume[86310]: DEBUG oslo_service.periodic_task [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86310) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 14:31:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:31:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:31:51 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:31:51 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:31:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:31:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:31:51 devstack sudo[87860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:31:51 devstack sudo[87860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:31:51 devstack sudo[87860]: pam_unix(sudo:session): session closed for user root Sep 23 14:31:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.494s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:31:51 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:31:51 devstack cinder-volume[86310]: DEBUG oslo_service.periodic_task [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Running periodic task VolumeManager._thread_info {{(pid=86310) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 14:31:51 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] thread count: 8 {{(pid=86310) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 14:31:51 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] thread info: [<_MainThread(MainThread, started 128854208852096)>, , , , , , , ] {{(pid=86310) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 14:31:52 devstack sudo[87857]: pam_unix(sudo:session): session closed for user root Sep 23 14:31:52 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ef79a404-9f43-4723-893f-44c2b31d6125 tempest-VolumesAdminNegativeTest-151034585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-ba7e890c-9471-49a4-a072-9e83abc0826f" returned: 0 in 0.830s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:31:52 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-ef79a404-9f43-4723-893f-44c2b31d6125 tempest-VolumesAdminNegativeTest-151034585 None] Lock "cinder-quobyte-ba7e890c-9471-49a4-a072-9e83abc0826f" released by "delete_volume" :: held 3.652s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:31:52 devstack cinder-volume[86310]: WARNING cinder.quota [None req-ef79a404-9f43-4723-893f-44c2b31d6125 tempest-VolumesAdminNegativeTest-151034585 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 23 14:31:52 devstack cinder-volume[86310]: WARNING cinder.quota [None req-ef79a404-9f43-4723-893f-44c2b31d6125 tempest-VolumesAdminNegativeTest-151034585 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 23 14:31:52 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-ef79a404-9f43-4723-893f-44c2b31d6125 tempest-VolumesAdminNegativeTest-151034585 None] Created reservations ['516b20e2-7e18-4dd0-b9e3-a64dfb3d79ad', '9001e02f-92fa-4901-ad13-9b40537b0854', 'f5dd11dd-6f54-498c-9e07-b0694b9dcd29', '6b6bfaec-188c-4496-ba33-99fe69ae9c39'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:31:52 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-ef79a404-9f43-4723-893f-44c2b31d6125 tempest-VolumesAdminNegativeTest-151034585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:31:52 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-ef79a404-9f43-4723-893f-44c2b31d6125 tempest-VolumesAdminNegativeTest-151034585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:31:52 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-ef79a404-9f43-4723-893f-44c2b31d6125 tempest-VolumesAdminNegativeTest-151034585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:31:52 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-ef79a404-9f43-4723-893f-44c2b31d6125 tempest-VolumesAdminNegativeTest-151034585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:31:52 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-ef79a404-9f43-4723-893f-44c2b31d6125 tempest-VolumesAdminNegativeTest-151034585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:31:52 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ef79a404-9f43-4723-893f-44c2b31d6125 tempest-VolumesAdminNegativeTest-151034585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:31:52 devstack sudo[87953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:31:52 devstack sudo[87953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:31:53 devstack sudo[87953]: pam_unix(sudo:session): session closed for user root Sep 23 14:31:53 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ef79a404-9f43-4723-893f-44c2b31d6125 tempest-VolumesAdminNegativeTest-151034585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.504s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:31:53 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-ef79a404-9f43-4723-893f-44c2b31d6125 tempest-VolumesAdminNegativeTest-151034585 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:31:53 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-ef79a404-9f43-4723-893f-44c2b31d6125 tempest-VolumesAdminNegativeTest-151034585 None] Deleted volume successfully. Sep 23 14:31:53 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-ef79a404-9f43-4723-893f-44c2b31d6125 tempest-VolumesAdminNegativeTest-151034585 None] Lock "cinder-ba7e890c-9471-49a4-a072-9e83abc0826f-delete_volume" released by "delete_volume" :: held 4.759s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:31:54 devstack cinder-volume[86310]: INFO cinder.volume.manager [req-0f0ec6e4-bfb2-4adc-9ed2-c6dc156c46a9 req-1dc1f1e3-b700-4e31-b1f1-444975f444fd tempest-DeleteServersTestJSON-619617090 None] Terminate volume connection completed successfully. Sep 23 14:31:54 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [req-0f0ec6e4-bfb2-4adc-9ed2-c6dc156c46a9 req-1dc1f1e3-b700-4e31-b1f1-444975f444fd tempest-DeleteServersTestJSON-619617090 None] Deleting attachment db7e4802-0b61-4957-bc00-0c4e7750a197. {{(pid=86310) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 14:31:55 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-85c95ef7-3b6f-4c4d-ad94-4e9fe162d25a tempest-DeleteServersTestJSON-619617090 None] Acquiring lock "cinder-1a3da6aa-ab94-49aa-a3c3-f8357d290163-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:31:55 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-85c95ef7-3b6f-4c4d-ad94-4e9fe162d25a tempest-DeleteServersTestJSON-619617090 None] Lock "cinder-1a3da6aa-ab94-49aa-a3c3-f8357d290163-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:31:55 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-85c95ef7-3b6f-4c4d-ad94-4e9fe162d25a tempest-DeleteServersTestJSON-619617090 None] Acquiring lock "cinder-quobyte-1a3da6aa-ab94-49aa-a3c3-f8357d290163" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:31:55 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-85c95ef7-3b6f-4c4d-ad94-4e9fe162d25a tempest-DeleteServersTestJSON-619617090 None] Lock "cinder-quobyte-1a3da6aa-ab94-49aa-a3c3-f8357d290163" acquired by "delete_volume" :: waited 0.017s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:31:55 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[61a6d3e0-1436-42c4-b873-cb858f89746e]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:31:55 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-85c95ef7-3b6f-4c4d-ad94-4e9fe162d25a tempest-DeleteServersTestJSON-619617090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-1a3da6aa-ab94-49aa-a3c3-f8357d290163 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:31:56 devstack sudo[87988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-1a3da6aa-ab94-49aa-a3c3-f8357d290163 Sep 23 14:31:56 devstack sudo[87988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:31:56 devstack sudo[87988]: pam_unix(sudo:session): session closed for user root Sep 23 14:31:56 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-85c95ef7-3b6f-4c4d-ad94-4e9fe162d25a tempest-DeleteServersTestJSON-619617090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-1a3da6aa-ab94-49aa-a3c3-f8357d290163" returned: 0 in 0.413s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:31:56 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-85c95ef7-3b6f-4c4d-ad94-4e9fe162d25a tempest-DeleteServersTestJSON-619617090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-1a3da6aa-ab94-49aa-a3c3-f8357d290163 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:31:56 devstack sudo[87993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-1a3da6aa-ab94-49aa-a3c3-f8357d290163 Sep 23 14:31:56 devstack sudo[87993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:31:56 devstack sudo[87993]: pam_unix(sudo:session): session closed for user root Sep 23 14:31:56 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-85c95ef7-3b6f-4c4d-ad94-4e9fe162d25a tempest-DeleteServersTestJSON-619617090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-1a3da6aa-ab94-49aa-a3c3-f8357d290163" returned: 0 in 0.309s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:31:56 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-85c95ef7-3b6f-4c4d-ad94-4e9fe162d25a tempest-DeleteServersTestJSON-619617090 None] Lock "cinder-quobyte-1a3da6aa-ab94-49aa-a3c3-f8357d290163" released by "delete_volume" :: held 0.798s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:31:56 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-85c95ef7-3b6f-4c4d-ad94-4e9fe162d25a tempest-DeleteServersTestJSON-619617090 None] Created reservations ['ba25dabc-52e2-4445-b294-fa5853a98b96', '65d37d19-00dd-4f65-b72c-ea641597db94', '36715b0d-4afc-4f8c-944f-454f7a6c2f3c', 'cb72daab-638d-42e3-b8ec-a85d8077dd38'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:31:56 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-85c95ef7-3b6f-4c4d-ad94-4e9fe162d25a tempest-DeleteServersTestJSON-619617090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:31:56 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-85c95ef7-3b6f-4c4d-ad94-4e9fe162d25a tempest-DeleteServersTestJSON-619617090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:31:56 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-85c95ef7-3b6f-4c4d-ad94-4e9fe162d25a tempest-DeleteServersTestJSON-619617090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:31:56 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-85c95ef7-3b6f-4c4d-ad94-4e9fe162d25a tempest-DeleteServersTestJSON-619617090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:31:56 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-85c95ef7-3b6f-4c4d-ad94-4e9fe162d25a tempest-DeleteServersTestJSON-619617090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:31:56 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-85c95ef7-3b6f-4c4d-ad94-4e9fe162d25a tempest-DeleteServersTestJSON-619617090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:31:56 devstack sudo[87997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:31:56 devstack sudo[87997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:31:57 devstack sudo[87997]: pam_unix(sudo:session): session closed for user root Sep 23 14:31:57 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-85c95ef7-3b6f-4c4d-ad94-4e9fe162d25a tempest-DeleteServersTestJSON-619617090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.271s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:31:57 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-85c95ef7-3b6f-4c4d-ad94-4e9fe162d25a tempest-DeleteServersTestJSON-619617090 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:31:57 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-85c95ef7-3b6f-4c4d-ad94-4e9fe162d25a tempest-DeleteServersTestJSON-619617090 None] Deleted volume successfully. Sep 23 14:31:57 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-85c95ef7-3b6f-4c4d-ad94-4e9fe162d25a tempest-DeleteServersTestJSON-619617090 None] Lock "cinder-1a3da6aa-ab94-49aa-a3c3-f8357d290163-delete_volume" released by "delete_volume" :: held 1.307s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:32:06 devstack cinder-volume[86310]: DEBUG dbcounter [-] [86310] Writing DB stats cinder:SELECT=23,cinder:UPDATE=27,cinder:INSERT=6,cinder:DELETE=1 {{(pid=86310) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 14:32:07 devstack cinder-volume[86310]: DEBUG dbcounter [-] [86310] Writing DB stats cinder:SELECT=20,cinder:INSERT=4,cinder:UPDATE=20,cinder:DELETE=3 {{(pid=86310) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 14:32:10 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-1142240b-2304-4855-b6fa-b4b0dbca9484 tempest-ServerActionsTestOtherA-561903914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:32:10 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-1142240b-2304-4855-b6fa-b4b0dbca9484 tempest-ServerActionsTestOtherA-561903914 None] Flow 'volume_create_manager' (e71e842c-cc9c-4756-afbd-8a5534e8adf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:32:10 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-1142240b-2304-4855-b6fa-b4b0dbca9484 tempest-ServerActionsTestOtherA-561903914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47530832-8d6f-4c14-9ffc-8c1866789319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:32:10 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-1142240b-2304-4855-b6fa-b4b0dbca9484 tempest-ServerActionsTestOtherA-561903914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47530832-8d6f-4c14-9ffc-8c1866789319) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:32:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-452554616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d392aec4-68f9-4e0d-b0d2-dc2355f8d2ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b055817b1834ad0899ce2ada1a4aa1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:32:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:32:10Z,use_quota=True,user_id='e96390e2252549d2bb096b1fef585b11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:32:10 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-1142240b-2304-4855-b6fa-b4b0dbca9484 tempest-ServerActionsTestOtherA-561903914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2012fe20-7b62-4da2-a126-b4b5d2f07b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:32:10 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-1142240b-2304-4855-b6fa-b4b0dbca9484 tempest-ServerActionsTestOtherA-561903914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2012fe20-7b62-4da2-a126-b4b5d2f07b8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:32:10 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-1142240b-2304-4855-b6fa-b4b0dbca9484 tempest-ServerActionsTestOtherA-561903914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1aa9fe4-ae7d-4ac3-bccf-ee0bc054e359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:32:10 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-1142240b-2304-4855-b6fa-b4b0dbca9484 tempest-ServerActionsTestOtherA-561903914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1aa9fe4-ae7d-4ac3-bccf-ee0bc054e359) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd392aec4-68f9-4e0d-b0d2-dc2355f8d2ac', 'volume_name': 'volume-d392aec4-68f9-4e0d-b0d2-dc2355f8d2ac', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:32:10 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-1142240b-2304-4855-b6fa-b4b0dbca9484 tempest-ServerActionsTestOtherA-561903914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dda2589e-bfda-4fc0-ad6a-6cbdf8b7d97f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:32:10 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-1142240b-2304-4855-b6fa-b4b0dbca9484 tempest-ServerActionsTestOtherA-561903914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dda2589e-bfda-4fc0-ad6a-6cbdf8b7d97f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:32:10 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-1142240b-2304-4855-b6fa-b4b0dbca9484 tempest-ServerActionsTestOtherA-561903914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6f3b7dd-46af-470a-8004-7195c2942613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:32:10 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-1142240b-2304-4855-b6fa-b4b0dbca9484 tempest-ServerActionsTestOtherA-561903914 None] Volume d392aec4-68f9-4e0d-b0d2-dc2355f8d2ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d392aec4-68f9-4e0d-b0d2-dc2355f8d2ac', 'volume_size': 1} Sep 23 14:32:10 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-1142240b-2304-4855-b6fa-b4b0dbca9484 tempest-ServerActionsTestOtherA-561903914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:32:10 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-1142240b-2304-4855-b6fa-b4b0dbca9484 tempest-ServerActionsTestOtherA-561903914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:32:10 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-1142240b-2304-4855-b6fa-b4b0dbca9484 tempest-ServerActionsTestOtherA-561903914 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:32:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-452554616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d392aec4-68f9-4e0d-b0d2-dc2355f8d2ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b055817b1834ad0899ce2ada1a4aa1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:32:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:32:10Z,use_quota=True,user_id='e96390e2252549d2bb096b1fef585b11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:32:10 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-1142240b-2304-4855-b6fa-b4b0dbca9484 tempest-ServerActionsTestOtherA-561903914 None] Creating volume d392aec4-68f9-4e0d-b0d2-dc2355f8d2ac {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:32:10 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-1142240b-2304-4855-b6fa-b4b0dbca9484 tempest-ServerActionsTestOtherA-561903914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:32:10 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-1142240b-2304-4855-b6fa-b4b0dbca9484 tempest-ServerActionsTestOtherA-561903914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:32:10 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-1142240b-2304-4855-b6fa-b4b0dbca9484 tempest-ServerActionsTestOtherA-561903914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:32:10 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-1142240b-2304-4855-b6fa-b4b0dbca9484 tempest-ServerActionsTestOtherA-561903914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:32:10 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-1142240b-2304-4855-b6fa-b4b0dbca9484 tempest-ServerActionsTestOtherA-561903914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:32:10 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-1142240b-2304-4855-b6fa-b4b0dbca9484 tempest-ServerActionsTestOtherA-561903914 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:32:10 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-1142240b-2304-4855-b6fa-b4b0dbca9484 tempest-ServerActionsTestOtherA-561903914 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:32:10 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-1142240b-2304-4855-b6fa-b4b0dbca9484 tempest-ServerActionsTestOtherA-561903914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d392aec4-68f9-4e0d-b0d2-dc2355f8d2ac 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:32:10 devstack sudo[88015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d392aec4-68f9-4e0d-b0d2-dc2355f8d2ac 1073741824 Sep 23 14:32:10 devstack sudo[88015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:32:10 devstack sudo[88015]: pam_unix(sudo:session): session closed for user root Sep 23 14:32:10 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-1142240b-2304-4855-b6fa-b4b0dbca9484 tempest-ServerActionsTestOtherA-561903914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d392aec4-68f9-4e0d-b0d2-dc2355f8d2ac 1073741824" returned: 0 in 0.600s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:32:10 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-1142240b-2304-4855-b6fa-b4b0dbca9484 tempest-ServerActionsTestOtherA-561903914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d392aec4-68f9-4e0d-b0d2-dc2355f8d2ac {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:32:10 devstack sudo[88038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d392aec4-68f9-4e0d-b0d2-dc2355f8d2ac Sep 23 14:32:10 devstack sudo[88038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:32:11 devstack sudo[88038]: pam_unix(sudo:session): session closed for user root Sep 23 14:32:11 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-1142240b-2304-4855-b6fa-b4b0dbca9484 tempest-ServerActionsTestOtherA-561903914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d392aec4-68f9-4e0d-b0d2-dc2355f8d2ac" returned: 0 in 0.337s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:32:11 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-1142240b-2304-4855-b6fa-b4b0dbca9484 tempest-ServerActionsTestOtherA-561903914 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:32:11 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-1142240b-2304-4855-b6fa-b4b0dbca9484 tempest-ServerActionsTestOtherA-561903914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:32:11 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-1142240b-2304-4855-b6fa-b4b0dbca9484 tempest-ServerActionsTestOtherA-561903914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6f3b7dd-46af-470a-8004-7195c2942613) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d392aec4-68f9-4e0d-b0d2-dc2355f8d2ac', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:32:11 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-1142240b-2304-4855-b6fa-b4b0dbca9484 tempest-ServerActionsTestOtherA-561903914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35e0e482-5770-47b9-a193-a5cdfd7a8a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:32:11 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-1142240b-2304-4855-b6fa-b4b0dbca9484 tempest-ServerActionsTestOtherA-561903914 None] Volume volume-d392aec4-68f9-4e0d-b0d2-dc2355f8d2ac (d392aec4-68f9-4e0d-b0d2-dc2355f8d2ac): created successfully Sep 23 14:32:11 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-1142240b-2304-4855-b6fa-b4b0dbca9484 tempest-ServerActionsTestOtherA-561903914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35e0e482-5770-47b9-a193-a5cdfd7a8a5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:32:11 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-1142240b-2304-4855-b6fa-b4b0dbca9484 tempest-ServerActionsTestOtherA-561903914 None] Flow 'volume_create_manager' (e71e842c-cc9c-4756-afbd-8a5534e8adf9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:32:11 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-1142240b-2304-4855-b6fa-b4b0dbca9484 tempest-ServerActionsTestOtherA-561903914 None] Created volume successfully. Sep 23 14:32:21 devstack cinder-volume[86310]: DEBUG dbcounter [-] [86310] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2,cinder:INSERT=1 {{(pid=86310) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 14:32:21 devstack cinder-volume[86310]: DEBUG dbcounter [-] [86310] Writing DB stats cinder:UPDATE=4,cinder:DELETE=1 {{(pid=86310) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 14:32:37 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-d62570aa-5cbb-490a-b279-d0429cde0660 tempest-TaggedAttachmentsTest-1184208625 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:32:37 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-d62570aa-5cbb-490a-b279-d0429cde0660 tempest-TaggedAttachmentsTest-1184208625 None] Flow 'volume_create_manager' (5b7fd70f-740b-4b1a-9878-e115b0c06d52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:32:37 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-d62570aa-5cbb-490a-b279-d0429cde0660 tempest-TaggedAttachmentsTest-1184208625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50a7c0e4-6531-498c-83e7-6e13bce6a4cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:32:37 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-d62570aa-5cbb-490a-b279-d0429cde0660 tempest-TaggedAttachmentsTest-1184208625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50a7c0e4-6531-498c-83e7-6e13bce6a4cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:32:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-689990901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcd0e6fb-af3c-4979-80d8-cc5cd38b7c0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff9d9f1297f443ebba8b3ab0d3fbc2bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:32:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:32:37Z,use_quota=True,user_id='c5d9b02b6231404eb1b21f854faedaba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:32:37 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-d62570aa-5cbb-490a-b279-d0429cde0660 tempest-TaggedAttachmentsTest-1184208625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89705d85-73c4-41d3-8844-da9881b5f6e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:32:37 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-d62570aa-5cbb-490a-b279-d0429cde0660 tempest-TaggedAttachmentsTest-1184208625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89705d85-73c4-41d3-8844-da9881b5f6e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:32:37 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-d62570aa-5cbb-490a-b279-d0429cde0660 tempest-TaggedAttachmentsTest-1184208625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdae05e9-02d4-4edd-8565-fc8d04fa6889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:32:37 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-d62570aa-5cbb-490a-b279-d0429cde0660 tempest-TaggedAttachmentsTest-1184208625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdae05e9-02d4-4edd-8565-fc8d04fa6889) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcd0e6fb-af3c-4979-80d8-cc5cd38b7c0f', 'volume_name': 'volume-bcd0e6fb-af3c-4979-80d8-cc5cd38b7c0f', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:32:37 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-d62570aa-5cbb-490a-b279-d0429cde0660 tempest-TaggedAttachmentsTest-1184208625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d933653d-23b4-4427-97d4-9807aa0365c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:32:37 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-d62570aa-5cbb-490a-b279-d0429cde0660 tempest-TaggedAttachmentsTest-1184208625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d933653d-23b4-4427-97d4-9807aa0365c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:32:37 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-d62570aa-5cbb-490a-b279-d0429cde0660 tempest-TaggedAttachmentsTest-1184208625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f07ed45d-3a23-4348-992d-0a3e9c45c3a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:32:37 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-d62570aa-5cbb-490a-b279-d0429cde0660 tempest-TaggedAttachmentsTest-1184208625 None] Volume bcd0e6fb-af3c-4979-80d8-cc5cd38b7c0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcd0e6fb-af3c-4979-80d8-cc5cd38b7c0f', 'volume_size': 1} Sep 23 14:32:37 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-d62570aa-5cbb-490a-b279-d0429cde0660 tempest-TaggedAttachmentsTest-1184208625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:32:37 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-d62570aa-5cbb-490a-b279-d0429cde0660 tempest-TaggedAttachmentsTest-1184208625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:32:37 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-d62570aa-5cbb-490a-b279-d0429cde0660 tempest-TaggedAttachmentsTest-1184208625 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:32:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-689990901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcd0e6fb-af3c-4979-80d8-cc5cd38b7c0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff9d9f1297f443ebba8b3ab0d3fbc2bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:32:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:32:37Z,use_quota=True,user_id='c5d9b02b6231404eb1b21f854faedaba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:32:37 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-d62570aa-5cbb-490a-b279-d0429cde0660 tempest-TaggedAttachmentsTest-1184208625 None] Creating volume bcd0e6fb-af3c-4979-80d8-cc5cd38b7c0f {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:32:37 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-d62570aa-5cbb-490a-b279-d0429cde0660 tempest-TaggedAttachmentsTest-1184208625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:32:37 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-d62570aa-5cbb-490a-b279-d0429cde0660 tempest-TaggedAttachmentsTest-1184208625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:32:37 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-d62570aa-5cbb-490a-b279-d0429cde0660 tempest-TaggedAttachmentsTest-1184208625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:32:37 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-d62570aa-5cbb-490a-b279-d0429cde0660 tempest-TaggedAttachmentsTest-1184208625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:32:37 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-d62570aa-5cbb-490a-b279-d0429cde0660 tempest-TaggedAttachmentsTest-1184208625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:32:37 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-d62570aa-5cbb-490a-b279-d0429cde0660 tempest-TaggedAttachmentsTest-1184208625 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:32:37 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-d62570aa-5cbb-490a-b279-d0429cde0660 tempest-TaggedAttachmentsTest-1184208625 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:32:37 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d62570aa-5cbb-490a-b279-d0429cde0660 tempest-TaggedAttachmentsTest-1184208625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bcd0e6fb-af3c-4979-80d8-cc5cd38b7c0f 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:32:37 devstack sudo[88108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bcd0e6fb-af3c-4979-80d8-cc5cd38b7c0f 1073741824 Sep 23 14:32:37 devstack sudo[88108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:32:38 devstack sudo[88108]: pam_unix(sudo:session): session closed for user root Sep 23 14:32:38 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d62570aa-5cbb-490a-b279-d0429cde0660 tempest-TaggedAttachmentsTest-1184208625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bcd0e6fb-af3c-4979-80d8-cc5cd38b7c0f 1073741824" returned: 0 in 1.204s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:32:38 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d62570aa-5cbb-490a-b279-d0429cde0660 tempest-TaggedAttachmentsTest-1184208625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bcd0e6fb-af3c-4979-80d8-cc5cd38b7c0f {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:32:38 devstack sudo[88160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bcd0e6fb-af3c-4979-80d8-cc5cd38b7c0f Sep 23 14:32:38 devstack sudo[88160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:32:39 devstack sudo[88160]: pam_unix(sudo:session): session closed for user root Sep 23 14:32:39 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d62570aa-5cbb-490a-b279-d0429cde0660 tempest-TaggedAttachmentsTest-1184208625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bcd0e6fb-af3c-4979-80d8-cc5cd38b7c0f" returned: 0 in 0.550s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:32:39 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-d62570aa-5cbb-490a-b279-d0429cde0660 tempest-TaggedAttachmentsTest-1184208625 None] <== create_volume: return (1858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:32:39 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-d62570aa-5cbb-490a-b279-d0429cde0660 tempest-TaggedAttachmentsTest-1184208625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.866s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:32:39 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-d62570aa-5cbb-490a-b279-d0429cde0660 tempest-TaggedAttachmentsTest-1184208625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f07ed45d-3a23-4348-992d-0a3e9c45c3a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcd0e6fb-af3c-4979-80d8-cc5cd38b7c0f', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:32:39 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-d62570aa-5cbb-490a-b279-d0429cde0660 tempest-TaggedAttachmentsTest-1184208625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd1e06e9-4f25-426d-a342-69b62f084322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:32:39 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-d62570aa-5cbb-490a-b279-d0429cde0660 tempest-TaggedAttachmentsTest-1184208625 None] Volume volume-bcd0e6fb-af3c-4979-80d8-cc5cd38b7c0f (bcd0e6fb-af3c-4979-80d8-cc5cd38b7c0f): created successfully Sep 23 14:32:39 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-d62570aa-5cbb-490a-b279-d0429cde0660 tempest-TaggedAttachmentsTest-1184208625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd1e06e9-4f25-426d-a342-69b62f084322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:32:39 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-d62570aa-5cbb-490a-b279-d0429cde0660 tempest-TaggedAttachmentsTest-1184208625 None] Flow 'volume_create_manager' (5b7fd70f-740b-4b1a-9878-e115b0c06d52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:32:39 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-d62570aa-5cbb-490a-b279-d0429cde0660 tempest-TaggedAttachmentsTest-1184208625 None] Created volume successfully. Sep 23 14:32:49 devstack cinder-volume[86310]: DEBUG dbcounter [-] [86310] Writing DB stats cinder:SELECT=2,cinder:UPDATE=4,cinder:INSERT=1 {{(pid=86310) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 14:32:49 devstack cinder-volume[86310]: DEBUG dbcounter [-] [86310] Writing DB stats cinder:UPDATE=3,cinder:SELECT=3,cinder:DELETE=1 {{(pid=86310) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 14:32:51 devstack cinder-volume[86310]: DEBUG oslo_service.periodic_task [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86310) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 14:32:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:32:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:32:51 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:32:51 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:32:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:32:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:32:51 devstack sudo[88274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:32:51 devstack sudo[88274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:32:52 devstack sudo[88274]: pam_unix(sudo:session): session closed for user root Sep 23 14:32:52 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.763s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:32:52 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:33:09 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [req-d30f168f-4000-412f-af61-2f4aefacb2c2 req-305b0ee6-6bc8-42b9-bfaa-fe2ce13c1166 tempest-ServerActionsTestOtherA-561903914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:33:09 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [req-d30f168f-4000-412f-af61-2f4aefacb2c2 req-305b0ee6-6bc8-42b9-bfaa-fe2ce13c1166 tempest-ServerActionsTestOtherA-561903914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:33:09 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [req-d30f168f-4000-412f-af61-2f4aefacb2c2 req-305b0ee6-6bc8-42b9-bfaa-fe2ce13c1166 tempest-ServerActionsTestOtherA-561903914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:33:09 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [req-d30f168f-4000-412f-af61-2f4aefacb2c2 req-305b0ee6-6bc8-42b9-bfaa-fe2ce13c1166 tempest-ServerActionsTestOtherA-561903914 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362', 'name': 'volume-d392aec4-68f9-4e0d-b0d2-dc2355f8d2ac', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '871a6afe-e92b-4fda-b02a-36ab28a280a3', 'enforce_multipath': True} {{(pid=86310) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 14:33:10 devstack cinder-volume[86310]: INFO cinder.volume.manager [req-d30f168f-4000-412f-af61-2f4aefacb2c2 req-305b0ee6-6bc8-42b9-bfaa-fe2ce13c1166 tempest-ServerActionsTestOtherA-561903914 None] attachment_update completed successfully. Sep 23 14:33:15 devstack cinder-volume[86310]: INFO cinder.volume.manager [req-77eef878-a526-46e1-9833-fac91d943f41 req-9e1444d5-d8f9-4ba9-98f1-a8fc2ea8b556 tempest-ServerActionsTestOtherA-561903914 None] Terminate volume connection completed successfully. Sep 23 14:33:15 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [req-77eef878-a526-46e1-9833-fac91d943f41 req-9e1444d5-d8f9-4ba9-98f1-a8fc2ea8b556 tempest-ServerActionsTestOtherA-561903914 None] Deleting attachment 871a6afe-e92b-4fda-b02a-36ab28a280a3. {{(pid=86310) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 14:33:17 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7400aa4-cb2f-4a9b-8a45-24fb934e5212 tempest-ServerRescueNegativeTestJSON-1651475438 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:33:17 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-f7400aa4-cb2f-4a9b-8a45-24fb934e5212 tempest-ServerRescueNegativeTestJSON-1651475438 None] Flow 'volume_create_manager' (25adc613-dbac-4940-b7fc-985099b9e9f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:33:17 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-f7400aa4-cb2f-4a9b-8a45-24fb934e5212 tempest-ServerRescueNegativeTestJSON-1651475438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d5e7aef-2d46-458c-8da9-f22127fc044a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:33:17 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-f7400aa4-cb2f-4a9b-8a45-24fb934e5212 tempest-ServerRescueNegativeTestJSON-1651475438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d5e7aef-2d46-458c-8da9-f22127fc044a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:33:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-600762049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17c088c8-450a-4212-9fb3-c718a2b5484a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3f0eb5745b9479786c46fbdb6163438',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:33:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:33:17Z,use_quota=True,user_id='0235cd52685a49c3865018d1f7db00f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:33:17 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-f7400aa4-cb2f-4a9b-8a45-24fb934e5212 tempest-ServerRescueNegativeTestJSON-1651475438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d31463bb-1f1a-4cc3-8987-7c29d0530777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:33:17 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-f7400aa4-cb2f-4a9b-8a45-24fb934e5212 tempest-ServerRescueNegativeTestJSON-1651475438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d31463bb-1f1a-4cc3-8987-7c29d0530777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:33:17 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-f7400aa4-cb2f-4a9b-8a45-24fb934e5212 tempest-ServerRescueNegativeTestJSON-1651475438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28f97f7a-0476-4b8e-b9a4-43e29b360772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:33:17 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-f7400aa4-cb2f-4a9b-8a45-24fb934e5212 tempest-ServerRescueNegativeTestJSON-1651475438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28f97f7a-0476-4b8e-b9a4-43e29b360772) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17c088c8-450a-4212-9fb3-c718a2b5484a', 'volume_name': 'volume-17c088c8-450a-4212-9fb3-c718a2b5484a', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:33:17 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-f7400aa4-cb2f-4a9b-8a45-24fb934e5212 tempest-ServerRescueNegativeTestJSON-1651475438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9eb3467-7918-4f4a-ba85-18c10bfac84f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:33:17 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-f7400aa4-cb2f-4a9b-8a45-24fb934e5212 tempest-ServerRescueNegativeTestJSON-1651475438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9eb3467-7918-4f4a-ba85-18c10bfac84f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:33:17 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-f7400aa4-cb2f-4a9b-8a45-24fb934e5212 tempest-ServerRescueNegativeTestJSON-1651475438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af40146d-a195-499d-b8c5-87bfbfa22c98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:33:17 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-f7400aa4-cb2f-4a9b-8a45-24fb934e5212 tempest-ServerRescueNegativeTestJSON-1651475438 None] Volume 17c088c8-450a-4212-9fb3-c718a2b5484a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17c088c8-450a-4212-9fb3-c718a2b5484a', 'volume_size': 1} Sep 23 14:33:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-f7400aa4-cb2f-4a9b-8a45-24fb934e5212 tempest-ServerRescueNegativeTestJSON-1651475438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:33:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-f7400aa4-cb2f-4a9b-8a45-24fb934e5212 tempest-ServerRescueNegativeTestJSON-1651475438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:33:17 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-f7400aa4-cb2f-4a9b-8a45-24fb934e5212 tempest-ServerRescueNegativeTestJSON-1651475438 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:33:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-600762049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17c088c8-450a-4212-9fb3-c718a2b5484a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3f0eb5745b9479786c46fbdb6163438',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:33:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:33:17Z,use_quota=True,user_id='0235cd52685a49c3865018d1f7db00f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:33:17 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-f7400aa4-cb2f-4a9b-8a45-24fb934e5212 tempest-ServerRescueNegativeTestJSON-1651475438 None] Creating volume 17c088c8-450a-4212-9fb3-c718a2b5484a {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:33:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-f7400aa4-cb2f-4a9b-8a45-24fb934e5212 tempest-ServerRescueNegativeTestJSON-1651475438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:33:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-f7400aa4-cb2f-4a9b-8a45-24fb934e5212 tempest-ServerRescueNegativeTestJSON-1651475438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:33:17 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-f7400aa4-cb2f-4a9b-8a45-24fb934e5212 tempest-ServerRescueNegativeTestJSON-1651475438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:33:17 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-f7400aa4-cb2f-4a9b-8a45-24fb934e5212 tempest-ServerRescueNegativeTestJSON-1651475438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:33:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-f7400aa4-cb2f-4a9b-8a45-24fb934e5212 tempest-ServerRescueNegativeTestJSON-1651475438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:33:17 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-f7400aa4-cb2f-4a9b-8a45-24fb934e5212 tempest-ServerRescueNegativeTestJSON-1651475438 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:33:17 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-f7400aa4-cb2f-4a9b-8a45-24fb934e5212 tempest-ServerRescueNegativeTestJSON-1651475438 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:33:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-f7400aa4-cb2f-4a9b-8a45-24fb934e5212 tempest-ServerRescueNegativeTestJSON-1651475438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-17c088c8-450a-4212-9fb3-c718a2b5484a 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:33:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [req-77eef878-a526-46e1-9833-fac91d943f41 req-80376157-6ae3-47ba-bf40-af4e67f97342 tempest-ServerActionsTestOtherA-561903914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:33:17 devstack sudo[89129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-17c088c8-450a-4212-9fb3-c718a2b5484a 1073741824 Sep 23 14:33:17 devstack sudo[89129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:33:18 devstack sudo[89129]: pam_unix(sudo:session): session closed for user root Sep 23 14:33:18 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-f7400aa4-cb2f-4a9b-8a45-24fb934e5212 tempest-ServerRescueNegativeTestJSON-1651475438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-17c088c8-450a-4212-9fb3-c718a2b5484a 1073741824" returned: 0 in 0.679s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:33:18 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-f7400aa4-cb2f-4a9b-8a45-24fb934e5212 tempest-ServerRescueNegativeTestJSON-1651475438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-17c088c8-450a-4212-9fb3-c718a2b5484a {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:33:18 devstack sudo[89137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-17c088c8-450a-4212-9fb3-c718a2b5484a Sep 23 14:33:18 devstack sudo[89137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:33:18 devstack sudo[89137]: pam_unix(sudo:session): session closed for user root Sep 23 14:33:18 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-f7400aa4-cb2f-4a9b-8a45-24fb934e5212 tempest-ServerRescueNegativeTestJSON-1651475438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-17c088c8-450a-4212-9fb3-c718a2b5484a" returned: 0 in 0.447s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:33:18 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-f7400aa4-cb2f-4a9b-8a45-24fb934e5212 tempest-ServerRescueNegativeTestJSON-1651475438 None] <== create_volume: return (1200ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:33:18 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-f7400aa4-cb2f-4a9b-8a45-24fb934e5212 tempest-ServerRescueNegativeTestJSON-1651475438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.204s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:33:18 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [req-77eef878-a526-46e1-9833-fac91d943f41 req-80376157-6ae3-47ba-bf40-af4e67f97342 tempest-ServerActionsTestOtherA-561903914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.134s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:33:18 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [req-77eef878-a526-46e1-9833-fac91d943f41 req-80376157-6ae3-47ba-bf40-af4e67f97342 tempest-ServerActionsTestOtherA-561903914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:33:18 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-f7400aa4-cb2f-4a9b-8a45-24fb934e5212 tempest-ServerRescueNegativeTestJSON-1651475438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af40146d-a195-499d-b8c5-87bfbfa22c98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17c088c8-450a-4212-9fb3-c718a2b5484a', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:33:18 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-f7400aa4-cb2f-4a9b-8a45-24fb934e5212 tempest-ServerRescueNegativeTestJSON-1651475438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91676aa9-5ff0-46a3-ae1c-d089627e0117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:33:18 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-f7400aa4-cb2f-4a9b-8a45-24fb934e5212 tempest-ServerRescueNegativeTestJSON-1651475438 None] Volume volume-17c088c8-450a-4212-9fb3-c718a2b5484a (17c088c8-450a-4212-9fb3-c718a2b5484a): created successfully Sep 23 14:33:18 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-f7400aa4-cb2f-4a9b-8a45-24fb934e5212 tempest-ServerRescueNegativeTestJSON-1651475438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91676aa9-5ff0-46a3-ae1c-d089627e0117) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:33:18 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-f7400aa4-cb2f-4a9b-8a45-24fb934e5212 tempest-ServerRescueNegativeTestJSON-1651475438 None] Flow 'volume_create_manager' (25adc613-dbac-4940-b7fc-985099b9e9f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:33:18 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-f7400aa4-cb2f-4a9b-8a45-24fb934e5212 tempest-ServerRescueNegativeTestJSON-1651475438 None] Created volume successfully. Sep 23 14:33:18 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [req-77eef878-a526-46e1-9833-fac91d943f41 req-80376157-6ae3-47ba-bf40-af4e67f97342 tempest-ServerActionsTestOtherA-561903914 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362', 'name': 'volume-d392aec4-68f9-4e0d-b0d2-dc2355f8d2ac', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '379b6ca3-4bec-4981-9da0-c257f6c11d23', 'enforce_multipath': True} {{(pid=86310) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 14:33:18 devstack cinder-volume[86310]: INFO cinder.volume.manager [req-77eef878-a526-46e1-9833-fac91d943f41 req-80376157-6ae3-47ba-bf40-af4e67f97342 tempest-ServerActionsTestOtherA-561903914 None] attachment_update completed successfully. Sep 23 14:33:28 devstack cinder-volume[86310]: DEBUG dbcounter [-] [86310] Writing DB stats cinder:SELECT=18,cinder:UPDATE=5 {{(pid=86310) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 14:33:28 devstack cinder-volume[86310]: DEBUG dbcounter [-] [86310] Writing DB stats cinder:SELECT=14,cinder:UPDATE=7,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86310) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 14:33:30 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-9fb49b15-c318-45c7-9fd2-22b8b33ee028 tempest-ServerRescueNegativeTestJSON-1651475438 None] Acquiring lock "cinder-17c088c8-450a-4212-9fb3-c718a2b5484a-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:33:30 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-9fb49b15-c318-45c7-9fd2-22b8b33ee028 tempest-ServerRescueNegativeTestJSON-1651475438 None] Lock "cinder-17c088c8-450a-4212-9fb3-c718a2b5484a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:33:30 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-9fb49b15-c318-45c7-9fd2-22b8b33ee028 tempest-ServerRescueNegativeTestJSON-1651475438 None] Acquiring lock "cinder-quobyte-17c088c8-450a-4212-9fb3-c718a2b5484a" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:33:30 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-9fb49b15-c318-45c7-9fd2-22b8b33ee028 tempest-ServerRescueNegativeTestJSON-1651475438 None] Lock "cinder-quobyte-17c088c8-450a-4212-9fb3-c718a2b5484a" acquired by "delete_volume" :: waited 0.028s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:33:30 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[c01e168a-3e89-4aae-85c3-a1fd9d0dc84b]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:33:30 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-9fb49b15-c318-45c7-9fd2-22b8b33ee028 tempest-ServerRescueNegativeTestJSON-1651475438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-17c088c8-450a-4212-9fb3-c718a2b5484a {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:33:30 devstack sudo[89764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-17c088c8-450a-4212-9fb3-c718a2b5484a Sep 23 14:33:30 devstack sudo[89764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:33:31 devstack sudo[89764]: pam_unix(sudo:session): session closed for user root Sep 23 14:33:31 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-9fb49b15-c318-45c7-9fd2-22b8b33ee028 tempest-ServerRescueNegativeTestJSON-1651475438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-17c088c8-450a-4212-9fb3-c718a2b5484a" returned: 0 in 0.419s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:33:31 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-9fb49b15-c318-45c7-9fd2-22b8b33ee028 tempest-ServerRescueNegativeTestJSON-1651475438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-17c088c8-450a-4212-9fb3-c718a2b5484a {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:33:31 devstack sudo[89770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-17c088c8-450a-4212-9fb3-c718a2b5484a Sep 23 14:33:31 devstack sudo[89770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:33:31 devstack sudo[89770]: pam_unix(sudo:session): session closed for user root Sep 23 14:33:31 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-9fb49b15-c318-45c7-9fd2-22b8b33ee028 tempest-ServerRescueNegativeTestJSON-1651475438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-17c088c8-450a-4212-9fb3-c718a2b5484a" returned: 0 in 0.400s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:33:31 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-9fb49b15-c318-45c7-9fd2-22b8b33ee028 tempest-ServerRescueNegativeTestJSON-1651475438 None] Lock "cinder-quobyte-17c088c8-450a-4212-9fb3-c718a2b5484a" released by "delete_volume" :: held 0.888s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:33:31 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-9fb49b15-c318-45c7-9fd2-22b8b33ee028 tempest-ServerRescueNegativeTestJSON-1651475438 None] Created reservations ['50c57464-7a69-47c2-af68-5878ee99b638', '84716b65-f87e-4b8c-a9cb-23d51ce3f96d', 'd625c636-e7e6-40ea-9b55-e1b4243f0dfb', '6cefdf3a-7414-4e4a-bb30-4d16073e3cef'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:33:31 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-9fb49b15-c318-45c7-9fd2-22b8b33ee028 tempest-ServerRescueNegativeTestJSON-1651475438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:33:31 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-9fb49b15-c318-45c7-9fd2-22b8b33ee028 tempest-ServerRescueNegativeTestJSON-1651475438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:33:31 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-9fb49b15-c318-45c7-9fd2-22b8b33ee028 tempest-ServerRescueNegativeTestJSON-1651475438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:33:31 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-9fb49b15-c318-45c7-9fd2-22b8b33ee028 tempest-ServerRescueNegativeTestJSON-1651475438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:33:31 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-9fb49b15-c318-45c7-9fd2-22b8b33ee028 tempest-ServerRescueNegativeTestJSON-1651475438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:33:31 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-9fb49b15-c318-45c7-9fd2-22b8b33ee028 tempest-ServerRescueNegativeTestJSON-1651475438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:33:31 devstack sudo[89776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:33:31 devstack sudo[89776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:33:32 devstack sudo[89776]: pam_unix(sudo:session): session closed for user root Sep 23 14:33:32 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-9fb49b15-c318-45c7-9fd2-22b8b33ee028 tempest-ServerRescueNegativeTestJSON-1651475438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.377s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:33:32 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-9fb49b15-c318-45c7-9fd2-22b8b33ee028 tempest-ServerRescueNegativeTestJSON-1651475438 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:33:32 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-9fb49b15-c318-45c7-9fd2-22b8b33ee028 tempest-ServerRescueNegativeTestJSON-1651475438 None] Deleted volume successfully. Sep 23 14:33:32 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-9fb49b15-c318-45c7-9fd2-22b8b33ee028 tempest-ServerRescueNegativeTestJSON-1651475438 None] Lock "cinder-17c088c8-450a-4212-9fb3-c718a2b5484a-delete_volume" released by "delete_volume" :: held 1.627s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:33:32 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea58abec-6591-4e97-8742-7dd817b33e09 tempest-AttachVolumeNegativeTest-527431328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:33:32 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-ea58abec-6591-4e97-8742-7dd817b33e09 tempest-AttachVolumeNegativeTest-527431328 None] Flow 'volume_create_manager' (4816ca85-45b5-4cb9-9513-c2eff38c3b12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:33:32 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-ea58abec-6591-4e97-8742-7dd817b33e09 tempest-AttachVolumeNegativeTest-527431328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac626074-f2a8-4431-a1ef-0d16fb3b357e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:33:32 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-ea58abec-6591-4e97-8742-7dd817b33e09 tempest-AttachVolumeNegativeTest-527431328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac626074-f2a8-4431-a1ef-0d16fb3b357e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:33:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1337635019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ba8a7d2-9324-4570-b342-fefd1b13c143,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1ac9a384403436f88ec793cde23db56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:33:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:33:33Z,use_quota=True,user_id='3d6e4f5983114e05b289eeced4b0beeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:33:32 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-ea58abec-6591-4e97-8742-7dd817b33e09 tempest-AttachVolumeNegativeTest-527431328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (719d5ab7-c0be-41eb-8cde-07da577f8ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:33:32 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-ea58abec-6591-4e97-8742-7dd817b33e09 tempest-AttachVolumeNegativeTest-527431328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (719d5ab7-c0be-41eb-8cde-07da577f8ce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:33:32 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-ea58abec-6591-4e97-8742-7dd817b33e09 tempest-AttachVolumeNegativeTest-527431328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c989e392-f289-40fd-93c0-51945b008a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:33:32 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-ea58abec-6591-4e97-8742-7dd817b33e09 tempest-AttachVolumeNegativeTest-527431328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c989e392-f289-40fd-93c0-51945b008a5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ba8a7d2-9324-4570-b342-fefd1b13c143', 'volume_name': 'volume-6ba8a7d2-9324-4570-b342-fefd1b13c143', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:33:32 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-ea58abec-6591-4e97-8742-7dd817b33e09 tempest-AttachVolumeNegativeTest-527431328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3974d8ea-72ef-4ea8-97f5-562e7767b879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:33:32 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-ea58abec-6591-4e97-8742-7dd817b33e09 tempest-AttachVolumeNegativeTest-527431328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3974d8ea-72ef-4ea8-97f5-562e7767b879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:33:32 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-ea58abec-6591-4e97-8742-7dd817b33e09 tempest-AttachVolumeNegativeTest-527431328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9567646d-0727-4dfc-9986-5361c90a4bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:33:32 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-ea58abec-6591-4e97-8742-7dd817b33e09 tempest-AttachVolumeNegativeTest-527431328 None] Volume 6ba8a7d2-9324-4570-b342-fefd1b13c143: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ba8a7d2-9324-4570-b342-fefd1b13c143', 'volume_size': 1} Sep 23 14:33:32 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-ea58abec-6591-4e97-8742-7dd817b33e09 tempest-AttachVolumeNegativeTest-527431328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:33:32 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-ea58abec-6591-4e97-8742-7dd817b33e09 tempest-AttachVolumeNegativeTest-527431328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:33:32 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-ea58abec-6591-4e97-8742-7dd817b33e09 tempest-AttachVolumeNegativeTest-527431328 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:33:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1337635019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ba8a7d2-9324-4570-b342-fefd1b13c143,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1ac9a384403436f88ec793cde23db56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:33:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:33:33Z,use_quota=True,user_id='3d6e4f5983114e05b289eeced4b0beeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:33:32 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-ea58abec-6591-4e97-8742-7dd817b33e09 tempest-AttachVolumeNegativeTest-527431328 None] Creating volume 6ba8a7d2-9324-4570-b342-fefd1b13c143 {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:33:32 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-ea58abec-6591-4e97-8742-7dd817b33e09 tempest-AttachVolumeNegativeTest-527431328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:33:32 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-ea58abec-6591-4e97-8742-7dd817b33e09 tempest-AttachVolumeNegativeTest-527431328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:33:32 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-ea58abec-6591-4e97-8742-7dd817b33e09 tempest-AttachVolumeNegativeTest-527431328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:33:32 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-ea58abec-6591-4e97-8742-7dd817b33e09 tempest-AttachVolumeNegativeTest-527431328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:33:32 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-ea58abec-6591-4e97-8742-7dd817b33e09 tempest-AttachVolumeNegativeTest-527431328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:33:32 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-ea58abec-6591-4e97-8742-7dd817b33e09 tempest-AttachVolumeNegativeTest-527431328 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:33:32 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-ea58abec-6591-4e97-8742-7dd817b33e09 tempest-AttachVolumeNegativeTest-527431328 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:33:32 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ea58abec-6591-4e97-8742-7dd817b33e09 tempest-AttachVolumeNegativeTest-527431328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6ba8a7d2-9324-4570-b342-fefd1b13c143 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:33:32 devstack sudo[89790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6ba8a7d2-9324-4570-b342-fefd1b13c143 1073741824 Sep 23 14:33:32 devstack sudo[89790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:33:33 devstack sudo[89790]: pam_unix(sudo:session): session closed for user root Sep 23 14:33:33 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ea58abec-6591-4e97-8742-7dd817b33e09 tempest-AttachVolumeNegativeTest-527431328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6ba8a7d2-9324-4570-b342-fefd1b13c143 1073741824" returned: 0 in 0.942s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:33:33 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ea58abec-6591-4e97-8742-7dd817b33e09 tempest-AttachVolumeNegativeTest-527431328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6ba8a7d2-9324-4570-b342-fefd1b13c143 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:33:33 devstack sudo[89818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6ba8a7d2-9324-4570-b342-fefd1b13c143 Sep 23 14:33:33 devstack sudo[89818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:33:34 devstack sudo[89818]: pam_unix(sudo:session): session closed for user root Sep 23 14:33:34 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ea58abec-6591-4e97-8742-7dd817b33e09 tempest-AttachVolumeNegativeTest-527431328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6ba8a7d2-9324-4570-b342-fefd1b13c143" returned: 0 in 0.529s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:33:34 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-ea58abec-6591-4e97-8742-7dd817b33e09 tempest-AttachVolumeNegativeTest-527431328 None] <== create_volume: return (1565ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:33:34 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-ea58abec-6591-4e97-8742-7dd817b33e09 tempest-AttachVolumeNegativeTest-527431328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.572s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:33:34 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-ea58abec-6591-4e97-8742-7dd817b33e09 tempest-AttachVolumeNegativeTest-527431328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9567646d-0727-4dfc-9986-5361c90a4bec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ba8a7d2-9324-4570-b342-fefd1b13c143', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:33:34 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-ea58abec-6591-4e97-8742-7dd817b33e09 tempest-AttachVolumeNegativeTest-527431328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dbefadc-4f61-465b-a357-26ee1211b56a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:33:34 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-ea58abec-6591-4e97-8742-7dd817b33e09 tempest-AttachVolumeNegativeTest-527431328 None] Volume volume-6ba8a7d2-9324-4570-b342-fefd1b13c143 (6ba8a7d2-9324-4570-b342-fefd1b13c143): created successfully Sep 23 14:33:34 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-ea58abec-6591-4e97-8742-7dd817b33e09 tempest-AttachVolumeNegativeTest-527431328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dbefadc-4f61-465b-a357-26ee1211b56a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:33:34 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-ea58abec-6591-4e97-8742-7dd817b33e09 tempest-AttachVolumeNegativeTest-527431328 None] Flow 'volume_create_manager' (4816ca85-45b5-4cb9-9513-c2eff38c3b12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:33:34 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-ea58abec-6591-4e97-8742-7dd817b33e09 tempest-AttachVolumeNegativeTest-527431328 None] Created volume successfully. Sep 23 14:33:35 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [req-76be1b4d-3a94-4019-bf34-887532c5ef89 req-0e598798-c4d5-4b29-9727-4f79b3bb1764 tempest-AttachVolumeNegativeTest-527431328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:33:35 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [req-76be1b4d-3a94-4019-bf34-887532c5ef89 req-0e598798-c4d5-4b29-9727-4f79b3bb1764 tempest-AttachVolumeNegativeTest-527431328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:33:35 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [req-76be1b4d-3a94-4019-bf34-887532c5ef89 req-0e598798-c4d5-4b29-9727-4f79b3bb1764 tempest-AttachVolumeNegativeTest-527431328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:33:35 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [req-76be1b4d-3a94-4019-bf34-887532c5ef89 req-0e598798-c4d5-4b29-9727-4f79b3bb1764 tempest-AttachVolumeNegativeTest-527431328 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362', 'name': 'volume-6ba8a7d2-9324-4570-b342-fefd1b13c143', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b9d02e57-9d6e-493a-a532-2627e876c9d8', 'enforce_multipath': True} {{(pid=86310) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 14:33:35 devstack cinder-volume[86310]: INFO cinder.volume.manager [req-76be1b4d-3a94-4019-bf34-887532c5ef89 req-0e598798-c4d5-4b29-9727-4f79b3bb1764 tempest-AttachVolumeNegativeTest-527431328 None] attachment_update completed successfully. Sep 23 14:33:45 devstack cinder-volume[86310]: DEBUG dbcounter [-] [86310] Writing DB stats cinder:SELECT=14,cinder:UPDATE=15,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86310) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 14:33:45 devstack cinder-volume[86310]: DEBUG dbcounter [-] [86310] Writing DB stats cinder:SELECT=13,cinder:INSERT=3,cinder:UPDATE=10,cinder:DELETE=1 {{(pid=86310) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 14:33:51 devstack cinder-volume[86310]: DEBUG oslo_service.periodic_task [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86310) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 14:33:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:33:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:33:51 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:33:51 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:33:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:33:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:33:51 devstack sudo[89997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:33:51 devstack sudo[89997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:33:51 devstack sudo[89997]: pam_unix(sudo:session): session closed for user root Sep 23 14:33:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.372s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:33:51 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:33:51 devstack cinder-volume[86310]: DEBUG oslo_service.periodic_task [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Running periodic task VolumeManager._thread_info {{(pid=86310) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 14:33:51 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] thread count: 8 {{(pid=86310) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 14:33:51 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] thread info: [<_MainThread(MainThread, started 128854208852096)>, , , , , , , ] {{(pid=86310) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 14:33:59 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [req-3c25fcc8-8a80-4414-a84c-3ba11c555846 req-65303f2c-15fd-43d1-ae6c-5683d0e1cf1d tempest-TaggedAttachmentsTest-1184208625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:33:59 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [req-3c25fcc8-8a80-4414-a84c-3ba11c555846 req-65303f2c-15fd-43d1-ae6c-5683d0e1cf1d tempest-TaggedAttachmentsTest-1184208625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:33:59 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [req-3c25fcc8-8a80-4414-a84c-3ba11c555846 req-65303f2c-15fd-43d1-ae6c-5683d0e1cf1d tempest-TaggedAttachmentsTest-1184208625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:33:59 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [req-3c25fcc8-8a80-4414-a84c-3ba11c555846 req-65303f2c-15fd-43d1-ae6c-5683d0e1cf1d tempest-TaggedAttachmentsTest-1184208625 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362', 'name': 'volume-bcd0e6fb-af3c-4979-80d8-cc5cd38b7c0f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '156285f4-b1b0-4142-bdf3-5f3c96497b03', 'enforce_multipath': True} {{(pid=86310) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 14:33:59 devstack cinder-volume[86310]: INFO cinder.volume.manager [req-3c25fcc8-8a80-4414-a84c-3ba11c555846 req-65303f2c-15fd-43d1-ae6c-5683d0e1cf1d tempest-TaggedAttachmentsTest-1184208625 None] attachment_update completed successfully. Sep 23 14:34:03 devstack cinder-volume[86310]: INFO cinder.volume.manager [req-a5c7f6f6-af53-4a29-b360-e77be346ccf7 req-6adaeb22-8c35-438d-8ed4-e38dc5c3428e tempest-TaggedAttachmentsTest-1184208625 None] Terminate volume connection completed successfully. Sep 23 14:34:03 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [req-a5c7f6f6-af53-4a29-b360-e77be346ccf7 req-6adaeb22-8c35-438d-8ed4-e38dc5c3428e tempest-TaggedAttachmentsTest-1184208625 None] Deleting attachment 156285f4-b1b0-4142-bdf3-5f3c96497b03. {{(pid=86310) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 14:34:03 devstack cinder-volume[86310]: INFO cinder.volume.manager [req-19b02ae6-e6a7-4fcd-b8c3-71bb1a7f5af6 req-e601862f-ae9a-47ff-996d-64586545874d tempest-ServerActionsTestOtherA-561903914 None] Terminate volume connection completed successfully. Sep 23 14:34:03 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [req-19b02ae6-e6a7-4fcd-b8c3-71bb1a7f5af6 req-e601862f-ae9a-47ff-996d-64586545874d tempest-ServerActionsTestOtherA-561903914 None] Deleting attachment 379b6ca3-4bec-4981-9da0-c257f6c11d23. {{(pid=86310) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 14:34:13 devstack cinder-volume[86310]: DEBUG dbcounter [-] [86310] Writing DB stats cinder:SELECT=11,cinder:UPDATE=1 {{(pid=86310) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 14:34:13 devstack cinder-volume[86310]: DEBUG dbcounter [-] [86310] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=86310) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 14:34:18 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-bffb97b9-f9bd-439a-830e-aa7274278760 tempest-ServerActionsTestOtherA-561903914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:34:18 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-bffb97b9-f9bd-439a-830e-aa7274278760 tempest-ServerActionsTestOtherA-561903914 None] Flow 'volume_create_manager' (27784185-7475-4269-8777-0704690e2516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:34:18 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-bffb97b9-f9bd-439a-830e-aa7274278760 tempest-ServerActionsTestOtherA-561903914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a308e7a4-0bc1-4997-a98a-fb916cf97438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:34:19 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-bffb97b9-f9bd-439a-830e-aa7274278760 tempest-ServerActionsTestOtherA-561903914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a308e7a4-0bc1-4997-a98a-fb916cf97438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:34:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1849264612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e00fc7f5-752b-46f5-8b34-74d62a481d73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b055817b1834ad0899ce2ada1a4aa1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:34:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:34:19Z,use_quota=True,user_id='e96390e2252549d2bb096b1fef585b11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:34:19 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-bffb97b9-f9bd-439a-830e-aa7274278760 tempest-ServerActionsTestOtherA-561903914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c95df42-6275-4809-8ee5-bc1476d02437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:34:19 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-bffb97b9-f9bd-439a-830e-aa7274278760 tempest-ServerActionsTestOtherA-561903914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c95df42-6275-4809-8ee5-bc1476d02437) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:34:19 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-bffb97b9-f9bd-439a-830e-aa7274278760 tempest-ServerActionsTestOtherA-561903914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (133a0e0a-9222-4ae4-a315-6b5d712c0227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:34:19 devstack cinder-volume[86310]: DEBUG cinder.image.glance [None req-bffb97b9-f9bd-439a-830e-aa7274278760 tempest-ServerActionsTestOtherA-561903914 None] Creating Keystone auth plugin from conf {{(pid=86310) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 23 14:34:19 devstack cinder-volume[86310]: INFO cinder.volume.manager [req-c7be0dad-0bda-4f70-9a88-b5697c283fda req-8cada697-f2b3-4771-b480-ec60ff5bf4d0 tempest-AttachVolumeNegativeTest-527431328 None] Terminate volume connection completed successfully. Sep 23 14:34:19 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [req-c7be0dad-0bda-4f70-9a88-b5697c283fda req-8cada697-f2b3-4771-b480-ec60ff5bf4d0 tempest-AttachVolumeNegativeTest-527431328 None] Deleting attachment b9d02e57-9d6e-493a-a532-2627e876c9d8. {{(pid=86310) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 14:34:19 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-bffb97b9-f9bd-439a-830e-aa7274278760 tempest-ServerActionsTestOtherA-561903914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (133a0e0a-9222-4ae4-a315-6b5d712c0227) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e00fc7f5-752b-46f5-8b34-74d62a481d73', 'volume_name': 'volume-e00fc7f5-752b-46f5-8b34-74d62a481d73', 'volume_size': 1, 'image_id': '0cd395f9-e766-4e32-94b1-775454bf3449', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0cd395f9-e766-4e32-94b1-775454bf3449', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7fa20aad952548c880b3288dd7d64dbc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0cd395f9-e766-4e32-94b1-775454bf3449', 'created_at': datetime.datetime(2026, 9, 23, 12, 25, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 23, 12, 25, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0cd395f9-e766-4e32-94b1-775454bf3449/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:34:19 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-bffb97b9-f9bd-439a-830e-aa7274278760 tempest-ServerActionsTestOtherA-561903914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2a14eb8-4a1b-4c2e-a951-78bbfcffa58b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:34:19 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-bffb97b9-f9bd-439a-830e-aa7274278760 tempest-ServerActionsTestOtherA-561903914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2a14eb8-4a1b-4c2e-a951-78bbfcffa58b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:34:19 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-bffb97b9-f9bd-439a-830e-aa7274278760 tempest-ServerActionsTestOtherA-561903914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fcbde59-68ea-49dc-8c63-a25d45b513e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:34:19 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-bffb97b9-f9bd-439a-830e-aa7274278760 tempest-ServerActionsTestOtherA-561903914 None] Volume e00fc7f5-752b-46f5-8b34-74d62a481d73: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e00fc7f5-752b-46f5-8b34-74d62a481d73', 'volume_size': 1, 'image_id': '0cd395f9-e766-4e32-94b1-775454bf3449', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0cd395f9-e766-4e32-94b1-775454bf3449', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7fa20aad952548c880b3288dd7d64dbc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0cd395f9-e766-4e32-94b1-775454bf3449', 'created_at': datetime.datetime(2026, 9, 23, 12, 25, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 23, 12, 25, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0cd395f9-e766-4e32-94b1-775454bf3449/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 23 14:34:19 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-bffb97b9-f9bd-439a-830e-aa7274278760 tempest-ServerActionsTestOtherA-561903914 None] Trying to clone e00fc7f5-752b-46f5-8b34-74d62a481d73 from image 0cd395f9-e766-4e32-94b1-775454bf3449 at location (None, [{'url': 'file:///opt/stack/data/glance/images/0cd395f9-e766-4e32-94b1-775454bf3449', 'metadata': {}}]). {{(pid=86310) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 23 14:34:20 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-056e4b95-ba57-4453-82a3-c7f485d5d6a5 tempest-TaggedAttachmentsTest-1184208625 None] Acquiring lock "cinder-bcd0e6fb-af3c-4979-80d8-cc5cd38b7c0f-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:34:20 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-056e4b95-ba57-4453-82a3-c7f485d5d6a5 tempest-TaggedAttachmentsTest-1184208625 None] Lock "cinder-bcd0e6fb-af3c-4979-80d8-cc5cd38b7c0f-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:34:20 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-056e4b95-ba57-4453-82a3-c7f485d5d6a5 tempest-TaggedAttachmentsTest-1184208625 None] Acquiring lock "cinder-quobyte-bcd0e6fb-af3c-4979-80d8-cc5cd38b7c0f" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:34:20 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-056e4b95-ba57-4453-82a3-c7f485d5d6a5 tempest-TaggedAttachmentsTest-1184208625 None] Lock "cinder-quobyte-bcd0e6fb-af3c-4979-80d8-cc5cd38b7c0f" acquired by "delete_volume" :: waited 0.029s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:34:20 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[c76e243d-2a80-4a33-b045-8c46904266a2]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:34:20 devstack cinder-volume[86310]: DEBUG cinder.image.image_utils [None req-bffb97b9-f9bd-439a-830e-aa7274278760 tempest-ServerActionsTestOtherA-561903914 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0cd395f9-e766-4e32-94b1-775454bf3449_uwwl4xrsdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86310) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 23 14:34:20 devstack cinder-volume[86310]: INFO cinder.image.image_utils [None req-bffb97b9-f9bd-439a-830e-aa7274278760 tempest-ServerActionsTestOtherA-561903914 None] Image download 20.69 MB at 20.69 MB/s Sep 23 14:34:20 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-056e4b95-ba57-4453-82a3-c7f485d5d6a5 tempest-TaggedAttachmentsTest-1184208625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bcd0e6fb-af3c-4979-80d8-cc5cd38b7c0f {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:34:20 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[df3812ed-12cc-407d-b43b-5e51a70fc118]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:34:20 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-bffb97b9-f9bd-439a-830e-aa7274278760 tempest-ServerActionsTestOtherA-561903914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0cd395f9-e766-4e32-94b1-775454bf3449_uwwl4xrsdevstack@QuobyteHD {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:34:20 devstack sudo[90393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bcd0e6fb-af3c-4979-80d8-cc5cd38b7c0f Sep 23 14:34:20 devstack sudo[90393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:34:20 devstack sudo[90394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0cd395f9-e766-4e32-94b1-775454bf3449_uwwl4xrsdevstack@QuobyteHD Sep 23 14:34:20 devstack sudo[90394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:34:20 devstack sudo[90393]: pam_unix(sudo:session): session closed for user root Sep 23 14:34:20 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-056e4b95-ba57-4453-82a3-c7f485d5d6a5 tempest-TaggedAttachmentsTest-1184208625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bcd0e6fb-af3c-4979-80d8-cc5cd38b7c0f" returned: 0 in 0.588s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:34:20 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-056e4b95-ba57-4453-82a3-c7f485d5d6a5 tempest-TaggedAttachmentsTest-1184208625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bcd0e6fb-af3c-4979-80d8-cc5cd38b7c0f {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:34:21 devstack sudo[90394]: pam_unix(sudo:session): session closed for user root Sep 23 14:34:21 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-bffb97b9-f9bd-439a-830e-aa7274278760 tempest-ServerActionsTestOtherA-561903914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0cd395f9-e766-4e32-94b1-775454bf3449_uwwl4xrsdevstack@QuobyteHD" returned: 0 in 0.558s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:34:21 devstack cinder-volume[86310]: DEBUG cinder.image.image_utils [None req-bffb97b9-f9bd-439a-830e-aa7274278760 tempest-ServerActionsTestOtherA-561903914 None] Temporary image 0cd395f9-e766-4e32-94b1-775454bf3449 is fetched for user e96390e2252549d2bb096b1fef585b11. {{(pid=86310) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 23 14:34:21 devstack sudo[90405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bcd0e6fb-af3c-4979-80d8-cc5cd38b7c0f Sep 23 14:34:21 devstack sudo[90405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:34:21 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd0c51f-b38d-4097-b788-462e90748bb8]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:34:21 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-bffb97b9-f9bd-439a-830e-aa7274278760 tempest-ServerActionsTestOtherA-561903914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0cd395f9-e766-4e32-94b1-775454bf3449_uwwl4xrsdevstack@QuobyteHD {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:34:21 devstack sudo[90407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0cd395f9-e766-4e32-94b1-775454bf3449_uwwl4xrsdevstack@QuobyteHD Sep 23 14:34:21 devstack sudo[90407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:34:21 devstack sudo[90405]: pam_unix(sudo:session): session closed for user root Sep 23 14:34:21 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-056e4b95-ba57-4453-82a3-c7f485d5d6a5 tempest-TaggedAttachmentsTest-1184208625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bcd0e6fb-af3c-4979-80d8-cc5cd38b7c0f" returned: 0 in 0.695s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:34:21 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-056e4b95-ba57-4453-82a3-c7f485d5d6a5 tempest-TaggedAttachmentsTest-1184208625 None] Lock "cinder-quobyte-bcd0e6fb-af3c-4979-80d8-cc5cd38b7c0f" released by "delete_volume" :: held 1.437s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:34:21 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-056e4b95-ba57-4453-82a3-c7f485d5d6a5 tempest-TaggedAttachmentsTest-1184208625 None] Created reservations ['145a0b00-a980-450a-b0b7-c7a8ffe328f8', '02fc815b-1133-41b2-9a63-ede890878f94', '8a819dec-542f-4ff7-b63b-514ee5551261', '65c4d185-1032-4655-9458-77ede32ed14f'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:34:22 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-056e4b95-ba57-4453-82a3-c7f485d5d6a5 tempest-TaggedAttachmentsTest-1184208625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:34:22 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-056e4b95-ba57-4453-82a3-c7f485d5d6a5 tempest-TaggedAttachmentsTest-1184208625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:34:22 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-056e4b95-ba57-4453-82a3-c7f485d5d6a5 tempest-TaggedAttachmentsTest-1184208625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:34:22 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-056e4b95-ba57-4453-82a3-c7f485d5d6a5 tempest-TaggedAttachmentsTest-1184208625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:34:22 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-056e4b95-ba57-4453-82a3-c7f485d5d6a5 tempest-TaggedAttachmentsTest-1184208625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:34:22 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-056e4b95-ba57-4453-82a3-c7f485d5d6a5 tempest-TaggedAttachmentsTest-1184208625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:34:22 devstack sudo[90407]: pam_unix(sudo:session): session closed for user root Sep 23 14:34:22 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-bffb97b9-f9bd-439a-830e-aa7274278760 tempest-ServerActionsTestOtherA-561903914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0cd395f9-e766-4e32-94b1-775454bf3449_uwwl4xrsdevstack@QuobyteHD" returned: 0 in 0.881s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:34:22 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-bffb97b9-f9bd-439a-830e-aa7274278760 tempest-ServerActionsTestOtherA-561903914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:34:22 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-bffb97b9-f9bd-439a-830e-aa7274278760 tempest-ServerActionsTestOtherA-561903914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:34:22 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-bffb97b9-f9bd-439a-830e-aa7274278760 tempest-ServerActionsTestOtherA-561903914 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:34:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1849264612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e00fc7f5-752b-46f5-8b34-74d62a481d73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b055817b1834ad0899ce2ada1a4aa1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:34:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:34:19Z,use_quota=True,user_id='e96390e2252549d2bb096b1fef585b11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:34:22 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-bffb97b9-f9bd-439a-830e-aa7274278760 tempest-ServerActionsTestOtherA-561903914 None] Creating volume e00fc7f5-752b-46f5-8b34-74d62a481d73 {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:34:22 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-bffb97b9-f9bd-439a-830e-aa7274278760 tempest-ServerActionsTestOtherA-561903914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:34:22 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-bffb97b9-f9bd-439a-830e-aa7274278760 tempest-ServerActionsTestOtherA-561903914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:34:22 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-bffb97b9-f9bd-439a-830e-aa7274278760 tempest-ServerActionsTestOtherA-561903914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:34:22 devstack sudo[90435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:34:22 devstack sudo[90435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:34:22 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-bffb97b9-f9bd-439a-830e-aa7274278760 tempest-ServerActionsTestOtherA-561903914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:34:22 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-bffb97b9-f9bd-439a-830e-aa7274278760 tempest-ServerActionsTestOtherA-561903914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:34:22 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-bffb97b9-f9bd-439a-830e-aa7274278760 tempest-ServerActionsTestOtherA-561903914 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:34:22 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-bffb97b9-f9bd-439a-830e-aa7274278760 tempest-ServerActionsTestOtherA-561903914 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:34:22 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-bffb97b9-f9bd-439a-830e-aa7274278760 tempest-ServerActionsTestOtherA-561903914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e00fc7f5-752b-46f5-8b34-74d62a481d73 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:34:22 devstack sudo[90437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e00fc7f5-752b-46f5-8b34-74d62a481d73 1073741824 Sep 23 14:34:22 devstack sudo[90437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:34:22 devstack sudo[90435]: pam_unix(sudo:session): session closed for user root Sep 23 14:34:22 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-056e4b95-ba57-4453-82a3-c7f485d5d6a5 tempest-TaggedAttachmentsTest-1184208625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.548s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:34:22 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-056e4b95-ba57-4453-82a3-c7f485d5d6a5 tempest-TaggedAttachmentsTest-1184208625 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:34:22 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-056e4b95-ba57-4453-82a3-c7f485d5d6a5 tempest-TaggedAttachmentsTest-1184208625 None] Deleted volume successfully. Sep 23 14:34:22 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-056e4b95-ba57-4453-82a3-c7f485d5d6a5 tempest-TaggedAttachmentsTest-1184208625 None] Lock "cinder-bcd0e6fb-af3c-4979-80d8-cc5cd38b7c0f-delete_volume" released by "delete_volume" :: held 2.526s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:34:22 devstack sudo[90437]: pam_unix(sudo:session): session closed for user root Sep 23 14:34:22 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-bffb97b9-f9bd-439a-830e-aa7274278760 tempest-ServerActionsTestOtherA-561903914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e00fc7f5-752b-46f5-8b34-74d62a481d73 1073741824" returned: 0 in 0.811s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:34:22 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-bffb97b9-f9bd-439a-830e-aa7274278760 tempest-ServerActionsTestOtherA-561903914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e00fc7f5-752b-46f5-8b34-74d62a481d73 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:34:23 devstack sudo[90445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e00fc7f5-752b-46f5-8b34-74d62a481d73 Sep 23 14:34:23 devstack sudo[90445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:34:23 devstack sudo[90445]: pam_unix(sudo:session): session closed for user root Sep 23 14:34:23 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-bffb97b9-f9bd-439a-830e-aa7274278760 tempest-ServerActionsTestOtherA-561903914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e00fc7f5-752b-46f5-8b34-74d62a481d73" returned: 0 in 0.418s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:34:23 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-bffb97b9-f9bd-439a-830e-aa7274278760 tempest-ServerActionsTestOtherA-561903914 None] <== create_volume: return (1304ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:34:23 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-bffb97b9-f9bd-439a-830e-aa7274278760 tempest-ServerActionsTestOtherA-561903914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.313s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:34:23 devstack cinder-volume[86310]: DEBUG cinder.volume.volume_utils [None req-bffb97b9-f9bd-439a-830e-aa7274278760 tempest-ServerActionsTestOtherA-561903914 None] Attempting download of 0cd395f9-e766-4e32-94b1-775454bf3449 ((None, [{'url': 'file:///opt/stack/data/glance/images/0cd395f9-e766-4e32-94b1-775454bf3449', 'metadata': {}}])) to volume e00fc7f5-752b-46f5-8b34-74d62a481d73. {{(pid=86310) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 23 14:34:23 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[56d61f94-88d1-4815-9941-5cd4eb7ae4e0]: (4, 'raw') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:34:23 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-bffb97b9-f9bd-439a-830e-aa7274278760 tempest-ServerActionsTestOtherA-561903914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0cd395f9-e766-4e32-94b1-775454bf3449_jpcwbiq1 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:34:23 devstack sudo[90451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0cd395f9-e766-4e32-94b1-775454bf3449_jpcwbiq1 Sep 23 14:34:23 devstack sudo[90451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:34:24 devstack sudo[90451]: pam_unix(sudo:session): session closed for user root Sep 23 14:34:24 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-bffb97b9-f9bd-439a-830e-aa7274278760 tempest-ServerActionsTestOtherA-561903914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0cd395f9-e766-4e32-94b1-775454bf3449_jpcwbiq1" returned: 0 in 0.718s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:34:24 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-bffb97b9-f9bd-439a-830e-aa7274278760 tempest-ServerActionsTestOtherA-561903914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0cd395f9-e766-4e32-94b1-775454bf3449_jpcwbiq1 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:34:24 devstack sudo[90458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0cd395f9-e766-4e32-94b1-775454bf3449_jpcwbiq1 Sep 23 14:34:24 devstack sudo[90458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:34:25 devstack sudo[90458]: pam_unix(sudo:session): session closed for user root Sep 23 14:34:25 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-bffb97b9-f9bd-439a-830e-aa7274278760 tempest-ServerActionsTestOtherA-561903914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0cd395f9-e766-4e32-94b1-775454bf3449_jpcwbiq1" returned: 1 in 0.787s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:34:25 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-bffb97b9-f9bd-439a-830e-aa7274278760 tempest-ServerActionsTestOtherA-561903914 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0cd395f9-e766-4e32-94b1-775454bf3449_jpcwbiq1' failed. Not Retrying. {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 14:34:25 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[c83253a7-a0c0-44f1-9e27-079fdaa63d03]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:34:25 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-bffb97b9-f9bd-439a-830e-aa7274278760 tempest-ServerActionsTestOtherA-561903914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0cd395f9-e766-4e32-94b1-775454bf3449_uwwl4xrsdevstack@QuobyteHD {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:34:25 devstack sudo[90471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0cd395f9-e766-4e32-94b1-775454bf3449_uwwl4xrsdevstack@QuobyteHD Sep 23 14:34:25 devstack sudo[90471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:34:25 devstack sudo[90471]: pam_unix(sudo:session): session closed for user root Sep 23 14:34:25 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-bffb97b9-f9bd-439a-830e-aa7274278760 tempest-ServerActionsTestOtherA-561903914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0cd395f9-e766-4e32-94b1-775454bf3449_uwwl4xrsdevstack@QuobyteHD" returned: 0 in 0.639s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:34:25 devstack cinder-volume[86310]: DEBUG cinder.image.image_utils [None req-bffb97b9-f9bd-439a-830e-aa7274278760 tempest-ServerActionsTestOtherA-561903914 None] 0cd395f9-e766-4e32-94b1-775454bf3449 was qcow2, converting to qcow2 {{(pid=86310) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 23 14:34:25 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-bffb97b9-f9bd-439a-830e-aa7274278760 tempest-ServerActionsTestOtherA-561903914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0cd395f9-e766-4e32-94b1-775454bf3449_uwwl4xrsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e00fc7f5-752b-46f5-8b34-74d62a481d73 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:34:25 devstack sudo[90484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0cd395f9-e766-4e32-94b1-775454bf3449_uwwl4xrsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e00fc7f5-752b-46f5-8b34-74d62a481d73 Sep 23 14:34:25 devstack sudo[90484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:34:28 devstack sudo[90484]: pam_unix(sudo:session): session closed for user root Sep 23 14:34:28 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-bffb97b9-f9bd-439a-830e-aa7274278760 tempest-ServerActionsTestOtherA-561903914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0cd395f9-e766-4e32-94b1-775454bf3449_uwwl4xrsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e00fc7f5-752b-46f5-8b34-74d62a481d73" returned: 0 in 2.345s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:34:28 devstack cinder-volume[86310]: DEBUG cinder.image.image_utils [None req-bffb97b9-f9bd-439a-830e-aa7274278760 tempest-ServerActionsTestOtherA-561903914 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0cd395f9-e766-4e32-94b1-775454bf3449_uwwl4xrsdevstack@QuobyteHD, size 112.00 MB, duration 2.35 sec, destination /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e00fc7f5-752b-46f5-8b34-74d62a481d73 {{(pid=86310) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 14:34:28 devstack cinder-volume[86310]: INFO cinder.image.image_utils [None req-bffb97b9-f9bd-439a-830e-aa7274278760 tempest-ServerActionsTestOtherA-561903914 None] Converted 112.00 MB image at 47.72 MB/s Sep 23 14:34:28 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-bffb97b9-f9bd-439a-830e-aa7274278760 tempest-ServerActionsTestOtherA-561903914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e00fc7f5-752b-46f5-8b34-74d62a481d73 1G {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:34:28 devstack sudo[90494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e00fc7f5-752b-46f5-8b34-74d62a481d73 1G Sep 23 14:34:28 devstack sudo[90494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:34:28 devstack sudo[90494]: pam_unix(sudo:session): session closed for user root Sep 23 14:34:28 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-bffb97b9-f9bd-439a-830e-aa7274278760 tempest-ServerActionsTestOtherA-561903914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e00fc7f5-752b-46f5-8b34-74d62a481d73 1G" returned: 0 in 0.470s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:34:28 devstack cinder-volume[86310]: DEBUG cinder.volume.volume_utils [None req-bffb97b9-f9bd-439a-830e-aa7274278760 tempest-ServerActionsTestOtherA-561903914 None] Downloaded image 0cd395f9-e766-4e32-94b1-775454bf3449 ((None, [{'url': 'file:///opt/stack/data/glance/images/0cd395f9-e766-4e32-94b1-775454bf3449', 'metadata': {}}])) to volume e00fc7f5-752b-46f5-8b34-74d62a481d73 successfully. {{(pid=86310) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 23 14:34:28 devstack cinder-volume[86310]: DEBUG cinder.image.image_utils [None req-bffb97b9-f9bd-439a-830e-aa7274278760 tempest-ServerActionsTestOtherA-561903914 None] Temporary image 0cd395f9-e766-4e32-94b1-775454bf3449 for user e96390e2252549d2bb096b1fef585b11 is deleted. {{(pid=86310) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 23 14:34:28 devstack cinder-volume[86310]: DEBUG cinder.volume.volume_utils [None req-bffb97b9-f9bd-439a-830e-aa7274278760 tempest-ServerActionsTestOtherA-561903914 None] Marking volume e00fc7f5-752b-46f5-8b34-74d62a481d73 as bootable. {{(pid=86310) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 23 14:34:28 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-bffb97b9-f9bd-439a-830e-aa7274278760 tempest-ServerActionsTestOtherA-561903914 None] Copying metadata from image 0cd395f9-e766-4e32-94b1-775454bf3449 to e00fc7f5-752b-46f5-8b34-74d62a481d73. {{(pid=86310) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 23 14:34:28 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-bffb97b9-f9bd-439a-830e-aa7274278760 tempest-ServerActionsTestOtherA-561903914 None] Creating volume glance metadata for volume e00fc7f5-752b-46f5-8b34-74d62a481d73 backed by image 0cd395f9-e766-4e32-94b1-775454bf3449 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0cd395f9-e766-4e32-94b1-775454bf3449', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86310) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 23 14:34:28 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-bffb97b9-f9bd-439a-830e-aa7274278760 tempest-ServerActionsTestOtherA-561903914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fcbde59-68ea-49dc-8c63-a25d45b513e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e00fc7f5-752b-46f5-8b34-74d62a481d73', 'volume_size': 1, 'image_id': '0cd395f9-e766-4e32-94b1-775454bf3449', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0cd395f9-e766-4e32-94b1-775454bf3449', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7fa20aad952548c880b3288dd7d64dbc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0cd395f9-e766-4e32-94b1-775454bf3449', 'created_at': datetime.datetime(2026, 9, 23, 12, 25, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 23, 12, 25, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0cd395f9-e766-4e32-94b1-775454bf3449/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:34:28 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-bffb97b9-f9bd-439a-830e-aa7274278760 tempest-ServerActionsTestOtherA-561903914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e77829d7-e41a-464e-81f0-bbdc2aa82403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:34:28 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-bffb97b9-f9bd-439a-830e-aa7274278760 tempest-ServerActionsTestOtherA-561903914 None] Volume volume-e00fc7f5-752b-46f5-8b34-74d62a481d73 (e00fc7f5-752b-46f5-8b34-74d62a481d73): created successfully Sep 23 14:34:28 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-bffb97b9-f9bd-439a-830e-aa7274278760 tempest-ServerActionsTestOtherA-561903914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e77829d7-e41a-464e-81f0-bbdc2aa82403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:34:28 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-bffb97b9-f9bd-439a-830e-aa7274278760 tempest-ServerActionsTestOtherA-561903914 None] Flow 'volume_create_manager' (27784185-7475-4269-8777-0704690e2516) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:34:28 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-bffb97b9-f9bd-439a-830e-aa7274278760 tempest-ServerActionsTestOtherA-561903914 None] Created volume successfully. Sep 23 14:34:33 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [req-da0572c7-0796-4362-be4e-d01d0a8c2771 req-fbec02e1-d493-42ae-baba-91cbe2c9fa3b tempest-ServerActionsTestOtherA-561903914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:34:33 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [req-da0572c7-0796-4362-be4e-d01d0a8c2771 req-fbec02e1-d493-42ae-baba-91cbe2c9fa3b tempest-ServerActionsTestOtherA-561903914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:34:33 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [req-da0572c7-0796-4362-be4e-d01d0a8c2771 req-fbec02e1-d493-42ae-baba-91cbe2c9fa3b tempest-ServerActionsTestOtherA-561903914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:34:33 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [req-da0572c7-0796-4362-be4e-d01d0a8c2771 req-fbec02e1-d493-42ae-baba-91cbe2c9fa3b tempest-ServerActionsTestOtherA-561903914 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362', 'name': 'volume-e00fc7f5-752b-46f5-8b34-74d62a481d73', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '34a77199-b88b-4236-af49-f8bcf7096e25', 'enforce_multipath': True} {{(pid=86310) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 14:34:33 devstack cinder-volume[86310]: INFO cinder.volume.manager [req-da0572c7-0796-4362-be4e-d01d0a8c2771 req-fbec02e1-d493-42ae-baba-91cbe2c9fa3b tempest-ServerActionsTestOtherA-561903914 None] attachment_update completed successfully. Sep 23 14:34:43 devstack cinder-volume[86310]: DEBUG dbcounter [-] [86310] Writing DB stats cinder:SELECT=24,cinder:UPDATE=14,cinder:INSERT=9 {{(pid=86310) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 14:34:43 devstack cinder-volume[86310]: DEBUG dbcounter [-] [86310] Writing DB stats cinder:SELECT=21,cinder:UPDATE=15,cinder:INSERT=9,cinder:DELETE=2 {{(pid=86310) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 14:34:44 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-891477c1-3b53-4b1a-ad0f-f6a4e6c1d28e tempest-AttachVolumeShelveTestJSON-422359333 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:34:44 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-891477c1-3b53-4b1a-ad0f-f6a4e6c1d28e tempest-AttachVolumeShelveTestJSON-422359333 None] Flow 'volume_create_manager' (5480f3d3-16ac-4546-b1cc-6568ff770d53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:34:44 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-891477c1-3b53-4b1a-ad0f-f6a4e6c1d28e tempest-AttachVolumeShelveTestJSON-422359333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (170f1603-ba3c-484a-939e-4abd86dbeb5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:34:44 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-891477c1-3b53-4b1a-ad0f-f6a4e6c1d28e tempest-AttachVolumeShelveTestJSON-422359333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (170f1603-ba3c-484a-939e-4abd86dbeb5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:34:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1552084657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a61114e5-58d0-4620-9338-220104de2b7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41553f41b86e41a5af5eb83756dc407a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:34:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:34:44Z,use_quota=True,user_id='f35afd9f69e54d07bbf0629d465203e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:34:44 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-891477c1-3b53-4b1a-ad0f-f6a4e6c1d28e tempest-AttachVolumeShelveTestJSON-422359333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a26889d-2627-4c1f-a4c2-6297c183a1bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:34:44 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-891477c1-3b53-4b1a-ad0f-f6a4e6c1d28e tempest-AttachVolumeShelveTestJSON-422359333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a26889d-2627-4c1f-a4c2-6297c183a1bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:34:44 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-891477c1-3b53-4b1a-ad0f-f6a4e6c1d28e tempest-AttachVolumeShelveTestJSON-422359333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e4a00cc-2b8d-4672-9b39-a9a479ecafdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:34:44 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-891477c1-3b53-4b1a-ad0f-f6a4e6c1d28e tempest-AttachVolumeShelveTestJSON-422359333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e4a00cc-2b8d-4672-9b39-a9a479ecafdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a61114e5-58d0-4620-9338-220104de2b7b', 'volume_name': 'volume-a61114e5-58d0-4620-9338-220104de2b7b', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:34:44 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-891477c1-3b53-4b1a-ad0f-f6a4e6c1d28e tempest-AttachVolumeShelveTestJSON-422359333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2b66ab9-4a05-488e-b179-2a75084b7525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:34:44 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-891477c1-3b53-4b1a-ad0f-f6a4e6c1d28e tempest-AttachVolumeShelveTestJSON-422359333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2b66ab9-4a05-488e-b179-2a75084b7525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:34:44 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-891477c1-3b53-4b1a-ad0f-f6a4e6c1d28e tempest-AttachVolumeShelveTestJSON-422359333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f1c5305-53ef-459a-81e7-c4147d40b0a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:34:44 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-891477c1-3b53-4b1a-ad0f-f6a4e6c1d28e tempest-AttachVolumeShelveTestJSON-422359333 None] Volume a61114e5-58d0-4620-9338-220104de2b7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a61114e5-58d0-4620-9338-220104de2b7b', 'volume_size': 1} Sep 23 14:34:44 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-891477c1-3b53-4b1a-ad0f-f6a4e6c1d28e tempest-AttachVolumeShelveTestJSON-422359333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:34:44 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-891477c1-3b53-4b1a-ad0f-f6a4e6c1d28e tempest-AttachVolumeShelveTestJSON-422359333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:34:44 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-891477c1-3b53-4b1a-ad0f-f6a4e6c1d28e tempest-AttachVolumeShelveTestJSON-422359333 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:34:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1552084657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a61114e5-58d0-4620-9338-220104de2b7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41553f41b86e41a5af5eb83756dc407a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:34:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:34:44Z,use_quota=True,user_id='f35afd9f69e54d07bbf0629d465203e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:34:44 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-891477c1-3b53-4b1a-ad0f-f6a4e6c1d28e tempest-AttachVolumeShelveTestJSON-422359333 None] Creating volume a61114e5-58d0-4620-9338-220104de2b7b {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:34:44 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-891477c1-3b53-4b1a-ad0f-f6a4e6c1d28e tempest-AttachVolumeShelveTestJSON-422359333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:34:44 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-891477c1-3b53-4b1a-ad0f-f6a4e6c1d28e tempest-AttachVolumeShelveTestJSON-422359333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:34:44 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-891477c1-3b53-4b1a-ad0f-f6a4e6c1d28e tempest-AttachVolumeShelveTestJSON-422359333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:34:44 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-891477c1-3b53-4b1a-ad0f-f6a4e6c1d28e tempest-AttachVolumeShelveTestJSON-422359333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:34:44 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-891477c1-3b53-4b1a-ad0f-f6a4e6c1d28e tempest-AttachVolumeShelveTestJSON-422359333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:34:44 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-891477c1-3b53-4b1a-ad0f-f6a4e6c1d28e tempest-AttachVolumeShelveTestJSON-422359333 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:34:44 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-891477c1-3b53-4b1a-ad0f-f6a4e6c1d28e tempest-AttachVolumeShelveTestJSON-422359333 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:34:44 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-891477c1-3b53-4b1a-ad0f-f6a4e6c1d28e tempest-AttachVolumeShelveTestJSON-422359333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-a61114e5-58d0-4620-9338-220104de2b7b 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:34:44 devstack sudo[91092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-a61114e5-58d0-4620-9338-220104de2b7b 1073741824 Sep 23 14:34:44 devstack sudo[91092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:34:45 devstack sudo[91092]: pam_unix(sudo:session): session closed for user root Sep 23 14:34:45 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-891477c1-3b53-4b1a-ad0f-f6a4e6c1d28e tempest-AttachVolumeShelveTestJSON-422359333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-a61114e5-58d0-4620-9338-220104de2b7b 1073741824" returned: 0 in 0.966s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:34:45 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-891477c1-3b53-4b1a-ad0f-f6a4e6c1d28e tempest-AttachVolumeShelveTestJSON-422359333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-a61114e5-58d0-4620-9338-220104de2b7b {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:34:45 devstack sudo[91098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-a61114e5-58d0-4620-9338-220104de2b7b Sep 23 14:34:45 devstack sudo[91098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:34:46 devstack sudo[91098]: pam_unix(sudo:session): session closed for user root Sep 23 14:34:46 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-891477c1-3b53-4b1a-ad0f-f6a4e6c1d28e tempest-AttachVolumeShelveTestJSON-422359333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-a61114e5-58d0-4620-9338-220104de2b7b" returned: 0 in 0.601s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:34:46 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-891477c1-3b53-4b1a-ad0f-f6a4e6c1d28e tempest-AttachVolumeShelveTestJSON-422359333 None] <== create_volume: return (1737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:34:46 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-891477c1-3b53-4b1a-ad0f-f6a4e6c1d28e tempest-AttachVolumeShelveTestJSON-422359333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.741s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:34:46 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-891477c1-3b53-4b1a-ad0f-f6a4e6c1d28e tempest-AttachVolumeShelveTestJSON-422359333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f1c5305-53ef-459a-81e7-c4147d40b0a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a61114e5-58d0-4620-9338-220104de2b7b', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:34:46 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-891477c1-3b53-4b1a-ad0f-f6a4e6c1d28e tempest-AttachVolumeShelveTestJSON-422359333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89be8f2a-4653-4864-bee4-f6b6dedd3ed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:34:46 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-891477c1-3b53-4b1a-ad0f-f6a4e6c1d28e tempest-AttachVolumeShelveTestJSON-422359333 None] Volume volume-a61114e5-58d0-4620-9338-220104de2b7b (a61114e5-58d0-4620-9338-220104de2b7b): created successfully Sep 23 14:34:46 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-891477c1-3b53-4b1a-ad0f-f6a4e6c1d28e tempest-AttachVolumeShelveTestJSON-422359333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89be8f2a-4653-4864-bee4-f6b6dedd3ed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:34:46 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-891477c1-3b53-4b1a-ad0f-f6a4e6c1d28e tempest-AttachVolumeShelveTestJSON-422359333 None] Flow 'volume_create_manager' (5480f3d3-16ac-4546-b1cc-6568ff770d53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:34:46 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-891477c1-3b53-4b1a-ad0f-f6a4e6c1d28e tempest-AttachVolumeShelveTestJSON-422359333 None] Created volume successfully. Sep 23 14:34:51 devstack cinder-volume[86310]: DEBUG oslo_service.periodic_task [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86310) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 14:34:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:34:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:34:51 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:34:51 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:34:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:34:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:34:51 devstack sudo[91121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:34:51 devstack sudo[91121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:34:52 devstack sudo[91121]: pam_unix(sudo:session): session closed for user root Sep 23 14:34:52 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.576s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:34:52 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:34:52 devstack cinder-volume[86310]: DEBUG oslo_service.periodic_task [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Running periodic task VolumeManager._thread_info {{(pid=86310) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 14:34:52 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] thread count: 28 {{(pid=86310) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 14:34:52 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] thread info: [<_MainThread(MainThread, started 128854208852096)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86310) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 14:34:56 devstack cinder-volume[86310]: DEBUG dbcounter [-] [86310] Writing DB stats cinder:SELECT=2,cinder:UPDATE=4,cinder:INSERT=1 {{(pid=86310) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 14:34:56 devstack cinder-volume[86310]: DEBUG dbcounter [-] [86310] Writing DB stats cinder:UPDATE=2,cinder:SELECT=2,cinder:DELETE=1 {{(pid=86310) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 14:34:57 devstack cinder-volume[86310]: INFO cinder.volume.manager [req-82ef04d5-27f5-401b-b033-601e762260da req-9daa1e83-4fc9-4553-a175-64f015fe617a tempest-ServerActionsTestOtherA-561903914 None] Terminate volume connection completed successfully. Sep 23 14:34:57 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [req-82ef04d5-27f5-401b-b033-601e762260da req-9daa1e83-4fc9-4553-a175-64f015fe617a tempest-ServerActionsTestOtherA-561903914 None] Deleting attachment 34a77199-b88b-4236-af49-f8bcf7096e25. {{(pid=86310) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 14:35:01 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [req-82ef04d5-27f5-401b-b033-601e762260da req-d543daa6-079e-45ab-95a5-8862148e5b33 tempest-ServerActionsTestOtherA-561903914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:35:01 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [req-82ef04d5-27f5-401b-b033-601e762260da req-d543daa6-079e-45ab-95a5-8862148e5b33 tempest-ServerActionsTestOtherA-561903914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:35:01 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [req-82ef04d5-27f5-401b-b033-601e762260da req-d543daa6-079e-45ab-95a5-8862148e5b33 tempest-ServerActionsTestOtherA-561903914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:35:01 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [req-82ef04d5-27f5-401b-b033-601e762260da req-d543daa6-079e-45ab-95a5-8862148e5b33 tempest-ServerActionsTestOtherA-561903914 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362', 'name': 'volume-e00fc7f5-752b-46f5-8b34-74d62a481d73', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '47460e16-832e-4933-95b1-615125d99a92', 'enforce_multipath': True} {{(pid=86310) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 14:35:01 devstack cinder-volume[86310]: INFO cinder.volume.manager [req-82ef04d5-27f5-401b-b033-601e762260da req-d543daa6-079e-45ab-95a5-8862148e5b33 tempest-ServerActionsTestOtherA-561903914 None] attachment_update completed successfully. Sep 23 14:35:06 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [req-6689599a-bb28-4efb-8245-239aa66816f6 req-e0da6f3c-f9dd-478d-8c25-acd1feb0d18f tempest-AttachVolumeShelveTestJSON-422359333 None] No connector for attachment 62aff9e3-cbd4-4188-b5c5-91c06561ba36; skipping storage backend terminate_connection call. {{(pid=86310) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 23 14:35:06 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [req-6689599a-bb28-4efb-8245-239aa66816f6 req-e0da6f3c-f9dd-478d-8c25-acd1feb0d18f tempest-AttachVolumeShelveTestJSON-422359333 None] Deleting attachment 62aff9e3-cbd4-4188-b5c5-91c06561ba36. {{(pid=86310) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 14:35:09 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f8bfcfb-baa9-4e20-a39a-2540d7db1eaa tempest-AttachVolumeNegativeTest-527431328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:35:09 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-2f8bfcfb-baa9-4e20-a39a-2540d7db1eaa tempest-AttachVolumeNegativeTest-527431328 None] Flow 'volume_create_manager' (62fdf65d-c472-475f-a310-52cfe47269c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:35:09 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-2f8bfcfb-baa9-4e20-a39a-2540d7db1eaa tempest-AttachVolumeNegativeTest-527431328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c66fc533-f40c-46dd-8d24-7b897353a81c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:35:09 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-2f8bfcfb-baa9-4e20-a39a-2540d7db1eaa tempest-AttachVolumeNegativeTest-527431328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c66fc533-f40c-46dd-8d24-7b897353a81c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:35:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1416338351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=481939eb-5320-4bcd-b966-b06e3976629a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1ac9a384403436f88ec793cde23db56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:35:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:35:09Z,use_quota=True,user_id='3d6e4f5983114e05b289eeced4b0beeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:35:09 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-2f8bfcfb-baa9-4e20-a39a-2540d7db1eaa tempest-AttachVolumeNegativeTest-527431328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e212363-386f-4c17-8306-e9132eb12aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:35:09 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-2f8bfcfb-baa9-4e20-a39a-2540d7db1eaa tempest-AttachVolumeNegativeTest-527431328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e212363-386f-4c17-8306-e9132eb12aa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:35:09 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-2f8bfcfb-baa9-4e20-a39a-2540d7db1eaa tempest-AttachVolumeNegativeTest-527431328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c08088b4-547b-4f5a-bfc7-0052f051b529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:35:09 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-2f8bfcfb-baa9-4e20-a39a-2540d7db1eaa tempest-AttachVolumeNegativeTest-527431328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c08088b4-547b-4f5a-bfc7-0052f051b529) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '481939eb-5320-4bcd-b966-b06e3976629a', 'volume_name': 'volume-481939eb-5320-4bcd-b966-b06e3976629a', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:35:09 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-2f8bfcfb-baa9-4e20-a39a-2540d7db1eaa tempest-AttachVolumeNegativeTest-527431328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dc1a5da-a92c-4016-b92b-47ed1a07a917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:35:09 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-2f8bfcfb-baa9-4e20-a39a-2540d7db1eaa tempest-AttachVolumeNegativeTest-527431328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dc1a5da-a92c-4016-b92b-47ed1a07a917) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:35:09 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-2f8bfcfb-baa9-4e20-a39a-2540d7db1eaa tempest-AttachVolumeNegativeTest-527431328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b7d743b-d45c-4ce7-bc0a-1f9b3ad08bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:35:09 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-2f8bfcfb-baa9-4e20-a39a-2540d7db1eaa tempest-AttachVolumeNegativeTest-527431328 None] Volume 481939eb-5320-4bcd-b966-b06e3976629a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-481939eb-5320-4bcd-b966-b06e3976629a', 'volume_size': 1} Sep 23 14:35:09 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-2f8bfcfb-baa9-4e20-a39a-2540d7db1eaa tempest-AttachVolumeNegativeTest-527431328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:35:09 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-2f8bfcfb-baa9-4e20-a39a-2540d7db1eaa tempest-AttachVolumeNegativeTest-527431328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:35:09 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-2f8bfcfb-baa9-4e20-a39a-2540d7db1eaa tempest-AttachVolumeNegativeTest-527431328 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:35:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1416338351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=481939eb-5320-4bcd-b966-b06e3976629a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1ac9a384403436f88ec793cde23db56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:35:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:35:09Z,use_quota=True,user_id='3d6e4f5983114e05b289eeced4b0beeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:35:09 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-2f8bfcfb-baa9-4e20-a39a-2540d7db1eaa tempest-AttachVolumeNegativeTest-527431328 None] Creating volume 481939eb-5320-4bcd-b966-b06e3976629a {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:35:09 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-2f8bfcfb-baa9-4e20-a39a-2540d7db1eaa tempest-AttachVolumeNegativeTest-527431328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:35:09 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-2f8bfcfb-baa9-4e20-a39a-2540d7db1eaa tempest-AttachVolumeNegativeTest-527431328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:35:09 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-2f8bfcfb-baa9-4e20-a39a-2540d7db1eaa tempest-AttachVolumeNegativeTest-527431328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:35:09 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-2f8bfcfb-baa9-4e20-a39a-2540d7db1eaa tempest-AttachVolumeNegativeTest-527431328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:35:09 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-2f8bfcfb-baa9-4e20-a39a-2540d7db1eaa tempest-AttachVolumeNegativeTest-527431328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:35:09 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-2f8bfcfb-baa9-4e20-a39a-2540d7db1eaa tempest-AttachVolumeNegativeTest-527431328 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:35:09 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-2f8bfcfb-baa9-4e20-a39a-2540d7db1eaa tempest-AttachVolumeNegativeTest-527431328 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:35:09 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-2f8bfcfb-baa9-4e20-a39a-2540d7db1eaa tempest-AttachVolumeNegativeTest-527431328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-481939eb-5320-4bcd-b966-b06e3976629a 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:35:09 devstack sudo[91708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-481939eb-5320-4bcd-b966-b06e3976629a 1073741824 Sep 23 14:35:09 devstack sudo[91708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:35:09 devstack sudo[91708]: pam_unix(sudo:session): session closed for user root Sep 23 14:35:09 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-2f8bfcfb-baa9-4e20-a39a-2540d7db1eaa tempest-AttachVolumeNegativeTest-527431328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-481939eb-5320-4bcd-b966-b06e3976629a 1073741824" returned: 0 in 0.620s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:35:09 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-2f8bfcfb-baa9-4e20-a39a-2540d7db1eaa tempest-AttachVolumeNegativeTest-527431328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-481939eb-5320-4bcd-b966-b06e3976629a {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:35:09 devstack sudo[91714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-481939eb-5320-4bcd-b966-b06e3976629a Sep 23 14:35:09 devstack sudo[91714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:35:10 devstack sudo[91714]: pam_unix(sudo:session): session closed for user root Sep 23 14:35:10 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-2f8bfcfb-baa9-4e20-a39a-2540d7db1eaa tempest-AttachVolumeNegativeTest-527431328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-481939eb-5320-4bcd-b966-b06e3976629a" returned: 0 in 0.310s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:35:10 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-2f8bfcfb-baa9-4e20-a39a-2540d7db1eaa tempest-AttachVolumeNegativeTest-527431328 None] <== create_volume: return (1005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:35:10 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-2f8bfcfb-baa9-4e20-a39a-2540d7db1eaa tempest-AttachVolumeNegativeTest-527431328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.009s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:35:10 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-2f8bfcfb-baa9-4e20-a39a-2540d7db1eaa tempest-AttachVolumeNegativeTest-527431328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b7d743b-d45c-4ce7-bc0a-1f9b3ad08bf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-481939eb-5320-4bcd-b966-b06e3976629a', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:35:10 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-2f8bfcfb-baa9-4e20-a39a-2540d7db1eaa tempest-AttachVolumeNegativeTest-527431328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bc0600f-f8cd-48e7-8257-357cae92385d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:35:10 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-2f8bfcfb-baa9-4e20-a39a-2540d7db1eaa tempest-AttachVolumeNegativeTest-527431328 None] Volume volume-481939eb-5320-4bcd-b966-b06e3976629a (481939eb-5320-4bcd-b966-b06e3976629a): created successfully Sep 23 14:35:10 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-2f8bfcfb-baa9-4e20-a39a-2540d7db1eaa tempest-AttachVolumeNegativeTest-527431328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bc0600f-f8cd-48e7-8257-357cae92385d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:35:10 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-2f8bfcfb-baa9-4e20-a39a-2540d7db1eaa tempest-AttachVolumeNegativeTest-527431328 None] Flow 'volume_create_manager' (62fdf65d-c472-475f-a310-52cfe47269c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:35:10 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-2f8bfcfb-baa9-4e20-a39a-2540d7db1eaa tempest-AttachVolumeNegativeTest-527431328 None] Created volume successfully. Sep 23 14:35:14 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [req-33dbf089-b249-42b0-8a58-fce3041f0d30 req-0820a30a-effd-4e79-8d1c-5a53382b90ee tempest-AttachVolumeNegativeTest-527431328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:35:14 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [req-33dbf089-b249-42b0-8a58-fce3041f0d30 req-0820a30a-effd-4e79-8d1c-5a53382b90ee tempest-AttachVolumeNegativeTest-527431328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.011s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:35:14 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [req-33dbf089-b249-42b0-8a58-fce3041f0d30 req-0820a30a-effd-4e79-8d1c-5a53382b90ee tempest-AttachVolumeNegativeTest-527431328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.061s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:35:15 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [req-33dbf089-b249-42b0-8a58-fce3041f0d30 req-0820a30a-effd-4e79-8d1c-5a53382b90ee tempest-AttachVolumeNegativeTest-527431328 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362', 'name': 'volume-481939eb-5320-4bcd-b966-b06e3976629a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8833dca9-c772-44b3-9992-7ba3016bf531', 'enforce_multipath': True} {{(pid=86310) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 14:35:15 devstack cinder-volume[86310]: INFO cinder.volume.manager [req-33dbf089-b249-42b0-8a58-fce3041f0d30 req-0820a30a-effd-4e79-8d1c-5a53382b90ee tempest-AttachVolumeNegativeTest-527431328 None] attachment_update completed successfully. Sep 23 14:35:18 devstack cinder-volume[86310]: INFO cinder.volume.manager [req-ce0700a3-255d-4be7-b8b4-e72ead94fdd2 req-40e7af90-7cfc-478b-882c-db3900b70915 tempest-AttachVolumeNegativeTest-527431328 None] Terminate volume connection completed successfully. Sep 23 14:35:18 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [req-ce0700a3-255d-4be7-b8b4-e72ead94fdd2 req-40e7af90-7cfc-478b-882c-db3900b70915 tempest-AttachVolumeNegativeTest-527431328 None] Deleting attachment 8833dca9-c772-44b3-9992-7ba3016bf531. {{(pid=86310) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 14:35:28 devstack cinder-volume[86310]: DEBUG dbcounter [-] [86310] Writing DB stats cinder:SELECT=22,cinder:UPDATE=5 {{(pid=86310) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 14:35:28 devstack cinder-volume[86310]: DEBUG dbcounter [-] [86310] Writing DB stats cinder:SELECT=14,cinder:UPDATE=7,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86310) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 14:35:40 devstack cinder-volume[86310]: INFO cinder.volume.manager [req-49270d69-b4a6-4d01-90dd-f01dbdef951b req-4345c37b-c403-4bea-bf0e-ac4e770db5cf tempest-ServerActionsTestOtherA-561903914 None] Terminate volume connection completed successfully. Sep 23 14:35:40 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [req-49270d69-b4a6-4d01-90dd-f01dbdef951b req-4345c37b-c403-4bea-bf0e-ac4e770db5cf tempest-ServerActionsTestOtherA-561903914 None] Deleting attachment 47460e16-832e-4933-95b1-615125d99a92. {{(pid=86310) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 14:35:40 devstack cinder-volume[86310]: DEBUG cinder.coordination [req-49270d69-b4a6-4d01-90dd-f01dbdef951b req-fa106ff4-1ae1-49b5-8edd-e5231d677c39 tempest-ServerActionsTestOtherA-561903914 None] Acquiring lock "cinder-e00fc7f5-752b-46f5-8b34-74d62a481d73-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:35:40 devstack cinder-volume[86310]: DEBUG cinder.coordination [req-49270d69-b4a6-4d01-90dd-f01dbdef951b req-fa106ff4-1ae1-49b5-8edd-e5231d677c39 tempest-ServerActionsTestOtherA-561903914 None] Lock "cinder-e00fc7f5-752b-46f5-8b34-74d62a481d73-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:35:40 devstack cinder-volume[86310]: DEBUG cinder.coordination [req-49270d69-b4a6-4d01-90dd-f01dbdef951b req-fa106ff4-1ae1-49b5-8edd-e5231d677c39 tempest-ServerActionsTestOtherA-561903914 None] Acquiring lock "cinder-quobyte-e00fc7f5-752b-46f5-8b34-74d62a481d73" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:35:40 devstack cinder-volume[86310]: DEBUG cinder.coordination [req-49270d69-b4a6-4d01-90dd-f01dbdef951b req-fa106ff4-1ae1-49b5-8edd-e5231d677c39 tempest-ServerActionsTestOtherA-561903914 None] Lock "cinder-quobyte-e00fc7f5-752b-46f5-8b34-74d62a481d73" acquired by "delete_volume" :: waited 0.054s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:35:41 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[616fc1d5-1456-4aad-a99f-8fd60619b52b]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:35:41 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [req-49270d69-b4a6-4d01-90dd-f01dbdef951b req-fa106ff4-1ae1-49b5-8edd-e5231d677c39 tempest-ServerActionsTestOtherA-561903914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e00fc7f5-752b-46f5-8b34-74d62a481d73 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:35:41 devstack sudo[92237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e00fc7f5-752b-46f5-8b34-74d62a481d73 Sep 23 14:35:41 devstack sudo[92237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:35:41 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-d03777d4-26de-49ac-bd31-0343d2a860d7 tempest-ServersNegativeTestJSON-699496641 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:35:41 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-d03777d4-26de-49ac-bd31-0343d2a860d7 tempest-ServersNegativeTestJSON-699496641 None] Flow 'volume_create_manager' (df90c37b-699a-4587-a12b-6eaf2653127e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:35:41 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-d03777d4-26de-49ac-bd31-0343d2a860d7 tempest-ServersNegativeTestJSON-699496641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7605b3cc-6047-4ee3-b532-d8790aac6588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:35:41 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-d03777d4-26de-49ac-bd31-0343d2a860d7 tempest-ServersNegativeTestJSON-699496641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7605b3cc-6047-4ee3-b532-d8790aac6588) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:35:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1920434895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa1a1e54-ad32-4aeb-a510-de4080f6458d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21b36bc21df3483fb1a630704251e990',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:35:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:35:41Z,use_quota=True,user_id='b5d3aa64ac924857a347114584fca708',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:35:41 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-d03777d4-26de-49ac-bd31-0343d2a860d7 tempest-ServersNegativeTestJSON-699496641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (020efd70-5605-4198-90ac-392cbe21fad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:35:41 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-d03777d4-26de-49ac-bd31-0343d2a860d7 tempest-ServersNegativeTestJSON-699496641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (020efd70-5605-4198-90ac-392cbe21fad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:35:41 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-d03777d4-26de-49ac-bd31-0343d2a860d7 tempest-ServersNegativeTestJSON-699496641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68675d06-c54c-48fc-b335-c981d17f8a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:35:41 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-d03777d4-26de-49ac-bd31-0343d2a860d7 tempest-ServersNegativeTestJSON-699496641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68675d06-c54c-48fc-b335-c981d17f8a26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa1a1e54-ad32-4aeb-a510-de4080f6458d', 'volume_name': 'volume-fa1a1e54-ad32-4aeb-a510-de4080f6458d', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:35:41 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-d03777d4-26de-49ac-bd31-0343d2a860d7 tempest-ServersNegativeTestJSON-699496641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6491f8c6-197a-4c59-908a-7bcabfac651f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:35:41 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-d03777d4-26de-49ac-bd31-0343d2a860d7 tempest-ServersNegativeTestJSON-699496641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6491f8c6-197a-4c59-908a-7bcabfac651f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:35:41 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-d03777d4-26de-49ac-bd31-0343d2a860d7 tempest-ServersNegativeTestJSON-699496641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54f8b70a-e5a5-476d-add2-dc6bf06c1aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:35:41 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-d03777d4-26de-49ac-bd31-0343d2a860d7 tempest-ServersNegativeTestJSON-699496641 None] Volume fa1a1e54-ad32-4aeb-a510-de4080f6458d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa1a1e54-ad32-4aeb-a510-de4080f6458d', 'volume_size': 1} Sep 23 14:35:41 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-d03777d4-26de-49ac-bd31-0343d2a860d7 tempest-ServersNegativeTestJSON-699496641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:35:41 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-d03777d4-26de-49ac-bd31-0343d2a860d7 tempest-ServersNegativeTestJSON-699496641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:35:41 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-d03777d4-26de-49ac-bd31-0343d2a860d7 tempest-ServersNegativeTestJSON-699496641 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:35:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1920434895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa1a1e54-ad32-4aeb-a510-de4080f6458d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21b36bc21df3483fb1a630704251e990',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:35:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:35:41Z,use_quota=True,user_id='b5d3aa64ac924857a347114584fca708',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:35:41 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-d03777d4-26de-49ac-bd31-0343d2a860d7 tempest-ServersNegativeTestJSON-699496641 None] Creating volume fa1a1e54-ad32-4aeb-a510-de4080f6458d {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:35:41 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-d03777d4-26de-49ac-bd31-0343d2a860d7 tempest-ServersNegativeTestJSON-699496641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:35:41 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-d03777d4-26de-49ac-bd31-0343d2a860d7 tempest-ServersNegativeTestJSON-699496641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:35:41 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-d03777d4-26de-49ac-bd31-0343d2a860d7 tempest-ServersNegativeTestJSON-699496641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:35:41 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-d03777d4-26de-49ac-bd31-0343d2a860d7 tempest-ServersNegativeTestJSON-699496641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:35:41 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-d03777d4-26de-49ac-bd31-0343d2a860d7 tempest-ServersNegativeTestJSON-699496641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:35:41 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-d03777d4-26de-49ac-bd31-0343d2a860d7 tempest-ServersNegativeTestJSON-699496641 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:35:41 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-d03777d4-26de-49ac-bd31-0343d2a860d7 tempest-ServersNegativeTestJSON-699496641 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:35:41 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d03777d4-26de-49ac-bd31-0343d2a860d7 tempest-ServersNegativeTestJSON-699496641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fa1a1e54-ad32-4aeb-a510-de4080f6458d 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:35:41 devstack sudo[92239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fa1a1e54-ad32-4aeb-a510-de4080f6458d 1073741824 Sep 23 14:35:41 devstack sudo[92239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:35:41 devstack sudo[92237]: pam_unix(sudo:session): session closed for user root Sep 23 14:35:41 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [req-49270d69-b4a6-4d01-90dd-f01dbdef951b req-fa106ff4-1ae1-49b5-8edd-e5231d677c39 tempest-ServerActionsTestOtherA-561903914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e00fc7f5-752b-46f5-8b34-74d62a481d73" returned: 0 in 0.826s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:35:41 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [req-49270d69-b4a6-4d01-90dd-f01dbdef951b req-fa106ff4-1ae1-49b5-8edd-e5231d677c39 tempest-ServerActionsTestOtherA-561903914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e00fc7f5-752b-46f5-8b34-74d62a481d73 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:35:41 devstack sudo[92245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e00fc7f5-752b-46f5-8b34-74d62a481d73 Sep 23 14:35:41 devstack sudo[92245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:35:42 devstack sudo[92245]: pam_unix(sudo:session): session closed for user root Sep 23 14:35:42 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [req-49270d69-b4a6-4d01-90dd-f01dbdef951b req-fa106ff4-1ae1-49b5-8edd-e5231d677c39 tempest-ServerActionsTestOtherA-561903914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e00fc7f5-752b-46f5-8b34-74d62a481d73" returned: 0 in 0.394s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:35:42 devstack cinder-volume[86310]: DEBUG cinder.coordination [req-49270d69-b4a6-4d01-90dd-f01dbdef951b req-fa106ff4-1ae1-49b5-8edd-e5231d677c39 tempest-ServerActionsTestOtherA-561903914 None] Lock "cinder-quobyte-e00fc7f5-752b-46f5-8b34-74d62a481d73" released by "delete_volume" :: held 1.302s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:35:42 devstack cinder-volume[86310]: DEBUG cinder.quota [req-49270d69-b4a6-4d01-90dd-f01dbdef951b req-fa106ff4-1ae1-49b5-8edd-e5231d677c39 tempest-ServerActionsTestOtherA-561903914 None] Created reservations ['b4533dbd-b699-4703-b0ac-f71934cd1905', '07a5b748-f4d1-43ea-8290-898cabacd854', 'c85012a6-4ec5-43c4-87e0-5a770e4bd405', '296f611c-d9e8-4b9d-91d8-b308b1e2bbea'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:35:42 devstack sudo[92239]: pam_unix(sudo:session): session closed for user root Sep 23 14:35:42 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d03777d4-26de-49ac-bd31-0343d2a860d7 tempest-ServersNegativeTestJSON-699496641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fa1a1e54-ad32-4aeb-a510-de4080f6458d 1073741824" returned: 0 in 0.787s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:35:42 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d03777d4-26de-49ac-bd31-0343d2a860d7 tempest-ServersNegativeTestJSON-699496641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fa1a1e54-ad32-4aeb-a510-de4080f6458d {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:35:42 devstack sudo[92256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fa1a1e54-ad32-4aeb-a510-de4080f6458d Sep 23 14:35:42 devstack sudo[92256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:35:42 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [req-49270d69-b4a6-4d01-90dd-f01dbdef951b req-fa106ff4-1ae1-49b5-8edd-e5231d677c39 tempest-ServerActionsTestOtherA-561903914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:35:42 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [req-49270d69-b4a6-4d01-90dd-f01dbdef951b req-fa106ff4-1ae1-49b5-8edd-e5231d677c39 tempest-ServerActionsTestOtherA-561903914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:35:42 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [req-49270d69-b4a6-4d01-90dd-f01dbdef951b req-fa106ff4-1ae1-49b5-8edd-e5231d677c39 tempest-ServerActionsTestOtherA-561903914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:35:42 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [req-49270d69-b4a6-4d01-90dd-f01dbdef951b req-fa106ff4-1ae1-49b5-8edd-e5231d677c39 tempest-ServerActionsTestOtherA-561903914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:35:42 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [req-49270d69-b4a6-4d01-90dd-f01dbdef951b req-fa106ff4-1ae1-49b5-8edd-e5231d677c39 tempest-ServerActionsTestOtherA-561903914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:35:42 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [req-49270d69-b4a6-4d01-90dd-f01dbdef951b req-fa106ff4-1ae1-49b5-8edd-e5231d677c39 tempest-ServerActionsTestOtherA-561903914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:35:42 devstack sudo[92258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:35:42 devstack sudo[92258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:35:42 devstack sudo[92256]: pam_unix(sudo:session): session closed for user root Sep 23 14:35:42 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d03777d4-26de-49ac-bd31-0343d2a860d7 tempest-ServersNegativeTestJSON-699496641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fa1a1e54-ad32-4aeb-a510-de4080f6458d" returned: 0 in 0.404s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:35:42 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-d03777d4-26de-49ac-bd31-0343d2a860d7 tempest-ServersNegativeTestJSON-699496641 None] <== create_volume: return (1255ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:35:42 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-d03777d4-26de-49ac-bd31-0343d2a860d7 tempest-ServersNegativeTestJSON-699496641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.257s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:35:42 devstack sudo[92258]: pam_unix(sudo:session): session closed for user root Sep 23 14:35:42 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [req-49270d69-b4a6-4d01-90dd-f01dbdef951b req-fa106ff4-1ae1-49b5-8edd-e5231d677c39 tempest-ServerActionsTestOtherA-561903914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.354s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:35:42 devstack cinder-volume[86310]: DEBUG cinder.manager [req-49270d69-b4a6-4d01-90dd-f01dbdef951b req-fa106ff4-1ae1-49b5-8edd-e5231d677c39 tempest-ServerActionsTestOtherA-561903914 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:35:42 devstack cinder-volume[86310]: INFO cinder.volume.manager [req-49270d69-b4a6-4d01-90dd-f01dbdef951b req-fa106ff4-1ae1-49b5-8edd-e5231d677c39 tempest-ServerActionsTestOtherA-561903914 None] Deleted volume successfully. Sep 23 14:35:42 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-d03777d4-26de-49ac-bd31-0343d2a860d7 tempest-ServersNegativeTestJSON-699496641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54f8b70a-e5a5-476d-add2-dc6bf06c1aec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa1a1e54-ad32-4aeb-a510-de4080f6458d', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:35:42 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-d03777d4-26de-49ac-bd31-0343d2a860d7 tempest-ServersNegativeTestJSON-699496641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33e6f8aa-24b4-4cac-a8cd-ba47d2bf22be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:35:42 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-d03777d4-26de-49ac-bd31-0343d2a860d7 tempest-ServersNegativeTestJSON-699496641 None] Volume volume-fa1a1e54-ad32-4aeb-a510-de4080f6458d (fa1a1e54-ad32-4aeb-a510-de4080f6458d): created successfully Sep 23 14:35:42 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-d03777d4-26de-49ac-bd31-0343d2a860d7 tempest-ServersNegativeTestJSON-699496641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33e6f8aa-24b4-4cac-a8cd-ba47d2bf22be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:35:42 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-d03777d4-26de-49ac-bd31-0343d2a860d7 tempest-ServersNegativeTestJSON-699496641 None] Flow 'volume_create_manager' (df90c37b-699a-4587-a12b-6eaf2653127e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:35:42 devstack cinder-volume[86310]: DEBUG cinder.coordination [req-49270d69-b4a6-4d01-90dd-f01dbdef951b req-fa106ff4-1ae1-49b5-8edd-e5231d677c39 tempest-ServerActionsTestOtherA-561903914 None] Lock "cinder-e00fc7f5-752b-46f5-8b34-74d62a481d73-delete_volume" released by "delete_volume" :: held 2.134s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:35:42 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-d03777d4-26de-49ac-bd31-0343d2a860d7 tempest-ServersNegativeTestJSON-699496641 None] Created volume successfully. Sep 23 14:35:43 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-1319a8f3-9a01-4876-b669-13e5140b66f9 tempest-ServerActionsTestOtherA-561903914 None] Acquiring lock "cinder-d392aec4-68f9-4e0d-b0d2-dc2355f8d2ac-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:35:43 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-1319a8f3-9a01-4876-b669-13e5140b66f9 tempest-ServerActionsTestOtherA-561903914 None] Lock "cinder-d392aec4-68f9-4e0d-b0d2-dc2355f8d2ac-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:35:43 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-1319a8f3-9a01-4876-b669-13e5140b66f9 tempest-ServerActionsTestOtherA-561903914 None] Acquiring lock "cinder-quobyte-d392aec4-68f9-4e0d-b0d2-dc2355f8d2ac" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:35:43 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-1319a8f3-9a01-4876-b669-13e5140b66f9 tempest-ServerActionsTestOtherA-561903914 None] Lock "cinder-quobyte-d392aec4-68f9-4e0d-b0d2-dc2355f8d2ac" acquired by "delete_volume" :: waited 0.030s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:35:43 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[37166fca-d219-479e-a35e-3b9f21540cf0]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:35:43 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-1319a8f3-9a01-4876-b669-13e5140b66f9 tempest-ServerActionsTestOtherA-561903914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d392aec4-68f9-4e0d-b0d2-dc2355f8d2ac {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:35:43 devstack sudo[92263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d392aec4-68f9-4e0d-b0d2-dc2355f8d2ac Sep 23 14:35:43 devstack sudo[92263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:35:43 devstack sudo[92263]: pam_unix(sudo:session): session closed for user root Sep 23 14:35:43 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-1319a8f3-9a01-4876-b669-13e5140b66f9 tempest-ServerActionsTestOtherA-561903914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d392aec4-68f9-4e0d-b0d2-dc2355f8d2ac" returned: 0 in 0.436s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:35:43 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-1319a8f3-9a01-4876-b669-13e5140b66f9 tempest-ServerActionsTestOtherA-561903914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d392aec4-68f9-4e0d-b0d2-dc2355f8d2ac {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:35:43 devstack sudo[92268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d392aec4-68f9-4e0d-b0d2-dc2355f8d2ac Sep 23 14:35:43 devstack sudo[92268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:35:44 devstack sudo[92268]: pam_unix(sudo:session): session closed for user root Sep 23 14:35:44 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-1319a8f3-9a01-4876-b669-13e5140b66f9 tempest-ServerActionsTestOtherA-561903914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d392aec4-68f9-4e0d-b0d2-dc2355f8d2ac" returned: 0 in 0.487s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:35:44 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-1319a8f3-9a01-4876-b669-13e5140b66f9 tempest-ServerActionsTestOtherA-561903914 None] Lock "cinder-quobyte-d392aec4-68f9-4e0d-b0d2-dc2355f8d2ac" released by "delete_volume" :: held 1.003s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:35:44 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-1319a8f3-9a01-4876-b669-13e5140b66f9 tempest-ServerActionsTestOtherA-561903914 None] Created reservations ['e23f9d6b-ff49-4758-8cbe-fbcbb0c01a35', 'c5c6e85c-1a44-4273-be8d-1ca1bc65cdf0', '4829a124-321e-460d-87ee-b357477af632', 'fa8b8b41-016f-4661-81a8-e18c786967f1'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:35:44 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-1319a8f3-9a01-4876-b669-13e5140b66f9 tempest-ServerActionsTestOtherA-561903914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:35:44 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-1319a8f3-9a01-4876-b669-13e5140b66f9 tempest-ServerActionsTestOtherA-561903914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:35:44 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-1319a8f3-9a01-4876-b669-13e5140b66f9 tempest-ServerActionsTestOtherA-561903914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:35:44 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-1319a8f3-9a01-4876-b669-13e5140b66f9 tempest-ServerActionsTestOtherA-561903914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:35:44 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-1319a8f3-9a01-4876-b669-13e5140b66f9 tempest-ServerActionsTestOtherA-561903914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:35:44 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-1319a8f3-9a01-4876-b669-13e5140b66f9 tempest-ServerActionsTestOtherA-561903914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:35:44 devstack sudo[92309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:35:44 devstack sudo[92309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:35:45 devstack sudo[92309]: pam_unix(sudo:session): session closed for user root Sep 23 14:35:45 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-1319a8f3-9a01-4876-b669-13e5140b66f9 tempest-ServerActionsTestOtherA-561903914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.585s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:35:45 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-1319a8f3-9a01-4876-b669-13e5140b66f9 tempest-ServerActionsTestOtherA-561903914 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:35:45 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-1319a8f3-9a01-4876-b669-13e5140b66f9 tempest-ServerActionsTestOtherA-561903914 None] Deleted volume successfully. Sep 23 14:35:45 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-1319a8f3-9a01-4876-b669-13e5140b66f9 tempest-ServerActionsTestOtherA-561903914 None] Lock "cinder-d392aec4-68f9-4e0d-b0d2-dc2355f8d2ac-delete_volume" released by "delete_volume" :: held 1.952s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:35:45 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-32327614-a537-4ba1-a28f-c9125d57bd7d tempest-ServersNegativeTestJSON-699496641 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:35:45 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-32327614-a537-4ba1-a28f-c9125d57bd7d tempest-ServersNegativeTestJSON-699496641 None] Flow 'volume_create_manager' (4b8c7c0f-1435-481f-9eb8-176929c859ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:35:45 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-32327614-a537-4ba1-a28f-c9125d57bd7d tempest-ServersNegativeTestJSON-699496641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74feccf0-ca5a-4acc-99af-982f0282b991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:35:45 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-32327614-a537-4ba1-a28f-c9125d57bd7d tempest-ServersNegativeTestJSON-699496641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74feccf0-ca5a-4acc-99af-982f0282b991) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:35:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-415497386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=227d6ffb-96e0-4b3a-8f77-87d26ff83634,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21b36bc21df3483fb1a630704251e990',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:35:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:35:46Z,use_quota=True,user_id='b5d3aa64ac924857a347114584fca708',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:35:45 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-32327614-a537-4ba1-a28f-c9125d57bd7d tempest-ServersNegativeTestJSON-699496641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8db25cb-627e-43fc-99f0-2c38607c6450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:35:45 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-32327614-a537-4ba1-a28f-c9125d57bd7d tempest-ServersNegativeTestJSON-699496641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8db25cb-627e-43fc-99f0-2c38607c6450) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:35:45 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-32327614-a537-4ba1-a28f-c9125d57bd7d tempest-ServersNegativeTestJSON-699496641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1554c503-8ecc-414d-accc-e397c1a2112f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:35:45 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-32327614-a537-4ba1-a28f-c9125d57bd7d tempest-ServersNegativeTestJSON-699496641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1554c503-8ecc-414d-accc-e397c1a2112f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '227d6ffb-96e0-4b3a-8f77-87d26ff83634', 'volume_name': 'volume-227d6ffb-96e0-4b3a-8f77-87d26ff83634', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:35:45 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-32327614-a537-4ba1-a28f-c9125d57bd7d tempest-ServersNegativeTestJSON-699496641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a71f2c4-9894-4944-b662-697efc0de1a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:35:45 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-32327614-a537-4ba1-a28f-c9125d57bd7d tempest-ServersNegativeTestJSON-699496641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a71f2c4-9894-4944-b662-697efc0de1a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:35:45 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-32327614-a537-4ba1-a28f-c9125d57bd7d tempest-ServersNegativeTestJSON-699496641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e904092d-8ffb-4cc9-ac7c-82d348d1f4e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:35:45 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-32327614-a537-4ba1-a28f-c9125d57bd7d tempest-ServersNegativeTestJSON-699496641 None] Volume 227d6ffb-96e0-4b3a-8f77-87d26ff83634: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-227d6ffb-96e0-4b3a-8f77-87d26ff83634', 'volume_size': 1} Sep 23 14:35:45 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-32327614-a537-4ba1-a28f-c9125d57bd7d tempest-ServersNegativeTestJSON-699496641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:35:45 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-32327614-a537-4ba1-a28f-c9125d57bd7d tempest-ServersNegativeTestJSON-699496641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:35:45 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-32327614-a537-4ba1-a28f-c9125d57bd7d tempest-ServersNegativeTestJSON-699496641 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:35:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-415497386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=227d6ffb-96e0-4b3a-8f77-87d26ff83634,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21b36bc21df3483fb1a630704251e990',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:35:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:35:46Z,use_quota=True,user_id='b5d3aa64ac924857a347114584fca708',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:35:45 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-32327614-a537-4ba1-a28f-c9125d57bd7d tempest-ServersNegativeTestJSON-699496641 None] Creating volume 227d6ffb-96e0-4b3a-8f77-87d26ff83634 {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:35:45 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-32327614-a537-4ba1-a28f-c9125d57bd7d tempest-ServersNegativeTestJSON-699496641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:35:45 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-32327614-a537-4ba1-a28f-c9125d57bd7d tempest-ServersNegativeTestJSON-699496641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:35:45 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-32327614-a537-4ba1-a28f-c9125d57bd7d tempest-ServersNegativeTestJSON-699496641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:35:45 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-32327614-a537-4ba1-a28f-c9125d57bd7d tempest-ServersNegativeTestJSON-699496641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:35:45 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-32327614-a537-4ba1-a28f-c9125d57bd7d tempest-ServersNegativeTestJSON-699496641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:35:45 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-32327614-a537-4ba1-a28f-c9125d57bd7d tempest-ServersNegativeTestJSON-699496641 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:35:45 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-32327614-a537-4ba1-a28f-c9125d57bd7d tempest-ServersNegativeTestJSON-699496641 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:35:45 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-32327614-a537-4ba1-a28f-c9125d57bd7d tempest-ServersNegativeTestJSON-699496641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-227d6ffb-96e0-4b3a-8f77-87d26ff83634 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:35:45 devstack sudo[92356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-227d6ffb-96e0-4b3a-8f77-87d26ff83634 1073741824 Sep 23 14:35:45 devstack sudo[92356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:35:46 devstack sudo[92356]: pam_unix(sudo:session): session closed for user root Sep 23 14:35:46 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-32327614-a537-4ba1-a28f-c9125d57bd7d tempest-ServersNegativeTestJSON-699496641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-227d6ffb-96e0-4b3a-8f77-87d26ff83634 1073741824" returned: 0 in 1.029s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:35:46 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-32327614-a537-4ba1-a28f-c9125d57bd7d tempest-ServersNegativeTestJSON-699496641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-227d6ffb-96e0-4b3a-8f77-87d26ff83634 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:35:47 devstack sudo[92386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-227d6ffb-96e0-4b3a-8f77-87d26ff83634 Sep 23 14:35:47 devstack sudo[92386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:35:47 devstack sudo[92386]: pam_unix(sudo:session): session closed for user root Sep 23 14:35:47 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-32327614-a537-4ba1-a28f-c9125d57bd7d tempest-ServersNegativeTestJSON-699496641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-227d6ffb-96e0-4b3a-8f77-87d26ff83634" returned: 0 in 0.318s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:35:47 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-32327614-a537-4ba1-a28f-c9125d57bd7d tempest-ServersNegativeTestJSON-699496641 None] <== create_volume: return (1417ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:35:47 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-32327614-a537-4ba1-a28f-c9125d57bd7d tempest-ServersNegativeTestJSON-699496641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.421s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:35:47 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-32327614-a537-4ba1-a28f-c9125d57bd7d tempest-ServersNegativeTestJSON-699496641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e904092d-8ffb-4cc9-ac7c-82d348d1f4e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-227d6ffb-96e0-4b3a-8f77-87d26ff83634', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:35:47 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-32327614-a537-4ba1-a28f-c9125d57bd7d tempest-ServersNegativeTestJSON-699496641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9517e17a-e005-4fe0-9fa8-02dc67888044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:35:47 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-32327614-a537-4ba1-a28f-c9125d57bd7d tempest-ServersNegativeTestJSON-699496641 None] Volume volume-227d6ffb-96e0-4b3a-8f77-87d26ff83634 (227d6ffb-96e0-4b3a-8f77-87d26ff83634): created successfully Sep 23 14:35:47 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-32327614-a537-4ba1-a28f-c9125d57bd7d tempest-ServersNegativeTestJSON-699496641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9517e17a-e005-4fe0-9fa8-02dc67888044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:35:47 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-32327614-a537-4ba1-a28f-c9125d57bd7d tempest-ServersNegativeTestJSON-699496641 None] Flow 'volume_create_manager' (4b8c7c0f-1435-481f-9eb8-176929c859ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:35:47 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-32327614-a537-4ba1-a28f-c9125d57bd7d tempest-ServersNegativeTestJSON-699496641 None] Created volume successfully. Sep 23 14:35:49 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-cf6668a3-e95a-4321-a4e3-0e7c4a1a633c tempest-ServersNegativeTestJSON-699496641 None] Acquiring lock "cinder-227d6ffb-96e0-4b3a-8f77-87d26ff83634-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:35:49 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-cf6668a3-e95a-4321-a4e3-0e7c4a1a633c tempest-ServersNegativeTestJSON-699496641 None] Lock "cinder-227d6ffb-96e0-4b3a-8f77-87d26ff83634-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:35:49 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-cf6668a3-e95a-4321-a4e3-0e7c4a1a633c tempest-ServersNegativeTestJSON-699496641 None] Acquiring lock "cinder-quobyte-227d6ffb-96e0-4b3a-8f77-87d26ff83634" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:35:49 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-cf6668a3-e95a-4321-a4e3-0e7c4a1a633c tempest-ServersNegativeTestJSON-699496641 None] Lock "cinder-quobyte-227d6ffb-96e0-4b3a-8f77-87d26ff83634" acquired by "delete_volume" :: waited 0.027s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:35:49 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[3155288f-28a4-4c21-82b5-9b369867fb74]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:35:49 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-cf6668a3-e95a-4321-a4e3-0e7c4a1a633c tempest-ServersNegativeTestJSON-699496641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-227d6ffb-96e0-4b3a-8f77-87d26ff83634 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:35:49 devstack sudo[92393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-227d6ffb-96e0-4b3a-8f77-87d26ff83634 Sep 23 14:35:49 devstack sudo[92393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:35:49 devstack sudo[92393]: pam_unix(sudo:session): session closed for user root Sep 23 14:35:49 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-cf6668a3-e95a-4321-a4e3-0e7c4a1a633c tempest-ServersNegativeTestJSON-699496641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-227d6ffb-96e0-4b3a-8f77-87d26ff83634" returned: 0 in 0.455s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:35:49 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-cf6668a3-e95a-4321-a4e3-0e7c4a1a633c tempest-ServersNegativeTestJSON-699496641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-227d6ffb-96e0-4b3a-8f77-87d26ff83634 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:35:49 devstack sudo[92400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-227d6ffb-96e0-4b3a-8f77-87d26ff83634 Sep 23 14:35:49 devstack sudo[92400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:35:50 devstack sudo[92400]: pam_unix(sudo:session): session closed for user root Sep 23 14:35:50 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-cf6668a3-e95a-4321-a4e3-0e7c4a1a633c tempest-ServersNegativeTestJSON-699496641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-227d6ffb-96e0-4b3a-8f77-87d26ff83634" returned: 0 in 0.265s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:35:50 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-cf6668a3-e95a-4321-a4e3-0e7c4a1a633c tempest-ServersNegativeTestJSON-699496641 None] Lock "cinder-quobyte-227d6ffb-96e0-4b3a-8f77-87d26ff83634" released by "delete_volume" :: held 0.784s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:35:50 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-cf6668a3-e95a-4321-a4e3-0e7c4a1a633c tempest-ServersNegativeTestJSON-699496641 None] Created reservations ['4512fd6e-2149-4ecb-ad8b-9c0c9c590e3d', 'adbf3dd0-e813-4f18-a678-26ece1b20da5', '0b82a243-6395-4b74-bcd2-0c3c513d3967', '50630320-d5de-4c75-87f4-8c956a89d569'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:35:50 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-cf6668a3-e95a-4321-a4e3-0e7c4a1a633c tempest-ServersNegativeTestJSON-699496641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:35:50 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-cf6668a3-e95a-4321-a4e3-0e7c4a1a633c tempest-ServersNegativeTestJSON-699496641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:35:50 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-cf6668a3-e95a-4321-a4e3-0e7c4a1a633c tempest-ServersNegativeTestJSON-699496641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:35:50 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-cf6668a3-e95a-4321-a4e3-0e7c4a1a633c tempest-ServersNegativeTestJSON-699496641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:35:50 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-cf6668a3-e95a-4321-a4e3-0e7c4a1a633c tempest-ServersNegativeTestJSON-699496641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:35:50 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-cf6668a3-e95a-4321-a4e3-0e7c4a1a633c tempest-ServersNegativeTestJSON-699496641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:35:50 devstack sudo[92403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:35:50 devstack sudo[92403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:35:50 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-d5757a15-4c9a-40d7-a70d-3d800d65fd0e tempest-ServersNegativeTestJSON-699496641 None] Acquiring lock "cinder-fa1a1e54-ad32-4aeb-a510-de4080f6458d-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:35:50 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-d5757a15-4c9a-40d7-a70d-3d800d65fd0e tempest-ServersNegativeTestJSON-699496641 None] Lock "cinder-fa1a1e54-ad32-4aeb-a510-de4080f6458d-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:35:50 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-d5757a15-4c9a-40d7-a70d-3d800d65fd0e tempest-ServersNegativeTestJSON-699496641 None] Acquiring lock "cinder-quobyte-fa1a1e54-ad32-4aeb-a510-de4080f6458d" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:35:50 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-d5757a15-4c9a-40d7-a70d-3d800d65fd0e tempest-ServersNegativeTestJSON-699496641 None] Lock "cinder-quobyte-fa1a1e54-ad32-4aeb-a510-de4080f6458d" acquired by "delete_volume" :: waited 0.040s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:35:50 devstack sudo[92403]: pam_unix(sudo:session): session closed for user root Sep 23 14:35:50 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[882b719b-674a-4a48-9979-99a1c5f95a1c]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:35:50 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d5757a15-4c9a-40d7-a70d-3d800d65fd0e tempest-ServersNegativeTestJSON-699496641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fa1a1e54-ad32-4aeb-a510-de4080f6458d {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:35:50 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-cf6668a3-e95a-4321-a4e3-0e7c4a1a633c tempest-ServersNegativeTestJSON-699496641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.443s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:35:50 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-cf6668a3-e95a-4321-a4e3-0e7c4a1a633c tempest-ServersNegativeTestJSON-699496641 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:35:50 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-cf6668a3-e95a-4321-a4e3-0e7c4a1a633c tempest-ServersNegativeTestJSON-699496641 None] Deleted volume successfully. Sep 23 14:35:50 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-cf6668a3-e95a-4321-a4e3-0e7c4a1a633c tempest-ServersNegativeTestJSON-699496641 None] Lock "cinder-227d6ffb-96e0-4b3a-8f77-87d26ff83634-delete_volume" released by "delete_volume" :: held 1.529s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:35:50 devstack sudo[92406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fa1a1e54-ad32-4aeb-a510-de4080f6458d Sep 23 14:35:50 devstack sudo[92406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:35:51 devstack sudo[92406]: pam_unix(sudo:session): session closed for user root Sep 23 14:35:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d5757a15-4c9a-40d7-a70d-3d800d65fd0e tempest-ServersNegativeTestJSON-699496641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fa1a1e54-ad32-4aeb-a510-de4080f6458d" returned: 0 in 0.534s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:35:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d5757a15-4c9a-40d7-a70d-3d800d65fd0e tempest-ServersNegativeTestJSON-699496641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fa1a1e54-ad32-4aeb-a510-de4080f6458d {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:35:51 devstack sudo[92411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fa1a1e54-ad32-4aeb-a510-de4080f6458d Sep 23 14:35:51 devstack sudo[92411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:35:51 devstack cinder-volume[86310]: DEBUG oslo_service.periodic_task [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86310) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 14:35:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:35:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:35:51 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:35:51 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:35:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:35:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:35:51 devstack sudo[92413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:35:51 devstack sudo[92413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:35:51 devstack sudo[92411]: pam_unix(sudo:session): session closed for user root Sep 23 14:35:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d5757a15-4c9a-40d7-a70d-3d800d65fd0e tempest-ServersNegativeTestJSON-699496641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fa1a1e54-ad32-4aeb-a510-de4080f6458d" returned: 0 in 0.561s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:35:51 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-d5757a15-4c9a-40d7-a70d-3d800d65fd0e tempest-ServersNegativeTestJSON-699496641 None] Lock "cinder-quobyte-fa1a1e54-ad32-4aeb-a510-de4080f6458d" released by "delete_volume" :: held 1.185s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:35:51 devstack sudo[92413]: pam_unix(sudo:session): session closed for user root Sep 23 14:35:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.524s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:35:51 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:35:51 devstack cinder-volume[86310]: DEBUG oslo_service.periodic_task [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Running periodic task VolumeManager._thread_info {{(pid=86310) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 14:35:51 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] thread count: 28 {{(pid=86310) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 14:35:51 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] thread info: [<_MainThread(MainThread, started 128854208852096)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86310) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 14:35:51 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-d5757a15-4c9a-40d7-a70d-3d800d65fd0e tempest-ServersNegativeTestJSON-699496641 None] Created reservations ['464f2fa7-3e70-4b6c-be87-1f42e90b3375', '7ae7971d-c102-491f-a93e-40b525b50481', '19bfe552-9be9-4972-94dc-4827b5f91a02', 'b37bb976-782a-4b65-9104-f6a06ae93b0a'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:35:52 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-d5757a15-4c9a-40d7-a70d-3d800d65fd0e tempest-ServersNegativeTestJSON-699496641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:35:52 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-d5757a15-4c9a-40d7-a70d-3d800d65fd0e tempest-ServersNegativeTestJSON-699496641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:35:52 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-d5757a15-4c9a-40d7-a70d-3d800d65fd0e tempest-ServersNegativeTestJSON-699496641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:35:52 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-d5757a15-4c9a-40d7-a70d-3d800d65fd0e tempest-ServersNegativeTestJSON-699496641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:35:52 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-d5757a15-4c9a-40d7-a70d-3d800d65fd0e tempest-ServersNegativeTestJSON-699496641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:35:52 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d5757a15-4c9a-40d7-a70d-3d800d65fd0e tempest-ServersNegativeTestJSON-699496641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:35:52 devstack sudo[92418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:35:52 devstack sudo[92418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:35:52 devstack sudo[92418]: pam_unix(sudo:session): session closed for user root Sep 23 14:35:52 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d5757a15-4c9a-40d7-a70d-3d800d65fd0e tempest-ServersNegativeTestJSON-699496641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.327s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:35:52 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-d5757a15-4c9a-40d7-a70d-3d800d65fd0e tempest-ServersNegativeTestJSON-699496641 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:35:52 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-d5757a15-4c9a-40d7-a70d-3d800d65fd0e tempest-ServersNegativeTestJSON-699496641 None] Deleted volume successfully. Sep 23 14:35:52 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-d5757a15-4c9a-40d7-a70d-3d800d65fd0e tempest-ServersNegativeTestJSON-699496641 None] Lock "cinder-fa1a1e54-ad32-4aeb-a510-de4080f6458d-delete_volume" released by "delete_volume" :: held 1.924s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:35:59 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-0b33e516-397a-40bb-842a-52caa094e345 tempest-AttachVolumeShelveTestJSON-422359333 None] Acquiring lock "cinder-a61114e5-58d0-4620-9338-220104de2b7b-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:35:59 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-0b33e516-397a-40bb-842a-52caa094e345 tempest-AttachVolumeShelveTestJSON-422359333 None] Lock "cinder-a61114e5-58d0-4620-9338-220104de2b7b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:35:59 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-0b33e516-397a-40bb-842a-52caa094e345 tempest-AttachVolumeShelveTestJSON-422359333 None] Acquiring lock "cinder-quobyte-a61114e5-58d0-4620-9338-220104de2b7b" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:35:59 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-0b33e516-397a-40bb-842a-52caa094e345 tempest-AttachVolumeShelveTestJSON-422359333 None] Lock "cinder-quobyte-a61114e5-58d0-4620-9338-220104de2b7b" acquired by "delete_volume" :: waited 0.022s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:35:59 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[064f8a9b-fe59-445c-b3c5-c96de41a5f9e]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:35:59 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-0b33e516-397a-40bb-842a-52caa094e345 tempest-AttachVolumeShelveTestJSON-422359333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-a61114e5-58d0-4620-9338-220104de2b7b {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:35:59 devstack sudo[92487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-a61114e5-58d0-4620-9338-220104de2b7b Sep 23 14:35:59 devstack sudo[92487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:36:00 devstack sudo[92487]: pam_unix(sudo:session): session closed for user root Sep 23 14:36:00 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-0b33e516-397a-40bb-842a-52caa094e345 tempest-AttachVolumeShelveTestJSON-422359333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-a61114e5-58d0-4620-9338-220104de2b7b" returned: 0 in 0.474s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:36:00 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-0b33e516-397a-40bb-842a-52caa094e345 tempest-AttachVolumeShelveTestJSON-422359333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-a61114e5-58d0-4620-9338-220104de2b7b {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:36:00 devstack sudo[92493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-a61114e5-58d0-4620-9338-220104de2b7b Sep 23 14:36:00 devstack sudo[92493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:36:00 devstack sudo[92493]: pam_unix(sudo:session): session closed for user root Sep 23 14:36:00 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-0b33e516-397a-40bb-842a-52caa094e345 tempest-AttachVolumeShelveTestJSON-422359333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-a61114e5-58d0-4620-9338-220104de2b7b" returned: 0 in 0.268s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:36:00 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-0b33e516-397a-40bb-842a-52caa094e345 tempest-AttachVolumeShelveTestJSON-422359333 None] Lock "cinder-quobyte-a61114e5-58d0-4620-9338-220104de2b7b" released by "delete_volume" :: held 0.800s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:36:00 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-0b33e516-397a-40bb-842a-52caa094e345 tempest-AttachVolumeShelveTestJSON-422359333 None] Created reservations ['9b7d403f-be7b-4577-89f1-89c3599557f1', '56a068e7-d836-4d47-827f-07a6f7f2228a', '2048b451-692a-4cc4-b33a-431162086b5b', '50425bdb-48a2-4919-9378-4c5743d8c046'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:36:00 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-0b33e516-397a-40bb-842a-52caa094e345 tempest-AttachVolumeShelveTestJSON-422359333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:36:00 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-0b33e516-397a-40bb-842a-52caa094e345 tempest-AttachVolumeShelveTestJSON-422359333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:36:00 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-0b33e516-397a-40bb-842a-52caa094e345 tempest-AttachVolumeShelveTestJSON-422359333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:36:00 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-0b33e516-397a-40bb-842a-52caa094e345 tempest-AttachVolumeShelveTestJSON-422359333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:36:00 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-0b33e516-397a-40bb-842a-52caa094e345 tempest-AttachVolumeShelveTestJSON-422359333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:36:00 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-0b33e516-397a-40bb-842a-52caa094e345 tempest-AttachVolumeShelveTestJSON-422359333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:36:00 devstack sudo[92496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:36:00 devstack sudo[92496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:36:00 devstack sudo[92496]: pam_unix(sudo:session): session closed for user root Sep 23 14:36:00 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-0b33e516-397a-40bb-842a-52caa094e345 tempest-AttachVolumeShelveTestJSON-422359333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.363s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:36:00 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-0b33e516-397a-40bb-842a-52caa094e345 tempest-AttachVolumeShelveTestJSON-422359333 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:36:00 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-0b33e516-397a-40bb-842a-52caa094e345 tempest-AttachVolumeShelveTestJSON-422359333 None] Deleted volume successfully. Sep 23 14:36:00 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-0b33e516-397a-40bb-842a-52caa094e345 tempest-AttachVolumeShelveTestJSON-422359333 None] Lock "cinder-a61114e5-58d0-4620-9338-220104de2b7b-delete_volume" released by "delete_volume" :: held 1.423s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:36:02 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad72cad4-9b12-4df7-90bf-ff9113efdf1d tempest-VolumesTestJSON-1667670565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:36:02 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-ad72cad4-9b12-4df7-90bf-ff9113efdf1d tempest-VolumesTestJSON-1667670565 None] Flow 'volume_create_manager' (59a02ad1-e35a-4deb-ae1c-458ca6e34bd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:36:02 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-ad72cad4-9b12-4df7-90bf-ff9113efdf1d tempest-VolumesTestJSON-1667670565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f53af8fd-cecf-4e0c-9f99-158056f6169b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:36:02 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-ad72cad4-9b12-4df7-90bf-ff9113efdf1d tempest-VolumesTestJSON-1667670565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f53af8fd-cecf-4e0c-9f99-158056f6169b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:36:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-665382323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=253b1892-95d7-46be-9ba3-be28dffa8ca3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6f8260c6082b430cae85039431bfd393',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:36:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:36:02Z,use_quota=True,user_id='2a04f84b48934407949d4bba140a36b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:36:02 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-ad72cad4-9b12-4df7-90bf-ff9113efdf1d tempest-VolumesTestJSON-1667670565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1480e1a8-549a-40bd-be7b-4b808a29548b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:36:02 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-ad72cad4-9b12-4df7-90bf-ff9113efdf1d tempest-VolumesTestJSON-1667670565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1480e1a8-549a-40bd-be7b-4b808a29548b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:36:02 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-ad72cad4-9b12-4df7-90bf-ff9113efdf1d tempest-VolumesTestJSON-1667670565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70ea9e32-1364-4383-afc1-19935266c4bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:36:02 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-ad72cad4-9b12-4df7-90bf-ff9113efdf1d tempest-VolumesTestJSON-1667670565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70ea9e32-1364-4383-afc1-19935266c4bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '253b1892-95d7-46be-9ba3-be28dffa8ca3', 'volume_name': 'volume-253b1892-95d7-46be-9ba3-be28dffa8ca3', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:36:02 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-ad72cad4-9b12-4df7-90bf-ff9113efdf1d tempest-VolumesTestJSON-1667670565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee53753c-24c8-42e4-b329-05103cbae25b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:36:02 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-ad72cad4-9b12-4df7-90bf-ff9113efdf1d tempest-VolumesTestJSON-1667670565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee53753c-24c8-42e4-b329-05103cbae25b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:36:02 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-ad72cad4-9b12-4df7-90bf-ff9113efdf1d tempest-VolumesTestJSON-1667670565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (743beae0-0510-410f-bbeb-f3c46845b6ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:36:02 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-ad72cad4-9b12-4df7-90bf-ff9113efdf1d tempest-VolumesTestJSON-1667670565 None] Volume 253b1892-95d7-46be-9ba3-be28dffa8ca3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-253b1892-95d7-46be-9ba3-be28dffa8ca3', 'volume_size': 1} Sep 23 14:36:02 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-ad72cad4-9b12-4df7-90bf-ff9113efdf1d tempest-VolumesTestJSON-1667670565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:36:02 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-ad72cad4-9b12-4df7-90bf-ff9113efdf1d tempest-VolumesTestJSON-1667670565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:36:02 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-ad72cad4-9b12-4df7-90bf-ff9113efdf1d tempest-VolumesTestJSON-1667670565 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:36:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-665382323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=253b1892-95d7-46be-9ba3-be28dffa8ca3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6f8260c6082b430cae85039431bfd393',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:36:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:36:02Z,use_quota=True,user_id='2a04f84b48934407949d4bba140a36b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:36:02 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-ad72cad4-9b12-4df7-90bf-ff9113efdf1d tempest-VolumesTestJSON-1667670565 None] Creating volume 253b1892-95d7-46be-9ba3-be28dffa8ca3 {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:36:02 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-ad72cad4-9b12-4df7-90bf-ff9113efdf1d tempest-VolumesTestJSON-1667670565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:36:02 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-ad72cad4-9b12-4df7-90bf-ff9113efdf1d tempest-VolumesTestJSON-1667670565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:36:02 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-ad72cad4-9b12-4df7-90bf-ff9113efdf1d tempest-VolumesTestJSON-1667670565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:36:02 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-ad72cad4-9b12-4df7-90bf-ff9113efdf1d tempest-VolumesTestJSON-1667670565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:36:02 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-ad72cad4-9b12-4df7-90bf-ff9113efdf1d tempest-VolumesTestJSON-1667670565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:36:02 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-ad72cad4-9b12-4df7-90bf-ff9113efdf1d tempest-VolumesTestJSON-1667670565 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:36:02 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-ad72cad4-9b12-4df7-90bf-ff9113efdf1d tempest-VolumesTestJSON-1667670565 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:36:02 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ad72cad4-9b12-4df7-90bf-ff9113efdf1d tempest-VolumesTestJSON-1667670565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-253b1892-95d7-46be-9ba3-be28dffa8ca3 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:36:02 devstack sudo[92501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-253b1892-95d7-46be-9ba3-be28dffa8ca3 1073741824 Sep 23 14:36:02 devstack sudo[92501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:36:03 devstack sudo[92501]: pam_unix(sudo:session): session closed for user root Sep 23 14:36:03 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ad72cad4-9b12-4df7-90bf-ff9113efdf1d tempest-VolumesTestJSON-1667670565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-253b1892-95d7-46be-9ba3-be28dffa8ca3 1073741824" returned: 0 in 0.501s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:36:03 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ad72cad4-9b12-4df7-90bf-ff9113efdf1d tempest-VolumesTestJSON-1667670565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-253b1892-95d7-46be-9ba3-be28dffa8ca3 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:36:03 devstack sudo[92508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-253b1892-95d7-46be-9ba3-be28dffa8ca3 Sep 23 14:36:03 devstack sudo[92508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:36:03 devstack sudo[92508]: pam_unix(sudo:session): session closed for user root Sep 23 14:36:03 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ad72cad4-9b12-4df7-90bf-ff9113efdf1d tempest-VolumesTestJSON-1667670565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-253b1892-95d7-46be-9ba3-be28dffa8ca3" returned: 0 in 0.285s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:36:03 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-ad72cad4-9b12-4df7-90bf-ff9113efdf1d tempest-VolumesTestJSON-1667670565 None] <== create_volume: return (842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:36:03 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-ad72cad4-9b12-4df7-90bf-ff9113efdf1d tempest-VolumesTestJSON-1667670565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.845s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:36:03 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-ad72cad4-9b12-4df7-90bf-ff9113efdf1d tempest-VolumesTestJSON-1667670565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (743beae0-0510-410f-bbeb-f3c46845b6ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-253b1892-95d7-46be-9ba3-be28dffa8ca3', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:36:03 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-ad72cad4-9b12-4df7-90bf-ff9113efdf1d tempest-VolumesTestJSON-1667670565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b59ffaf-54b2-4d26-a2e2-2da88ce1d810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:36:03 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-ad72cad4-9b12-4df7-90bf-ff9113efdf1d tempest-VolumesTestJSON-1667670565 None] Volume volume-253b1892-95d7-46be-9ba3-be28dffa8ca3 (253b1892-95d7-46be-9ba3-be28dffa8ca3): created successfully Sep 23 14:36:03 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-ad72cad4-9b12-4df7-90bf-ff9113efdf1d tempest-VolumesTestJSON-1667670565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b59ffaf-54b2-4d26-a2e2-2da88ce1d810) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:36:03 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-ad72cad4-9b12-4df7-90bf-ff9113efdf1d tempest-VolumesTestJSON-1667670565 None] Flow 'volume_create_manager' (59a02ad1-e35a-4deb-ae1c-458ca6e34bd2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:36:03 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-ad72cad4-9b12-4df7-90bf-ff9113efdf1d tempest-VolumesTestJSON-1667670565 None] Created volume successfully. Sep 23 14:36:05 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-83c95eda-727a-41e2-b8ed-54408b9619a7 tempest-VolumesTestJSON-1667670565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:36:05 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-83c95eda-727a-41e2-b8ed-54408b9619a7 tempest-VolumesTestJSON-1667670565 None] Flow 'volume_create_manager' (255124f9-a034-4f03-bb6c-e05c49eeb9a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:36:05 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-83c95eda-727a-41e2-b8ed-54408b9619a7 tempest-VolumesTestJSON-1667670565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (395c4b4d-40a4-4632-9d05-582abbb5bff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:36:05 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-83c95eda-727a-41e2-b8ed-54408b9619a7 tempest-VolumesTestJSON-1667670565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (395c4b4d-40a4-4632-9d05-582abbb5bff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:36:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1841398197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=994ed0e5-df22-4ba2-94f4-8729adf1cbf8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6f8260c6082b430cae85039431bfd393',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:36:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:36:06Z,use_quota=True,user_id='2a04f84b48934407949d4bba140a36b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:36:05 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-83c95eda-727a-41e2-b8ed-54408b9619a7 tempest-VolumesTestJSON-1667670565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db397463-d670-4682-930a-3676508a5412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:36:05 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-83c95eda-727a-41e2-b8ed-54408b9619a7 tempest-VolumesTestJSON-1667670565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db397463-d670-4682-930a-3676508a5412) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:36:05 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-83c95eda-727a-41e2-b8ed-54408b9619a7 tempest-VolumesTestJSON-1667670565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbd0ef73-4250-4aee-bfb8-40a7315b6a98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:36:05 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-83c95eda-727a-41e2-b8ed-54408b9619a7 tempest-VolumesTestJSON-1667670565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbd0ef73-4250-4aee-bfb8-40a7315b6a98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '994ed0e5-df22-4ba2-94f4-8729adf1cbf8', 'volume_name': 'volume-994ed0e5-df22-4ba2-94f4-8729adf1cbf8', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:36:05 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-83c95eda-727a-41e2-b8ed-54408b9619a7 tempest-VolumesTestJSON-1667670565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac26a4c6-e04a-4d4c-83e3-aa4c7f067efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:36:05 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-83c95eda-727a-41e2-b8ed-54408b9619a7 tempest-VolumesTestJSON-1667670565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac26a4c6-e04a-4d4c-83e3-aa4c7f067efa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:36:05 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-83c95eda-727a-41e2-b8ed-54408b9619a7 tempest-VolumesTestJSON-1667670565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0179796-b4a9-4202-8a6b-5bafd099de21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:36:05 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-83c95eda-727a-41e2-b8ed-54408b9619a7 tempest-VolumesTestJSON-1667670565 None] Volume 994ed0e5-df22-4ba2-94f4-8729adf1cbf8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-994ed0e5-df22-4ba2-94f4-8729adf1cbf8', 'volume_size': 1} Sep 23 14:36:05 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-83c95eda-727a-41e2-b8ed-54408b9619a7 tempest-VolumesTestJSON-1667670565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:36:05 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-83c95eda-727a-41e2-b8ed-54408b9619a7 tempest-VolumesTestJSON-1667670565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:36:05 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-83c95eda-727a-41e2-b8ed-54408b9619a7 tempest-VolumesTestJSON-1667670565 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:36:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1841398197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=994ed0e5-df22-4ba2-94f4-8729adf1cbf8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6f8260c6082b430cae85039431bfd393',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:36:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:36:06Z,use_quota=True,user_id='2a04f84b48934407949d4bba140a36b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:36:05 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-83c95eda-727a-41e2-b8ed-54408b9619a7 tempest-VolumesTestJSON-1667670565 None] Creating volume 994ed0e5-df22-4ba2-94f4-8729adf1cbf8 {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:36:05 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-83c95eda-727a-41e2-b8ed-54408b9619a7 tempest-VolumesTestJSON-1667670565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:36:05 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-83c95eda-727a-41e2-b8ed-54408b9619a7 tempest-VolumesTestJSON-1667670565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:36:05 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-83c95eda-727a-41e2-b8ed-54408b9619a7 tempest-VolumesTestJSON-1667670565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:36:05 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-83c95eda-727a-41e2-b8ed-54408b9619a7 tempest-VolumesTestJSON-1667670565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:36:05 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-83c95eda-727a-41e2-b8ed-54408b9619a7 tempest-VolumesTestJSON-1667670565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:36:05 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-83c95eda-727a-41e2-b8ed-54408b9619a7 tempest-VolumesTestJSON-1667670565 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:36:05 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-83c95eda-727a-41e2-b8ed-54408b9619a7 tempest-VolumesTestJSON-1667670565 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:36:05 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-83c95eda-727a-41e2-b8ed-54408b9619a7 tempest-VolumesTestJSON-1667670565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-994ed0e5-df22-4ba2-94f4-8729adf1cbf8 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:36:05 devstack sudo[92511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-994ed0e5-df22-4ba2-94f4-8729adf1cbf8 1073741824 Sep 23 14:36:05 devstack sudo[92511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:36:06 devstack sudo[92511]: pam_unix(sudo:session): session closed for user root Sep 23 14:36:06 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-83c95eda-727a-41e2-b8ed-54408b9619a7 tempest-VolumesTestJSON-1667670565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-994ed0e5-df22-4ba2-94f4-8729adf1cbf8 1073741824" returned: 0 in 0.576s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:36:06 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-83c95eda-727a-41e2-b8ed-54408b9619a7 tempest-VolumesTestJSON-1667670565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-994ed0e5-df22-4ba2-94f4-8729adf1cbf8 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:36:06 devstack sudo[92518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-994ed0e5-df22-4ba2-94f4-8729adf1cbf8 Sep 23 14:36:06 devstack sudo[92518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:36:06 devstack sudo[92518]: pam_unix(sudo:session): session closed for user root Sep 23 14:36:06 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-83c95eda-727a-41e2-b8ed-54408b9619a7 tempest-VolumesTestJSON-1667670565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-994ed0e5-df22-4ba2-94f4-8729adf1cbf8" returned: 0 in 0.433s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:36:06 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-83c95eda-727a-41e2-b8ed-54408b9619a7 tempest-VolumesTestJSON-1667670565 None] <== create_volume: return (1093ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:36:06 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-83c95eda-727a-41e2-b8ed-54408b9619a7 tempest-VolumesTestJSON-1667670565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.096s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:36:06 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-83c95eda-727a-41e2-b8ed-54408b9619a7 tempest-VolumesTestJSON-1667670565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0179796-b4a9-4202-8a6b-5bafd099de21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-994ed0e5-df22-4ba2-94f4-8729adf1cbf8', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:36:06 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-83c95eda-727a-41e2-b8ed-54408b9619a7 tempest-VolumesTestJSON-1667670565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e557f8e-9016-442b-badb-490f0fc752ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:36:06 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-83c95eda-727a-41e2-b8ed-54408b9619a7 tempest-VolumesTestJSON-1667670565 None] Volume volume-994ed0e5-df22-4ba2-94f4-8729adf1cbf8 (994ed0e5-df22-4ba2-94f4-8729adf1cbf8): created successfully Sep 23 14:36:06 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-83c95eda-727a-41e2-b8ed-54408b9619a7 tempest-VolumesTestJSON-1667670565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e557f8e-9016-442b-badb-490f0fc752ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:36:06 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-83c95eda-727a-41e2-b8ed-54408b9619a7 tempest-VolumesTestJSON-1667670565 None] Flow 'volume_create_manager' (255124f9-a034-4f03-bb6c-e05c49eeb9a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:36:07 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-83c95eda-727a-41e2-b8ed-54408b9619a7 tempest-VolumesTestJSON-1667670565 None] Created volume successfully. Sep 23 14:36:08 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-244b77c4-274b-420f-934b-aa9525a380ff tempest-VolumesTestJSON-1667670565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:36:08 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-244b77c4-274b-420f-934b-aa9525a380ff tempest-VolumesTestJSON-1667670565 None] Flow 'volume_create_manager' (86144b4e-4d3a-4829-8432-917e5b0fff97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:36:08 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-244b77c4-274b-420f-934b-aa9525a380ff tempest-VolumesTestJSON-1667670565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de69e083-ffa9-442a-972f-38e90ec114ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:36:08 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-244b77c4-274b-420f-934b-aa9525a380ff tempest-VolumesTestJSON-1667670565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de69e083-ffa9-442a-972f-38e90ec114ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:36:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2022264904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1117d6b-8ae4-4b6d-8164-1a53dac2938a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6f8260c6082b430cae85039431bfd393',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:36:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:36:08Z,use_quota=True,user_id='2a04f84b48934407949d4bba140a36b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:36:08 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-244b77c4-274b-420f-934b-aa9525a380ff tempest-VolumesTestJSON-1667670565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (212ea12d-45ad-4761-b5ff-38ad123350f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:36:08 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-244b77c4-274b-420f-934b-aa9525a380ff tempest-VolumesTestJSON-1667670565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (212ea12d-45ad-4761-b5ff-38ad123350f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:36:08 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-244b77c4-274b-420f-934b-aa9525a380ff tempest-VolumesTestJSON-1667670565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e084d74-7d91-44b4-9069-6f5aa5c3cd7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:36:08 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-244b77c4-274b-420f-934b-aa9525a380ff tempest-VolumesTestJSON-1667670565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e084d74-7d91-44b4-9069-6f5aa5c3cd7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1117d6b-8ae4-4b6d-8164-1a53dac2938a', 'volume_name': 'volume-d1117d6b-8ae4-4b6d-8164-1a53dac2938a', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:36:08 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-244b77c4-274b-420f-934b-aa9525a380ff tempest-VolumesTestJSON-1667670565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b86ba80-a04d-411a-aa28-a7015181e526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:36:08 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-244b77c4-274b-420f-934b-aa9525a380ff tempest-VolumesTestJSON-1667670565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b86ba80-a04d-411a-aa28-a7015181e526) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:36:08 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-244b77c4-274b-420f-934b-aa9525a380ff tempest-VolumesTestJSON-1667670565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54d48b39-1556-420f-be06-3e82a6b91804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:36:08 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-244b77c4-274b-420f-934b-aa9525a380ff tempest-VolumesTestJSON-1667670565 None] Volume d1117d6b-8ae4-4b6d-8164-1a53dac2938a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1117d6b-8ae4-4b6d-8164-1a53dac2938a', 'volume_size': 1} Sep 23 14:36:08 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-244b77c4-274b-420f-934b-aa9525a380ff tempest-VolumesTestJSON-1667670565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:36:08 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-244b77c4-274b-420f-934b-aa9525a380ff tempest-VolumesTestJSON-1667670565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:36:08 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-244b77c4-274b-420f-934b-aa9525a380ff tempest-VolumesTestJSON-1667670565 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:36:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2022264904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1117d6b-8ae4-4b6d-8164-1a53dac2938a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6f8260c6082b430cae85039431bfd393',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:36:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:36:08Z,use_quota=True,user_id='2a04f84b48934407949d4bba140a36b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:36:08 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-244b77c4-274b-420f-934b-aa9525a380ff tempest-VolumesTestJSON-1667670565 None] Creating volume d1117d6b-8ae4-4b6d-8164-1a53dac2938a {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:36:08 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-244b77c4-274b-420f-934b-aa9525a380ff tempest-VolumesTestJSON-1667670565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:36:08 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-244b77c4-274b-420f-934b-aa9525a380ff tempest-VolumesTestJSON-1667670565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:36:08 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-244b77c4-274b-420f-934b-aa9525a380ff tempest-VolumesTestJSON-1667670565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:36:08 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-244b77c4-274b-420f-934b-aa9525a380ff tempest-VolumesTestJSON-1667670565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:36:08 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-244b77c4-274b-420f-934b-aa9525a380ff tempest-VolumesTestJSON-1667670565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:36:08 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-244b77c4-274b-420f-934b-aa9525a380ff tempest-VolumesTestJSON-1667670565 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:36:08 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-244b77c4-274b-420f-934b-aa9525a380ff tempest-VolumesTestJSON-1667670565 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:36:08 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-244b77c4-274b-420f-934b-aa9525a380ff tempest-VolumesTestJSON-1667670565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d1117d6b-8ae4-4b6d-8164-1a53dac2938a 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:36:08 devstack sudo[92522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d1117d6b-8ae4-4b6d-8164-1a53dac2938a 1073741824 Sep 23 14:36:08 devstack sudo[92522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:36:09 devstack sudo[92522]: pam_unix(sudo:session): session closed for user root Sep 23 14:36:09 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-244b77c4-274b-420f-934b-aa9525a380ff tempest-VolumesTestJSON-1667670565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d1117d6b-8ae4-4b6d-8164-1a53dac2938a 1073741824" returned: 0 in 0.592s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:36:09 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-244b77c4-274b-420f-934b-aa9525a380ff tempest-VolumesTestJSON-1667670565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d1117d6b-8ae4-4b6d-8164-1a53dac2938a {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:36:09 devstack sudo[92530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d1117d6b-8ae4-4b6d-8164-1a53dac2938a Sep 23 14:36:09 devstack sudo[92530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:36:09 devstack sudo[92530]: pam_unix(sudo:session): session closed for user root Sep 23 14:36:09 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-244b77c4-274b-420f-934b-aa9525a380ff tempest-VolumesTestJSON-1667670565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d1117d6b-8ae4-4b6d-8164-1a53dac2938a" returned: 0 in 0.275s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:36:09 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-244b77c4-274b-420f-934b-aa9525a380ff tempest-VolumesTestJSON-1667670565 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:36:09 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-244b77c4-274b-420f-934b-aa9525a380ff tempest-VolumesTestJSON-1667670565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:36:09 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-244b77c4-274b-420f-934b-aa9525a380ff tempest-VolumesTestJSON-1667670565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54d48b39-1556-420f-be06-3e82a6b91804) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1117d6b-8ae4-4b6d-8164-1a53dac2938a', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:36:09 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-244b77c4-274b-420f-934b-aa9525a380ff tempest-VolumesTestJSON-1667670565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6b07b9d-54b8-41a3-bff2-80cc5798c657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:36:09 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-244b77c4-274b-420f-934b-aa9525a380ff tempest-VolumesTestJSON-1667670565 None] Volume volume-d1117d6b-8ae4-4b6d-8164-1a53dac2938a (d1117d6b-8ae4-4b6d-8164-1a53dac2938a): created successfully Sep 23 14:36:09 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-244b77c4-274b-420f-934b-aa9525a380ff tempest-VolumesTestJSON-1667670565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6b07b9d-54b8-41a3-bff2-80cc5798c657) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:36:09 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-244b77c4-274b-420f-934b-aa9525a380ff tempest-VolumesTestJSON-1667670565 None] Flow 'volume_create_manager' (86144b4e-4d3a-4829-8432-917e5b0fff97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:36:09 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-244b77c4-274b-420f-934b-aa9525a380ff tempest-VolumesTestJSON-1667670565 None] Created volume successfully. Sep 23 14:36:09 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-e05a8dde-31da-4488-aa48-051ff3e72829 tempest-AttachVolumeNegativeTest-527431328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:36:09 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-e05a8dde-31da-4488-aa48-051ff3e72829 tempest-AttachVolumeNegativeTest-527431328 None] Flow 'volume_create_manager' (896ce2af-0880-4572-9878-06d1c98447b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:36:09 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-e05a8dde-31da-4488-aa48-051ff3e72829 tempest-AttachVolumeNegativeTest-527431328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (069baf0e-6bfc-491e-a5eb-3b91989c3baa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:36:09 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-e05a8dde-31da-4488-aa48-051ff3e72829 tempest-AttachVolumeNegativeTest-527431328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (069baf0e-6bfc-491e-a5eb-3b91989c3baa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:36:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1472592773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=813dc01f-01aa-402a-93c3-629a6223aed8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1ac9a384403436f88ec793cde23db56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:36:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:36:10Z,use_quota=True,user_id='3d6e4f5983114e05b289eeced4b0beeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:36:09 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-e05a8dde-31da-4488-aa48-051ff3e72829 tempest-AttachVolumeNegativeTest-527431328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc0ff6da-4a42-429a-84b2-e90f5408f0c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:36:09 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-e05a8dde-31da-4488-aa48-051ff3e72829 tempest-AttachVolumeNegativeTest-527431328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc0ff6da-4a42-429a-84b2-e90f5408f0c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:36:09 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-e05a8dde-31da-4488-aa48-051ff3e72829 tempest-AttachVolumeNegativeTest-527431328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bed92a3-e55a-4794-9c3d-d365619c6969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:36:09 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-e05a8dde-31da-4488-aa48-051ff3e72829 tempest-AttachVolumeNegativeTest-527431328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bed92a3-e55a-4794-9c3d-d365619c6969) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '813dc01f-01aa-402a-93c3-629a6223aed8', 'volume_name': 'volume-813dc01f-01aa-402a-93c3-629a6223aed8', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:36:09 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-e05a8dde-31da-4488-aa48-051ff3e72829 tempest-AttachVolumeNegativeTest-527431328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b312bac2-46b6-4a9f-88bf-8700f3b519f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:36:09 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-e05a8dde-31da-4488-aa48-051ff3e72829 tempest-AttachVolumeNegativeTest-527431328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b312bac2-46b6-4a9f-88bf-8700f3b519f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:36:09 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-e05a8dde-31da-4488-aa48-051ff3e72829 tempest-AttachVolumeNegativeTest-527431328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2b1df96-d383-4b9a-a9c8-82618265140e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:36:09 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-e05a8dde-31da-4488-aa48-051ff3e72829 tempest-AttachVolumeNegativeTest-527431328 None] Volume 813dc01f-01aa-402a-93c3-629a6223aed8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-813dc01f-01aa-402a-93c3-629a6223aed8', 'volume_size': 1} Sep 23 14:36:09 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-e05a8dde-31da-4488-aa48-051ff3e72829 tempest-AttachVolumeNegativeTest-527431328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:36:09 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-e05a8dde-31da-4488-aa48-051ff3e72829 tempest-AttachVolumeNegativeTest-527431328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:36:09 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-e05a8dde-31da-4488-aa48-051ff3e72829 tempest-AttachVolumeNegativeTest-527431328 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:36:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1472592773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=813dc01f-01aa-402a-93c3-629a6223aed8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1ac9a384403436f88ec793cde23db56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:36:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:36:10Z,use_quota=True,user_id='3d6e4f5983114e05b289eeced4b0beeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:36:09 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-e05a8dde-31da-4488-aa48-051ff3e72829 tempest-AttachVolumeNegativeTest-527431328 None] Creating volume 813dc01f-01aa-402a-93c3-629a6223aed8 {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:36:09 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-e05a8dde-31da-4488-aa48-051ff3e72829 tempest-AttachVolumeNegativeTest-527431328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:36:09 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-e05a8dde-31da-4488-aa48-051ff3e72829 tempest-AttachVolumeNegativeTest-527431328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:36:09 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-e05a8dde-31da-4488-aa48-051ff3e72829 tempest-AttachVolumeNegativeTest-527431328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:36:09 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-e05a8dde-31da-4488-aa48-051ff3e72829 tempest-AttachVolumeNegativeTest-527431328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:36:09 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-e05a8dde-31da-4488-aa48-051ff3e72829 tempest-AttachVolumeNegativeTest-527431328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:36:09 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-e05a8dde-31da-4488-aa48-051ff3e72829 tempest-AttachVolumeNegativeTest-527431328 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:36:09 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-e05a8dde-31da-4488-aa48-051ff3e72829 tempest-AttachVolumeNegativeTest-527431328 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:36:09 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-e05a8dde-31da-4488-aa48-051ff3e72829 tempest-AttachVolumeNegativeTest-527431328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-813dc01f-01aa-402a-93c3-629a6223aed8 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:36:09 devstack sudo[92533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-813dc01f-01aa-402a-93c3-629a6223aed8 1073741824 Sep 23 14:36:09 devstack sudo[92533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:36:10 devstack sudo[92533]: pam_unix(sudo:session): session closed for user root Sep 23 14:36:10 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-e05a8dde-31da-4488-aa48-051ff3e72829 tempest-AttachVolumeNegativeTest-527431328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-813dc01f-01aa-402a-93c3-629a6223aed8 1073741824" returned: 0 in 0.562s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:36:10 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-e05a8dde-31da-4488-aa48-051ff3e72829 tempest-AttachVolumeNegativeTest-527431328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-813dc01f-01aa-402a-93c3-629a6223aed8 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:36:10 devstack sudo[92539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-813dc01f-01aa-402a-93c3-629a6223aed8 Sep 23 14:36:10 devstack sudo[92539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:36:10 devstack sudo[92539]: pam_unix(sudo:session): session closed for user root Sep 23 14:36:10 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-e05a8dde-31da-4488-aa48-051ff3e72829 tempest-AttachVolumeNegativeTest-527431328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-813dc01f-01aa-402a-93c3-629a6223aed8" returned: 0 in 0.343s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:36:10 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-e05a8dde-31da-4488-aa48-051ff3e72829 tempest-AttachVolumeNegativeTest-527431328 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:36:10 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-e05a8dde-31da-4488-aa48-051ff3e72829 tempest-AttachVolumeNegativeTest-527431328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:36:10 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-e05a8dde-31da-4488-aa48-051ff3e72829 tempest-AttachVolumeNegativeTest-527431328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2b1df96-d383-4b9a-a9c8-82618265140e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-813dc01f-01aa-402a-93c3-629a6223aed8', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:36:10 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-e05a8dde-31da-4488-aa48-051ff3e72829 tempest-AttachVolumeNegativeTest-527431328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9d4a073-32b5-49b6-b006-4f76bb0042e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:36:10 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-e05a8dde-31da-4488-aa48-051ff3e72829 tempest-AttachVolumeNegativeTest-527431328 None] Volume volume-813dc01f-01aa-402a-93c3-629a6223aed8 (813dc01f-01aa-402a-93c3-629a6223aed8): created successfully Sep 23 14:36:10 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-e05a8dde-31da-4488-aa48-051ff3e72829 tempest-AttachVolumeNegativeTest-527431328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9d4a073-32b5-49b6-b006-4f76bb0042e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:36:10 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-e05a8dde-31da-4488-aa48-051ff3e72829 tempest-AttachVolumeNegativeTest-527431328 None] Flow 'volume_create_manager' (896ce2af-0880-4572-9878-06d1c98447b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:36:10 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-e05a8dde-31da-4488-aa48-051ff3e72829 tempest-AttachVolumeNegativeTest-527431328 None] Created volume successfully. Sep 23 14:36:11 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-7b23ae6d-f1ee-46d4-bcca-8791f0d2a1cd tempest-VolumesTestJSON-1667670565 None] Acquiring lock "cinder-d1117d6b-8ae4-4b6d-8164-1a53dac2938a-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:36:11 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-7b23ae6d-f1ee-46d4-bcca-8791f0d2a1cd tempest-VolumesTestJSON-1667670565 None] Lock "cinder-d1117d6b-8ae4-4b6d-8164-1a53dac2938a-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:36:12 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-7b23ae6d-f1ee-46d4-bcca-8791f0d2a1cd tempest-VolumesTestJSON-1667670565 None] Acquiring lock "cinder-quobyte-d1117d6b-8ae4-4b6d-8164-1a53dac2938a" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:36:12 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-7b23ae6d-f1ee-46d4-bcca-8791f0d2a1cd tempest-VolumesTestJSON-1667670565 None] Lock "cinder-quobyte-d1117d6b-8ae4-4b6d-8164-1a53dac2938a" acquired by "delete_volume" :: waited 0.029s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:36:12 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[57deff1d-5ad7-44e9-a148-5edd2b3e8ba2]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:36:12 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-7b23ae6d-f1ee-46d4-bcca-8791f0d2a1cd tempest-VolumesTestJSON-1667670565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d1117d6b-8ae4-4b6d-8164-1a53dac2938a {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:36:12 devstack sudo[92550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d1117d6b-8ae4-4b6d-8164-1a53dac2938a Sep 23 14:36:12 devstack sudo[92550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:36:12 devstack sudo[92550]: pam_unix(sudo:session): session closed for user root Sep 23 14:36:12 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-7b23ae6d-f1ee-46d4-bcca-8791f0d2a1cd tempest-VolumesTestJSON-1667670565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d1117d6b-8ae4-4b6d-8164-1a53dac2938a" returned: 0 in 0.690s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:36:12 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-7b23ae6d-f1ee-46d4-bcca-8791f0d2a1cd tempest-VolumesTestJSON-1667670565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d1117d6b-8ae4-4b6d-8164-1a53dac2938a {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:36:12 devstack sudo[92561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d1117d6b-8ae4-4b6d-8164-1a53dac2938a Sep 23 14:36:12 devstack sudo[92561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:36:13 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [req-21f8fc63-e843-41ca-93d8-567f744ad716 req-16205a46-363c-4036-80d7-8937b126cbe7 tempest-AttachVolumeNegativeTest-527431328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:36:13 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [req-21f8fc63-e843-41ca-93d8-567f744ad716 req-16205a46-363c-4036-80d7-8937b126cbe7 tempest-AttachVolumeNegativeTest-527431328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:36:13 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [req-21f8fc63-e843-41ca-93d8-567f744ad716 req-16205a46-363c-4036-80d7-8937b126cbe7 tempest-AttachVolumeNegativeTest-527431328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:36:13 devstack sudo[92561]: pam_unix(sudo:session): session closed for user root Sep 23 14:36:13 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [req-21f8fc63-e843-41ca-93d8-567f744ad716 req-16205a46-363c-4036-80d7-8937b126cbe7 tempest-AttachVolumeNegativeTest-527431328 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362', 'name': 'volume-813dc01f-01aa-402a-93c3-629a6223aed8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '38f07f70-e590-4654-9348-e9609680b316', 'enforce_multipath': True} {{(pid=86310) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 14:36:13 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-7b23ae6d-f1ee-46d4-bcca-8791f0d2a1cd tempest-VolumesTestJSON-1667670565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d1117d6b-8ae4-4b6d-8164-1a53dac2938a" returned: 0 in 0.378s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:36:13 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-7b23ae6d-f1ee-46d4-bcca-8791f0d2a1cd tempest-VolumesTestJSON-1667670565 None] Lock "cinder-quobyte-d1117d6b-8ae4-4b6d-8164-1a53dac2938a" released by "delete_volume" :: held 1.182s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:36:13 devstack cinder-volume[86310]: INFO cinder.volume.manager [req-21f8fc63-e843-41ca-93d8-567f744ad716 req-16205a46-363c-4036-80d7-8937b126cbe7 tempest-AttachVolumeNegativeTest-527431328 None] attachment_update completed successfully. Sep 23 14:36:13 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-7b23ae6d-f1ee-46d4-bcca-8791f0d2a1cd tempest-VolumesTestJSON-1667670565 None] Created reservations ['86b94dc3-6afd-4e14-bcbe-23f65d07ed25', '4f25cf62-c60b-4cb5-918d-caf3b5a0fee9', 'd7eb48e9-4f8c-484e-a1d2-b0cbdd702829', 'e6fc35b9-f131-4b09-b153-ea986a556870'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:36:13 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-7b23ae6d-f1ee-46d4-bcca-8791f0d2a1cd tempest-VolumesTestJSON-1667670565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:36:13 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-7b23ae6d-f1ee-46d4-bcca-8791f0d2a1cd tempest-VolumesTestJSON-1667670565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:36:13 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-7b23ae6d-f1ee-46d4-bcca-8791f0d2a1cd tempest-VolumesTestJSON-1667670565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:36:13 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-7b23ae6d-f1ee-46d4-bcca-8791f0d2a1cd tempest-VolumesTestJSON-1667670565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:36:13 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-7b23ae6d-f1ee-46d4-bcca-8791f0d2a1cd tempest-VolumesTestJSON-1667670565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:36:13 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-7b23ae6d-f1ee-46d4-bcca-8791f0d2a1cd tempest-VolumesTestJSON-1667670565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:36:13 devstack sudo[92591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:36:13 devstack sudo[92591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:36:13 devstack sudo[92591]: pam_unix(sudo:session): session closed for user root Sep 23 14:36:13 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-7b23ae6d-f1ee-46d4-bcca-8791f0d2a1cd tempest-VolumesTestJSON-1667670565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.461s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:36:13 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-7b23ae6d-f1ee-46d4-bcca-8791f0d2a1cd tempest-VolumesTestJSON-1667670565 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:36:13 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-7b23ae6d-f1ee-46d4-bcca-8791f0d2a1cd tempest-VolumesTestJSON-1667670565 None] Deleted volume successfully. Sep 23 14:36:14 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-7b23ae6d-f1ee-46d4-bcca-8791f0d2a1cd tempest-VolumesTestJSON-1667670565 None] Lock "cinder-d1117d6b-8ae4-4b6d-8164-1a53dac2938a-delete_volume" released by "delete_volume" :: held 2.035s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:36:14 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-e8832bc7-d89e-4a03-b163-5940766c1c9d tempest-VolumesTestJSON-1667670565 None] Acquiring lock "cinder-994ed0e5-df22-4ba2-94f4-8729adf1cbf8-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:36:14 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-e8832bc7-d89e-4a03-b163-5940766c1c9d tempest-VolumesTestJSON-1667670565 None] Lock "cinder-994ed0e5-df22-4ba2-94f4-8729adf1cbf8-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:36:14 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-e8832bc7-d89e-4a03-b163-5940766c1c9d tempest-VolumesTestJSON-1667670565 None] Acquiring lock "cinder-quobyte-994ed0e5-df22-4ba2-94f4-8729adf1cbf8" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:36:14 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-e8832bc7-d89e-4a03-b163-5940766c1c9d tempest-VolumesTestJSON-1667670565 None] Lock "cinder-quobyte-994ed0e5-df22-4ba2-94f4-8729adf1cbf8" acquired by "delete_volume" :: waited 0.019s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:36:14 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[e64145ae-4d7b-49d4-9313-06ca7b681539]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:36:14 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-e8832bc7-d89e-4a03-b163-5940766c1c9d tempest-VolumesTestJSON-1667670565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-994ed0e5-df22-4ba2-94f4-8729adf1cbf8 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:36:14 devstack sudo[92983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-994ed0e5-df22-4ba2-94f4-8729adf1cbf8 Sep 23 14:36:14 devstack sudo[92983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:36:15 devstack sudo[92983]: pam_unix(sudo:session): session closed for user root Sep 23 14:36:15 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-e8832bc7-d89e-4a03-b163-5940766c1c9d tempest-VolumesTestJSON-1667670565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-994ed0e5-df22-4ba2-94f4-8729adf1cbf8" returned: 0 in 0.540s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:36:15 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-e8832bc7-d89e-4a03-b163-5940766c1c9d tempest-VolumesTestJSON-1667670565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-994ed0e5-df22-4ba2-94f4-8729adf1cbf8 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:36:15 devstack sudo[92988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-994ed0e5-df22-4ba2-94f4-8729adf1cbf8 Sep 23 14:36:15 devstack sudo[92988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:36:15 devstack sudo[92988]: pam_unix(sudo:session): session closed for user root Sep 23 14:36:15 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-e8832bc7-d89e-4a03-b163-5940766c1c9d tempest-VolumesTestJSON-1667670565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-994ed0e5-df22-4ba2-94f4-8729adf1cbf8" returned: 0 in 0.356s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:36:15 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-e8832bc7-d89e-4a03-b163-5940766c1c9d tempest-VolumesTestJSON-1667670565 None] Lock "cinder-quobyte-994ed0e5-df22-4ba2-94f4-8729adf1cbf8" released by "delete_volume" :: held 0.976s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:36:15 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-e8832bc7-d89e-4a03-b163-5940766c1c9d tempest-VolumesTestJSON-1667670565 None] Created reservations ['7ac256a3-2e32-48c0-b2ba-c50811d0a94c', '739c44f1-c730-4963-9d1a-5d4c0b419ace', '9614f49d-8b67-46aa-87f3-fd078c8d5d68', 'bc8541c2-653e-4ad3-9db7-8f8fc80c3264'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:36:16 devstack cinder-volume[86310]: INFO cinder.volume.manager [req-c7c96b00-76ad-4962-87b8-1f3c20c3444a req-d1db49a7-5a6b-4e43-ba04-5bf9f2375499 tempest-AttachVolumeNegativeTest-527431328 None] Terminate volume connection completed successfully. Sep 23 14:36:16 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [req-c7c96b00-76ad-4962-87b8-1f3c20c3444a req-d1db49a7-5a6b-4e43-ba04-5bf9f2375499 tempest-AttachVolumeNegativeTest-527431328 None] Deleting attachment 38f07f70-e590-4654-9348-e9609680b316. {{(pid=86310) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 14:36:16 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-e8832bc7-d89e-4a03-b163-5940766c1c9d tempest-VolumesTestJSON-1667670565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:36:16 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-e8832bc7-d89e-4a03-b163-5940766c1c9d tempest-VolumesTestJSON-1667670565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:36:16 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-e8832bc7-d89e-4a03-b163-5940766c1c9d tempest-VolumesTestJSON-1667670565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:36:16 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-e8832bc7-d89e-4a03-b163-5940766c1c9d tempest-VolumesTestJSON-1667670565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:36:16 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-e8832bc7-d89e-4a03-b163-5940766c1c9d tempest-VolumesTestJSON-1667670565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:36:16 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-e8832bc7-d89e-4a03-b163-5940766c1c9d tempest-VolumesTestJSON-1667670565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:36:16 devstack sudo[93055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:36:16 devstack sudo[93055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:36:16 devstack sudo[93055]: pam_unix(sudo:session): session closed for user root Sep 23 14:36:16 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-e8832bc7-d89e-4a03-b163-5940766c1c9d tempest-VolumesTestJSON-1667670565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.417s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:36:16 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-e8832bc7-d89e-4a03-b163-5940766c1c9d tempest-VolumesTestJSON-1667670565 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:36:16 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-e8832bc7-d89e-4a03-b163-5940766c1c9d tempest-VolumesTestJSON-1667670565 None] Deleted volume successfully. Sep 23 14:36:16 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-7ab07deb-7421-463d-ae97-b79d50f1194a tempest-VolumesTestJSON-1667670565 None] Acquiring lock "cinder-253b1892-95d7-46be-9ba3-be28dffa8ca3-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:36:16 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-7ab07deb-7421-463d-ae97-b79d50f1194a tempest-VolumesTestJSON-1667670565 None] Lock "cinder-253b1892-95d7-46be-9ba3-be28dffa8ca3-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:36:17 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-e8832bc7-d89e-4a03-b163-5940766c1c9d tempest-VolumesTestJSON-1667670565 None] Lock "cinder-994ed0e5-df22-4ba2-94f4-8729adf1cbf8-delete_volume" released by "delete_volume" :: held 2.704s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:36:17 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-7ab07deb-7421-463d-ae97-b79d50f1194a tempest-VolumesTestJSON-1667670565 None] Acquiring lock "cinder-quobyte-253b1892-95d7-46be-9ba3-be28dffa8ca3" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:36:17 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-7ab07deb-7421-463d-ae97-b79d50f1194a tempest-VolumesTestJSON-1667670565 None] Lock "cinder-quobyte-253b1892-95d7-46be-9ba3-be28dffa8ca3" acquired by "delete_volume" :: waited 0.022s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:36:17 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddda7e25-e1aa-4139-aeaf-c4b001f6a824]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:36:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-7ab07deb-7421-463d-ae97-b79d50f1194a tempest-VolumesTestJSON-1667670565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-253b1892-95d7-46be-9ba3-be28dffa8ca3 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:36:17 devstack sudo[93058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-253b1892-95d7-46be-9ba3-be28dffa8ca3 Sep 23 14:36:17 devstack sudo[93058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:36:17 devstack sudo[93058]: pam_unix(sudo:session): session closed for user root Sep 23 14:36:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-7ab07deb-7421-463d-ae97-b79d50f1194a tempest-VolumesTestJSON-1667670565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-253b1892-95d7-46be-9ba3-be28dffa8ca3" returned: 0 in 0.429s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:36:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-7ab07deb-7421-463d-ae97-b79d50f1194a tempest-VolumesTestJSON-1667670565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-253b1892-95d7-46be-9ba3-be28dffa8ca3 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:36:17 devstack sudo[93064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-253b1892-95d7-46be-9ba3-be28dffa8ca3 Sep 23 14:36:17 devstack sudo[93064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:36:17 devstack sudo[93064]: pam_unix(sudo:session): session closed for user root Sep 23 14:36:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-7ab07deb-7421-463d-ae97-b79d50f1194a tempest-VolumesTestJSON-1667670565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-253b1892-95d7-46be-9ba3-be28dffa8ca3" returned: 0 in 0.364s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:36:17 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-7ab07deb-7421-463d-ae97-b79d50f1194a tempest-VolumesTestJSON-1667670565 None] Lock "cinder-quobyte-253b1892-95d7-46be-9ba3-be28dffa8ca3" released by "delete_volume" :: held 0.843s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:36:18 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-7ab07deb-7421-463d-ae97-b79d50f1194a tempest-VolumesTestJSON-1667670565 None] Created reservations ['4f47821c-7844-44d2-8e50-731022a2a407', '234c3550-059e-4edf-bfee-9fece0c0cd8d', 'd4f2d2c7-bb73-4dc8-86f7-f74a71097fcc', '5601f775-189f-4122-b19d-50bfe0be321c'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:36:18 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-7ab07deb-7421-463d-ae97-b79d50f1194a tempest-VolumesTestJSON-1667670565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:36:18 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-7ab07deb-7421-463d-ae97-b79d50f1194a tempest-VolumesTestJSON-1667670565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:36:18 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-7ab07deb-7421-463d-ae97-b79d50f1194a tempest-VolumesTestJSON-1667670565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:36:18 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-7ab07deb-7421-463d-ae97-b79d50f1194a tempest-VolumesTestJSON-1667670565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:36:18 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-7ab07deb-7421-463d-ae97-b79d50f1194a tempest-VolumesTestJSON-1667670565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:36:18 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-7ab07deb-7421-463d-ae97-b79d50f1194a tempest-VolumesTestJSON-1667670565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:36:18 devstack sudo[93086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:36:18 devstack sudo[93086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:36:18 devstack sudo[93086]: pam_unix(sudo:session): session closed for user root Sep 23 14:36:18 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-7ab07deb-7421-463d-ae97-b79d50f1194a tempest-VolumesTestJSON-1667670565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.320s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:36:18 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-7ab07deb-7421-463d-ae97-b79d50f1194a tempest-VolumesTestJSON-1667670565 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:36:18 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-7ab07deb-7421-463d-ae97-b79d50f1194a tempest-VolumesTestJSON-1667670565 None] Deleted volume successfully. Sep 23 14:36:19 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-7ab07deb-7421-463d-ae97-b79d50f1194a tempest-VolumesTestJSON-1667670565 None] Lock "cinder-253b1892-95d7-46be-9ba3-be28dffa8ca3-delete_volume" released by "delete_volume" :: held 2.080s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:36:20 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-5a0e26a0-ed76-438c-9714-85c9ba087da2 tempest-GroupsV314Test-987203562 None] Group tempest-GroupsV314Test-Group-1423998551: creating Sep 23 14:36:20 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-5a0e26a0-ed76-438c-9714-85c9ba087da2 tempest-GroupsV314Test-987203562 None] Group tempest-GroupsV314Test-Group-1423998551: created successfully Sep 23 14:36:20 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-5a0e26a0-ed76-438c-9714-85c9ba087da2 tempest-GroupsV314Test-987203562 None] Create group completed successfully. Sep 23 14:36:21 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-04712105-57d4-4a28-9ab5-248879a7ce4c tempest-GroupsV314Test-987203562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:36:21 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-04712105-57d4-4a28-9ab5-248879a7ce4c tempest-GroupsV314Test-987203562 None] Flow 'volume_create_manager' (3e8fd02f-1687-45ae-a82a-363c9c313da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:36:21 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-04712105-57d4-4a28-9ab5-248879a7ce4c tempest-GroupsV314Test-987203562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac101e20-94a3-4cd8-b7d2-895142f480ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:36:21 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-04712105-57d4-4a28-9ab5-248879a7ce4c tempest-GroupsV314Test-987203562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac101e20-94a3-4cd8-b7d2-895142f480ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:36:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1541561686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cdd9d6b8-7b5e-4d7b-b579-80108a77cbec,host='devstack@QuobyteHD#QuobyteHD',id=8bd6a1ac-0591-4679-ac43-e1dbb61410aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47f03306b6ca449696fdd37c9a02c3d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:36:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:36:22Z,use_quota=True,user_id='4d1858ea7a0a4ae2a5050ddeb62ab69f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fef187c6-2f31-405c-b832-b75bb2f2126f),volume_type_id=fef187c6-2f31-405c-b832-b75bb2f2126f)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:36:21 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-04712105-57d4-4a28-9ab5-248879a7ce4c tempest-GroupsV314Test-987203562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe223b0a-1ba4-476c-b8d3-bed143f04747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:36:21 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-04712105-57d4-4a28-9ab5-248879a7ce4c tempest-GroupsV314Test-987203562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe223b0a-1ba4-476c-b8d3-bed143f04747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:36:21 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-04712105-57d4-4a28-9ab5-248879a7ce4c tempest-GroupsV314Test-987203562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (062e1d76-33e2-4b63-b977-8ec545680d70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:36:21 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-04712105-57d4-4a28-9ab5-248879a7ce4c tempest-GroupsV314Test-987203562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (062e1d76-33e2-4b63-b977-8ec545680d70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bd6a1ac-0591-4679-ac43-e1dbb61410aa', 'volume_name': 'volume-8bd6a1ac-0591-4679-ac43-e1dbb61410aa', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:36:21 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-04712105-57d4-4a28-9ab5-248879a7ce4c tempest-GroupsV314Test-987203562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f70c1528-4f09-43b4-83b2-9b0591afe4f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:36:21 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-04712105-57d4-4a28-9ab5-248879a7ce4c tempest-GroupsV314Test-987203562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f70c1528-4f09-43b4-83b2-9b0591afe4f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:36:21 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-04712105-57d4-4a28-9ab5-248879a7ce4c tempest-GroupsV314Test-987203562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f24fbb08-f168-40d2-a5c9-f850dfc3eca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:36:21 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-04712105-57d4-4a28-9ab5-248879a7ce4c tempest-GroupsV314Test-987203562 None] Volume 8bd6a1ac-0591-4679-ac43-e1dbb61410aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bd6a1ac-0591-4679-ac43-e1dbb61410aa', 'volume_size': 1} Sep 23 14:36:21 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-04712105-57d4-4a28-9ab5-248879a7ce4c tempest-GroupsV314Test-987203562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:36:21 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-04712105-57d4-4a28-9ab5-248879a7ce4c tempest-GroupsV314Test-987203562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:36:21 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-04712105-57d4-4a28-9ab5-248879a7ce4c tempest-GroupsV314Test-987203562 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=cdd9d6b8-7b5e-4d7b-b579-80108a77cbec,created_at=2026-09-23T12:36:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1541561686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cdd9d6b8-7b5e-4d7b-b579-80108a77cbec,host='devstack@QuobyteHD#QuobyteHD',id=8bd6a1ac-0591-4679-ac43-e1dbb61410aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47f03306b6ca449696fdd37c9a02c3d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:36:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:36:22Z,use_quota=True,user_id='4d1858ea7a0a4ae2a5050ddeb62ab69f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fef187c6-2f31-405c-b832-b75bb2f2126f),volume_type_id=fef187c6-2f31-405c-b832-b75bb2f2126f)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:36:21 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-04712105-57d4-4a28-9ab5-248879a7ce4c tempest-GroupsV314Test-987203562 None] Creating volume 8bd6a1ac-0591-4679-ac43-e1dbb61410aa {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:36:21 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-04712105-57d4-4a28-9ab5-248879a7ce4c tempest-GroupsV314Test-987203562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:36:21 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-04712105-57d4-4a28-9ab5-248879a7ce4c tempest-GroupsV314Test-987203562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:36:21 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-04712105-57d4-4a28-9ab5-248879a7ce4c tempest-GroupsV314Test-987203562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:36:21 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-04712105-57d4-4a28-9ab5-248879a7ce4c tempest-GroupsV314Test-987203562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:36:21 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-04712105-57d4-4a28-9ab5-248879a7ce4c tempest-GroupsV314Test-987203562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:36:21 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-04712105-57d4-4a28-9ab5-248879a7ce4c tempest-GroupsV314Test-987203562 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:36:21 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-04712105-57d4-4a28-9ab5-248879a7ce4c tempest-GroupsV314Test-987203562 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:36:21 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-04712105-57d4-4a28-9ab5-248879a7ce4c tempest-GroupsV314Test-987203562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8bd6a1ac-0591-4679-ac43-e1dbb61410aa 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:36:21 devstack sudo[93093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8bd6a1ac-0591-4679-ac43-e1dbb61410aa 1073741824 Sep 23 14:36:21 devstack sudo[93093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:36:22 devstack sudo[93093]: pam_unix(sudo:session): session closed for user root Sep 23 14:36:22 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-04712105-57d4-4a28-9ab5-248879a7ce4c tempest-GroupsV314Test-987203562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8bd6a1ac-0591-4679-ac43-e1dbb61410aa 1073741824" returned: 0 in 0.639s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:36:22 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-04712105-57d4-4a28-9ab5-248879a7ce4c tempest-GroupsV314Test-987203562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8bd6a1ac-0591-4679-ac43-e1dbb61410aa {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:36:22 devstack sudo[93101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8bd6a1ac-0591-4679-ac43-e1dbb61410aa Sep 23 14:36:22 devstack sudo[93101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:36:22 devstack sudo[93101]: pam_unix(sudo:session): session closed for user root Sep 23 14:36:22 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-04712105-57d4-4a28-9ab5-248879a7ce4c tempest-GroupsV314Test-987203562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8bd6a1ac-0591-4679-ac43-e1dbb61410aa" returned: 0 in 0.356s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:36:22 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-04712105-57d4-4a28-9ab5-248879a7ce4c tempest-GroupsV314Test-987203562 None] <== create_volume: return (1062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:36:22 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-04712105-57d4-4a28-9ab5-248879a7ce4c tempest-GroupsV314Test-987203562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:36:22 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-04712105-57d4-4a28-9ab5-248879a7ce4c tempest-GroupsV314Test-987203562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f24fbb08-f168-40d2-a5c9-f850dfc3eca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bd6a1ac-0591-4679-ac43-e1dbb61410aa', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:36:22 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-04712105-57d4-4a28-9ab5-248879a7ce4c tempest-GroupsV314Test-987203562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d2f0218-3994-448f-b7f9-5fc148dfc47d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:36:22 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-04712105-57d4-4a28-9ab5-248879a7ce4c tempest-GroupsV314Test-987203562 None] Volume volume-8bd6a1ac-0591-4679-ac43-e1dbb61410aa (8bd6a1ac-0591-4679-ac43-e1dbb61410aa): created successfully Sep 23 14:36:22 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-04712105-57d4-4a28-9ab5-248879a7ce4c tempest-GroupsV314Test-987203562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d2f0218-3994-448f-b7f9-5fc148dfc47d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:36:22 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-04712105-57d4-4a28-9ab5-248879a7ce4c tempest-GroupsV314Test-987203562 None] Flow 'volume_create_manager' (3e8fd02f-1687-45ae-a82a-363c9c313da9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:36:22 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-04712105-57d4-4a28-9ab5-248879a7ce4c tempest-GroupsV314Test-987203562 None] Created volume successfully. Sep 23 14:36:23 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-b79555dc-fdec-4695-b7d7-ac8de5a2e16c tempest-AttachVolumeNegativeTest-527431328 None] Acquiring lock "cinder-813dc01f-01aa-402a-93c3-629a6223aed8-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:36:23 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-b79555dc-fdec-4695-b7d7-ac8de5a2e16c tempest-AttachVolumeNegativeTest-527431328 None] Lock "cinder-813dc01f-01aa-402a-93c3-629a6223aed8-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:36:24 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-b79555dc-fdec-4695-b7d7-ac8de5a2e16c tempest-AttachVolumeNegativeTest-527431328 None] Acquiring lock "cinder-quobyte-813dc01f-01aa-402a-93c3-629a6223aed8" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:36:24 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-b79555dc-fdec-4695-b7d7-ac8de5a2e16c tempest-AttachVolumeNegativeTest-527431328 None] Lock "cinder-quobyte-813dc01f-01aa-402a-93c3-629a6223aed8" acquired by "delete_volume" :: waited 0.030s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:36:24 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[248b5d1c-e905-40db-8a1d-b0ee71f41b00]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:36:24 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-b79555dc-fdec-4695-b7d7-ac8de5a2e16c tempest-AttachVolumeNegativeTest-527431328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-813dc01f-01aa-402a-93c3-629a6223aed8 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:36:24 devstack sudo[93104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-813dc01f-01aa-402a-93c3-629a6223aed8 Sep 23 14:36:24 devstack sudo[93104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:36:24 devstack sudo[93104]: pam_unix(sudo:session): session closed for user root Sep 23 14:36:24 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-b79555dc-fdec-4695-b7d7-ac8de5a2e16c tempest-AttachVolumeNegativeTest-527431328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-813dc01f-01aa-402a-93c3-629a6223aed8" returned: 0 in 0.488s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:36:24 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-b79555dc-fdec-4695-b7d7-ac8de5a2e16c tempest-AttachVolumeNegativeTest-527431328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-813dc01f-01aa-402a-93c3-629a6223aed8 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:36:24 devstack sudo[93110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-813dc01f-01aa-402a-93c3-629a6223aed8 Sep 23 14:36:24 devstack sudo[93110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:36:24 devstack sudo[93110]: pam_unix(sudo:session): session closed for user root Sep 23 14:36:24 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-b79555dc-fdec-4695-b7d7-ac8de5a2e16c tempest-AttachVolumeNegativeTest-527431328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-813dc01f-01aa-402a-93c3-629a6223aed8" returned: 0 in 0.340s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:36:24 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-b79555dc-fdec-4695-b7d7-ac8de5a2e16c tempest-AttachVolumeNegativeTest-527431328 None] Lock "cinder-quobyte-813dc01f-01aa-402a-93c3-629a6223aed8" released by "delete_volume" :: held 0.891s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:36:25 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-99d8366b-c507-4cb1-a4b9-f880b5d842fd tempest-GroupsV314Test-987203562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:36:25 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-99d8366b-c507-4cb1-a4b9-f880b5d842fd tempest-GroupsV314Test-987203562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:36:25 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-99d8366b-c507-4cb1-a4b9-f880b5d842fd tempest-GroupsV314Test-987203562 None] Cloning volume 8bd6a1ac-0591-4679-ac43-e1dbb61410aa to volume fe451c13-ba7b-4a78-94a2-8372364a1356 Sep 23 14:36:25 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-99d8366b-c507-4cb1-a4b9-f880b5d842fd tempest-GroupsV314Test-987203562 None] Creating offline snapshot d37c3442-df2c-4b46-8e9e-d562652a24f7 of volume 8bd6a1ac-0591-4679-ac43-e1dbb61410aa {{(pid=86310) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 14:36:25 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[d45f1f81-8290-42bb-ab35-d97cde35057f]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:36:25 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-99d8366b-c507-4cb1-a4b9-f880b5d842fd tempest-GroupsV314Test-987203562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8bd6a1ac-0591-4679-ac43-e1dbb61410aa {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:36:25 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-b79555dc-fdec-4695-b7d7-ac8de5a2e16c tempest-AttachVolumeNegativeTest-527431328 None] Created reservations ['a4e6343d-f5c9-4822-bb6f-da9ef3b4c934', 'e7f67b27-4943-4582-bfe6-5be9e912fd8d', 'bcbefb4e-0c81-49fc-a2d8-faf74ae40a0d', '4e69d3c3-9bbc-488c-a491-1e0c1e960b40'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:36:25 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-b79555dc-fdec-4695-b7d7-ac8de5a2e16c tempest-AttachVolumeNegativeTest-527431328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:36:25 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-b79555dc-fdec-4695-b7d7-ac8de5a2e16c tempest-AttachVolumeNegativeTest-527431328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:36:25 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-b79555dc-fdec-4695-b7d7-ac8de5a2e16c tempest-AttachVolumeNegativeTest-527431328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:36:25 devstack sudo[93116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8bd6a1ac-0591-4679-ac43-e1dbb61410aa Sep 23 14:36:25 devstack sudo[93116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:36:25 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-b79555dc-fdec-4695-b7d7-ac8de5a2e16c tempest-AttachVolumeNegativeTest-527431328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:36:25 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-b79555dc-fdec-4695-b7d7-ac8de5a2e16c tempest-AttachVolumeNegativeTest-527431328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:36:25 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-b79555dc-fdec-4695-b7d7-ac8de5a2e16c tempest-AttachVolumeNegativeTest-527431328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:36:25 devstack sudo[93118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:36:25 devstack sudo[93118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:36:25 devstack sudo[93118]: pam_unix(sudo:session): session closed for user root Sep 23 14:36:25 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-b79555dc-fdec-4695-b7d7-ac8de5a2e16c tempest-AttachVolumeNegativeTest-527431328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.308s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:36:25 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-b79555dc-fdec-4695-b7d7-ac8de5a2e16c tempest-AttachVolumeNegativeTest-527431328 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:36:25 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-b79555dc-fdec-4695-b7d7-ac8de5a2e16c tempest-AttachVolumeNegativeTest-527431328 None] Deleted volume successfully. Sep 23 14:36:25 devstack sudo[93116]: pam_unix(sudo:session): session closed for user root Sep 23 14:36:25 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-99d8366b-c507-4cb1-a4b9-f880b5d842fd tempest-GroupsV314Test-987203562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8bd6a1ac-0591-4679-ac43-e1dbb61410aa" returned: 0 in 0.575s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:36:25 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-99d8366b-c507-4cb1-a4b9-f880b5d842fd tempest-GroupsV314Test-987203562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8bd6a1ac-0591-4679-ac43-e1dbb61410aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8bd6a1ac-0591-4679-ac43-e1dbb61410aa.d37c3442-df2c-4b46-8e9e-d562652a24f7 1G {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:36:25 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-b79555dc-fdec-4695-b7d7-ac8de5a2e16c tempest-AttachVolumeNegativeTest-527431328 None] Lock "cinder-813dc01f-01aa-402a-93c3-629a6223aed8-delete_volume" released by "delete_volume" :: held 1.733s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:36:25 devstack sudo[93125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8bd6a1ac-0591-4679-ac43-e1dbb61410aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8bd6a1ac-0591-4679-ac43-e1dbb61410aa.d37c3442-df2c-4b46-8e9e-d562652a24f7 1G Sep 23 14:36:25 devstack sudo[93125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:36:26 devstack sudo[93125]: pam_unix(sudo:session): session closed for user root Sep 23 14:36:26 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-99d8366b-c507-4cb1-a4b9-f880b5d842fd tempest-GroupsV314Test-987203562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8bd6a1ac-0591-4679-ac43-e1dbb61410aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8bd6a1ac-0591-4679-ac43-e1dbb61410aa.d37c3442-df2c-4b46-8e9e-d562652a24f7 1G" returned: 0 in 0.579s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:36:26 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-99d8366b-c507-4cb1-a4b9-f880b5d842fd tempest-GroupsV314Test-987203562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8bd6a1ac-0591-4679-ac43-e1dbb61410aa -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8bd6a1ac-0591-4679-ac43-e1dbb61410aa.d37c3442-df2c-4b46-8e9e-d562652a24f7 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:36:26 devstack sudo[93134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8bd6a1ac-0591-4679-ac43-e1dbb61410aa -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8bd6a1ac-0591-4679-ac43-e1dbb61410aa.d37c3442-df2c-4b46-8e9e-d562652a24f7 Sep 23 14:36:26 devstack sudo[93134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:36:26 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-57130820-47ea-4897-a881-7568e1d00fbe tempest-BackendsCapabilitiesAdminTestsJSON-707762897 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.4513206481934, 'free_capacity_gb': 1775.4513206481934, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86310) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 23 14:36:26 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-f20bb2c1-72a3-41c6-995b-755444f0f883 tempest-BackendsCapabilitiesAdminTestsJSON-707762897 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.4513206481934, 'free_capacity_gb': 1775.4513206481934, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86310) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 23 14:36:26 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-7fbc52b7-adcf-4110-a4ad-a37e8bb36e94 tempest-AttachVolumeNegativeTest-527431328 None] Acquiring lock "cinder-481939eb-5320-4bcd-b966-b06e3976629a-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:36:26 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-7fbc52b7-adcf-4110-a4ad-a37e8bb36e94 tempest-AttachVolumeNegativeTest-527431328 None] Lock "cinder-481939eb-5320-4bcd-b966-b06e3976629a-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:36:26 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-7fbc52b7-adcf-4110-a4ad-a37e8bb36e94 tempest-AttachVolumeNegativeTest-527431328 None] Acquiring lock "cinder-quobyte-481939eb-5320-4bcd-b966-b06e3976629a" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:36:26 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-7fbc52b7-adcf-4110-a4ad-a37e8bb36e94 tempest-AttachVolumeNegativeTest-527431328 None] Lock "cinder-quobyte-481939eb-5320-4bcd-b966-b06e3976629a" acquired by "delete_volume" :: waited 0.019s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:36:26 devstack sudo[93134]: pam_unix(sudo:session): session closed for user root Sep 23 14:36:26 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-99d8366b-c507-4cb1-a4b9-f880b5d842fd tempest-GroupsV314Test-987203562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8bd6a1ac-0591-4679-ac43-e1dbb61410aa -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8bd6a1ac-0591-4679-ac43-e1dbb61410aa.d37c3442-df2c-4b46-8e9e-d562652a24f7" returned: 0 in 0.591s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:36:26 devstack cinder-volume[86310]: WARNING cinder.volume.drivers.remotefs [None req-99d8366b-c507-4cb1-a4b9-f880b5d842fd tempest-GroupsV314Test-987203562 None] /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8bd6a1ac-0591-4679-ac43-e1dbb61410aa.d37c3442-df2c-4b46-8e9e-d562652a24f7 is being set with open permissions: ugo+rw: NotImplementedError Sep 23 14:36:26 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-99d8366b-c507-4cb1-a4b9-f880b5d842fd tempest-GroupsV314Test-987203562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8bd6a1ac-0591-4679-ac43-e1dbb61410aa.d37c3442-df2c-4b46-8e9e-d562652a24f7 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:36:26 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[282d049f-db9d-428e-a200-f927d4d88e59]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:36:26 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-7fbc52b7-adcf-4110-a4ad-a37e8bb36e94 tempest-AttachVolumeNegativeTest-527431328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-481939eb-5320-4bcd-b966-b06e3976629a {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:36:26 devstack sudo[93140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8bd6a1ac-0591-4679-ac43-e1dbb61410aa.d37c3442-df2c-4b46-8e9e-d562652a24f7 Sep 23 14:36:26 devstack sudo[93140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:36:27 devstack sudo[93141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-481939eb-5320-4bcd-b966-b06e3976629a Sep 23 14:36:27 devstack sudo[93141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:36:27 devstack sudo[93140]: pam_unix(sudo:session): session closed for user root Sep 23 14:36:27 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-99d8366b-c507-4cb1-a4b9-f880b5d842fd tempest-GroupsV314Test-987203562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8bd6a1ac-0591-4679-ac43-e1dbb61410aa.d37c3442-df2c-4b46-8e9e-d562652a24f7" returned: 0 in 0.340s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:36:27 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-99d8366b-c507-4cb1-a4b9-f880b5d842fd tempest-GroupsV314Test-987203562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8bd6a1ac-0591-4679-ac43-e1dbb61410aa.info {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:36:27 devstack sudo[93145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8bd6a1ac-0591-4679-ac43-e1dbb61410aa.info Sep 23 14:36:27 devstack sudo[93145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:36:27 devstack sudo[93141]: pam_unix(sudo:session): session closed for user root Sep 23 14:36:27 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-7fbc52b7-adcf-4110-a4ad-a37e8bb36e94 tempest-AttachVolumeNegativeTest-527431328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-481939eb-5320-4bcd-b966-b06e3976629a" returned: 0 in 0.527s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:36:27 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-7fbc52b7-adcf-4110-a4ad-a37e8bb36e94 tempest-AttachVolumeNegativeTest-527431328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-481939eb-5320-4bcd-b966-b06e3976629a {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:36:27 devstack sudo[93151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-481939eb-5320-4bcd-b966-b06e3976629a Sep 23 14:36:27 devstack sudo[93151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:36:27 devstack sudo[93145]: pam_unix(sudo:session): session closed for user root Sep 23 14:36:27 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-99d8366b-c507-4cb1-a4b9-f880b5d842fd tempest-GroupsV314Test-987203562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8bd6a1ac-0591-4679-ac43-e1dbb61410aa.info" returned: 0 in 0.428s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:36:27 devstack cinder-volume[86310]: WARNING cinder.volume.drivers.remotefs [None req-99d8366b-c507-4cb1-a4b9-f880b5d842fd tempest-GroupsV314Test-987203562 None] /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8bd6a1ac-0591-4679-ac43-e1dbb61410aa.info is being set with open permissions: ugo+rw: NotImplementedError Sep 23 14:36:27 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-99d8366b-c507-4cb1-a4b9-f880b5d842fd tempest-GroupsV314Test-987203562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8bd6a1ac-0591-4679-ac43-e1dbb61410aa.info {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:36:27 devstack sudo[93155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8bd6a1ac-0591-4679-ac43-e1dbb61410aa.info Sep 23 14:36:27 devstack sudo[93155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:36:27 devstack sudo[93151]: pam_unix(sudo:session): session closed for user root Sep 23 14:36:27 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-7fbc52b7-adcf-4110-a4ad-a37e8bb36e94 tempest-AttachVolumeNegativeTest-527431328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-481939eb-5320-4bcd-b966-b06e3976629a" returned: 0 in 0.474s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:36:27 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-7fbc52b7-adcf-4110-a4ad-a37e8bb36e94 tempest-AttachVolumeNegativeTest-527431328 None] Lock "cinder-quobyte-481939eb-5320-4bcd-b966-b06e3976629a" released by "delete_volume" :: held 1.089s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:36:28 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-7fbc52b7-adcf-4110-a4ad-a37e8bb36e94 tempest-AttachVolumeNegativeTest-527431328 None] Created reservations ['b7184ca8-348c-43ea-955d-4a18a1f08606', '09c54d5d-7dcc-4b66-b851-9cd65ed9f657', '7a8d83c5-de33-414b-8ce5-9fcf56b17542', '462b1fe1-edef-4f0d-b6f1-30d5ac9804d4'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:36:28 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-7fbc52b7-adcf-4110-a4ad-a37e8bb36e94 tempest-AttachVolumeNegativeTest-527431328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:36:28 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-7fbc52b7-adcf-4110-a4ad-a37e8bb36e94 tempest-AttachVolumeNegativeTest-527431328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:36:28 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-7fbc52b7-adcf-4110-a4ad-a37e8bb36e94 tempest-AttachVolumeNegativeTest-527431328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:36:28 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-7fbc52b7-adcf-4110-a4ad-a37e8bb36e94 tempest-AttachVolumeNegativeTest-527431328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:36:28 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-7fbc52b7-adcf-4110-a4ad-a37e8bb36e94 tempest-AttachVolumeNegativeTest-527431328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:36:28 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-7fbc52b7-adcf-4110-a4ad-a37e8bb36e94 tempest-AttachVolumeNegativeTest-527431328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:36:28 devstack sudo[93165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:36:28 devstack sudo[93165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:36:28 devstack sudo[93155]: pam_unix(sudo:session): session closed for user root Sep 23 14:36:28 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-99d8366b-c507-4cb1-a4b9-f880b5d842fd tempest-GroupsV314Test-987203562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8bd6a1ac-0591-4679-ac43-e1dbb61410aa.info" returned: 0 in 0.538s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:36:28 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-99d8366b-c507-4cb1-a4b9-f880b5d842fd tempest-GroupsV314Test-987203562 None] Acquiring lock "cinder-quobyte-fe451c13-ba7b-4a78-94a2-8372364a1356" by "_copy_volume_from_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:36:28 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-99d8366b-c507-4cb1-a4b9-f880b5d842fd tempest-GroupsV314Test-987203562 None] Lock "cinder-quobyte-fe451c13-ba7b-4a78-94a2-8372364a1356" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:36:28 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-99d8366b-c507-4cb1-a4b9-f880b5d842fd tempest-GroupsV314Test-987203562 None] snapshot: d37c3442-df2c-4b46-8e9e-d562652a24f7, volume: fe451c13-ba7b-4a78-94a2-8372364a1356, {{(pid=86310) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 23 14:36:28 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-99d8366b-c507-4cb1-a4b9-f880b5d842fd tempest-GroupsV314Test-987203562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:36:28 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-99d8366b-c507-4cb1-a4b9-f880b5d842fd tempest-GroupsV314Test-987203562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:36:28 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-99d8366b-c507-4cb1-a4b9-f880b5d842fd tempest-GroupsV314Test-987203562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:36:28 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-99d8366b-c507-4cb1-a4b9-f880b5d842fd tempest-GroupsV314Test-987203562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:36:28 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-99d8366b-c507-4cb1-a4b9-f880b5d842fd tempest-GroupsV314Test-987203562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:36:28 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[34b8d0a4-e704-4182-b9f9-71cf8c4aea8a]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:36:28 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-99d8366b-c507-4cb1-a4b9-f880b5d842fd tempest-GroupsV314Test-987203562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8bd6a1ac-0591-4679-ac43-e1dbb61410aa.d37c3442-df2c-4b46-8e9e-d562652a24f7 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:36:28 devstack sudo[93165]: pam_unix(sudo:session): session closed for user root Sep 23 14:36:28 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-7fbc52b7-adcf-4110-a4ad-a37e8bb36e94 tempest-AttachVolumeNegativeTest-527431328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.408s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:36:28 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-7fbc52b7-adcf-4110-a4ad-a37e8bb36e94 tempest-AttachVolumeNegativeTest-527431328 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:36:28 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-7fbc52b7-adcf-4110-a4ad-a37e8bb36e94 tempest-AttachVolumeNegativeTest-527431328 None] Deleted volume successfully. Sep 23 14:36:28 devstack sudo[93174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8bd6a1ac-0591-4679-ac43-e1dbb61410aa.d37c3442-df2c-4b46-8e9e-d562652a24f7 Sep 23 14:36:28 devstack sudo[93174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:36:28 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-7fbc52b7-adcf-4110-a4ad-a37e8bb36e94 tempest-AttachVolumeNegativeTest-527431328 None] Lock "cinder-481939eb-5320-4bcd-b966-b06e3976629a-delete_volume" released by "delete_volume" :: held 1.836s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:36:28 devstack sudo[93174]: pam_unix(sudo:session): session closed for user root Sep 23 14:36:28 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-99d8366b-c507-4cb1-a4b9-f880b5d842fd tempest-GroupsV314Test-987203562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8bd6a1ac-0591-4679-ac43-e1dbb61410aa.d37c3442-df2c-4b46-8e9e-d562652a24f7" returned: 0 in 0.541s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:36:28 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-99d8366b-c507-4cb1-a4b9-f880b5d842fd tempest-GroupsV314Test-987203562 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8bd6a1ac-0591-4679-ac43-e1dbb61410aa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 14:36:28 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[f044614f-7a29-4e66-bbb1-7e18452214ca]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:36:28 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-99d8366b-c507-4cb1-a4b9-f880b5d842fd tempest-GroupsV314Test-987203562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8bd6a1ac-0591-4679-ac43-e1dbb61410aa {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:36:29 devstack sudo[93184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8bd6a1ac-0591-4679-ac43-e1dbb61410aa Sep 23 14:36:29 devstack sudo[93184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:36:29 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-6a39301d-c8c7-4f6d-80eb-1ff1bc4978e1 tempest-AttachVolumeNegativeTest-527431328 None] Acquiring lock "cinder-6ba8a7d2-9324-4570-b342-fefd1b13c143-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:36:29 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-6a39301d-c8c7-4f6d-80eb-1ff1bc4978e1 tempest-AttachVolumeNegativeTest-527431328 None] Lock "cinder-6ba8a7d2-9324-4570-b342-fefd1b13c143-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:36:29 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-6a39301d-c8c7-4f6d-80eb-1ff1bc4978e1 tempest-AttachVolumeNegativeTest-527431328 None] Acquiring lock "cinder-quobyte-6ba8a7d2-9324-4570-b342-fefd1b13c143" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:36:29 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-6a39301d-c8c7-4f6d-80eb-1ff1bc4978e1 tempest-AttachVolumeNegativeTest-527431328 None] Lock "cinder-quobyte-6ba8a7d2-9324-4570-b342-fefd1b13c143" acquired by "delete_volume" :: waited 0.024s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:36:29 devstack sudo[93184]: pam_unix(sudo:session): session closed for user root Sep 23 14:36:29 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-99d8366b-c507-4cb1-a4b9-f880b5d842fd tempest-GroupsV314Test-987203562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8bd6a1ac-0591-4679-ac43-e1dbb61410aa" returned: 0 in 0.657s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:36:29 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-99d8366b-c507-4cb1-a4b9-f880b5d842fd tempest-GroupsV314Test-987203562 None] will copy from snapshot at /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8bd6a1ac-0591-4679-ac43-e1dbb61410aa {{(pid=86310) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 23 14:36:29 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-99d8366b-c507-4cb1-a4b9-f880b5d842fd tempest-GroupsV314Test-987203562 None] Creating direct copy from snapshot {{(pid=86310) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 23 14:36:29 devstack cinder-volume[86310]: DEBUG cinder.utils [None req-99d8366b-c507-4cb1-a4b9-f880b5d842fd tempest-GroupsV314Test-987203562 None] Path /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fe451c13-ba7b-4a78-94a2-8372364a1356 not found in is_blk_device check {{(pid=86310) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 23 14:36:29 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-99d8366b-c507-4cb1-a4b9-f880b5d842fd tempest-GroupsV314Test-987203562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8bd6a1ac-0591-4679-ac43-e1dbb61410aa /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fe451c13-ba7b-4a78-94a2-8372364a1356 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:36:29 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[9531dbdb-af9f-458f-a3af-43b9ca7fbe6d]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:36:29 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-6a39301d-c8c7-4f6d-80eb-1ff1bc4978e1 tempest-AttachVolumeNegativeTest-527431328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6ba8a7d2-9324-4570-b342-fefd1b13c143 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:36:29 devstack sudo[93189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8bd6a1ac-0591-4679-ac43-e1dbb61410aa /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fe451c13-ba7b-4a78-94a2-8372364a1356 Sep 23 14:36:29 devstack sudo[93189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:36:29 devstack sudo[93190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6ba8a7d2-9324-4570-b342-fefd1b13c143 Sep 23 14:36:29 devstack sudo[93190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:36:30 devstack sudo[93190]: pam_unix(sudo:session): session closed for user root Sep 23 14:36:30 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-6a39301d-c8c7-4f6d-80eb-1ff1bc4978e1 tempest-AttachVolumeNegativeTest-527431328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6ba8a7d2-9324-4570-b342-fefd1b13c143" returned: 0 in 0.478s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:36:30 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-6a39301d-c8c7-4f6d-80eb-1ff1bc4978e1 tempest-AttachVolumeNegativeTest-527431328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6ba8a7d2-9324-4570-b342-fefd1b13c143 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:36:30 devstack sudo[93200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6ba8a7d2-9324-4570-b342-fefd1b13c143 Sep 23 14:36:30 devstack sudo[93200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:36:30 devstack sudo[93200]: pam_unix(sudo:session): session closed for user root Sep 23 14:36:30 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-6a39301d-c8c7-4f6d-80eb-1ff1bc4978e1 tempest-AttachVolumeNegativeTest-527431328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6ba8a7d2-9324-4570-b342-fefd1b13c143" returned: 0 in 0.656s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:36:30 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-6a39301d-c8c7-4f6d-80eb-1ff1bc4978e1 tempest-AttachVolumeNegativeTest-527431328 None] Lock "cinder-quobyte-6ba8a7d2-9324-4570-b342-fefd1b13c143" released by "delete_volume" :: held 1.237s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:36:30 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-6a39301d-c8c7-4f6d-80eb-1ff1bc4978e1 tempest-AttachVolumeNegativeTest-527431328 None] Created reservations ['3418e3a3-8bcf-44ec-8a70-12c9d1785649', 'fd0c9a25-3316-44fc-9f93-058e041033d5', 'da28c6ec-3f21-4984-8839-d651efdf34ca', 'e696a82a-567e-420b-b885-3c155d71839a'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:36:31 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-6a39301d-c8c7-4f6d-80eb-1ff1bc4978e1 tempest-AttachVolumeNegativeTest-527431328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:36:31 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-6a39301d-c8c7-4f6d-80eb-1ff1bc4978e1 tempest-AttachVolumeNegativeTest-527431328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:36:31 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-6a39301d-c8c7-4f6d-80eb-1ff1bc4978e1 tempest-AttachVolumeNegativeTest-527431328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:36:31 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-6a39301d-c8c7-4f6d-80eb-1ff1bc4978e1 tempest-AttachVolumeNegativeTest-527431328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:36:31 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-6a39301d-c8c7-4f6d-80eb-1ff1bc4978e1 tempest-AttachVolumeNegativeTest-527431328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:36:31 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-6a39301d-c8c7-4f6d-80eb-1ff1bc4978e1 tempest-AttachVolumeNegativeTest-527431328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:36:31 devstack sudo[93222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:36:31 devstack sudo[93222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:36:31 devstack sudo[93222]: pam_unix(sudo:session): session closed for user root Sep 23 14:36:31 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-6a39301d-c8c7-4f6d-80eb-1ff1bc4978e1 tempest-AttachVolumeNegativeTest-527431328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.684s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:36:31 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-6a39301d-c8c7-4f6d-80eb-1ff1bc4978e1 tempest-AttachVolumeNegativeTest-527431328 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:36:31 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-6a39301d-c8c7-4f6d-80eb-1ff1bc4978e1 tempest-AttachVolumeNegativeTest-527431328 None] Deleted volume successfully. Sep 23 14:36:31 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-6a39301d-c8c7-4f6d-80eb-1ff1bc4978e1 tempest-AttachVolumeNegativeTest-527431328 None] Lock "cinder-6ba8a7d2-9324-4570-b342-fefd1b13c143-delete_volume" released by "delete_volume" :: held 2.487s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:36:40 devstack cinder-volume[86310]: DEBUG dbcounter [-] [86310] Writing DB stats cinder:SELECT=87,cinder:UPDATE=108,cinder:INSERT=31,cinder:DELETE=8 {{(pid=86310) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 14:36:40 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-e62a72c8-3506-4b43-a283-187774867b65 tempest-GroupSnapshotsTest-1878904240 None] Group tempest-GroupSnapshotsTest-Group-1263594378: creating Sep 23 14:36:40 devstack cinder-volume[86310]: DEBUG dbcounter [-] [86310] Writing DB stats cinder:SELECT=85,cinder:UPDATE=117,cinder:INSERT=22,cinder:DELETE=10 {{(pid=86310) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 14:36:40 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-e62a72c8-3506-4b43-a283-187774867b65 tempest-GroupSnapshotsTest-1878904240 None] Group tempest-GroupSnapshotsTest-Group-1263594378: created successfully Sep 23 14:36:40 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-e62a72c8-3506-4b43-a283-187774867b65 tempest-GroupSnapshotsTest-1878904240 None] Create group completed successfully. Sep 23 14:36:41 devstack sudo[93189]: pam_unix(sudo:session): session closed for user root Sep 23 14:36:41 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-99d8366b-c507-4cb1-a4b9-f880b5d842fd tempest-GroupsV314Test-987203562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8bd6a1ac-0591-4679-ac43-e1dbb61410aa /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fe451c13-ba7b-4a78-94a2-8372364a1356" returned: 0 in 11.421s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:36:41 devstack cinder-volume[86310]: DEBUG cinder.image.image_utils [None req-99d8366b-c507-4cb1-a4b9-f880b5d842fd tempest-GroupsV314Test-987203562 None] Image conversion details: src /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8bd6a1ac-0591-4679-ac43-e1dbb61410aa, size 1024.00 MB, duration 11.42 sec, destination /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fe451c13-ba7b-4a78-94a2-8372364a1356 {{(pid=86310) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 14:36:41 devstack cinder-volume[86310]: INFO cinder.image.image_utils [None req-99d8366b-c507-4cb1-a4b9-f880b5d842fd tempest-GroupsV314Test-987203562 None] Converted 1024.00 MB image at 89.65 MB/s Sep 23 14:36:41 devstack cinder-volume[86310]: WARNING cinder.volume.drivers.remotefs [None req-99d8366b-c507-4cb1-a4b9-f880b5d842fd tempest-GroupsV314Test-987203562 None] /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fe451c13-ba7b-4a78-94a2-8372364a1356 is being set with open permissions: ugo+rw: NotImplementedError Sep 23 14:36:41 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-99d8366b-c507-4cb1-a4b9-f880b5d842fd tempest-GroupsV314Test-987203562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fe451c13-ba7b-4a78-94a2-8372364a1356 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:36:41 devstack sudo[93303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fe451c13-ba7b-4a78-94a2-8372364a1356 Sep 23 14:36:41 devstack sudo[93303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:36:41 devstack sudo[93303]: pam_unix(sudo:session): session closed for user root Sep 23 14:36:41 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-99d8366b-c507-4cb1-a4b9-f880b5d842fd tempest-GroupsV314Test-987203562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fe451c13-ba7b-4a78-94a2-8372364a1356" returned: 0 in 0.432s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:36:41 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-99d8366b-c507-4cb1-a4b9-f880b5d842fd tempest-GroupsV314Test-987203562 None] Lock "cinder-quobyte-fe451c13-ba7b-4a78-94a2-8372364a1356" released by "_copy_volume_from_snapshot" :: held 13.180s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:36:41 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-99d8366b-c507-4cb1-a4b9-f880b5d842fd tempest-GroupsV314Test-987203562 None] Acquiring lock "cinder-quobyte-d37c3442-df2c-4b46-8e9e-d562652a24f7" by "_delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:36:41 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-99d8366b-c507-4cb1-a4b9-f880b5d842fd tempest-GroupsV314Test-987203562 None] Lock "cinder-quobyte-d37c3442-df2c-4b46-8e9e-d562652a24f7" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:36:41 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-99d8366b-c507-4cb1-a4b9-f880b5d842fd tempest-GroupsV314Test-987203562 None] Deleting offline snapshot d37c3442-df2c-4b46-8e9e-d562652a24f7 of volume 8bd6a1ac-0591-4679-ac43-e1dbb61410aa {{(pid=86310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 14:36:41 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-99d8366b-c507-4cb1-a4b9-f880b5d842fd tempest-GroupsV314Test-987203562 None] snapshot_file for this snap is: volume-8bd6a1ac-0591-4679-ac43-e1dbb61410aa.d37c3442-df2c-4b46-8e9e-d562652a24f7 {{(pid=86310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 14:36:41 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c025e90-6d27-42a2-90db-420fe61adfda]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:36:41 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-99d8366b-c507-4cb1-a4b9-f880b5d842fd tempest-GroupsV314Test-987203562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8bd6a1ac-0591-4679-ac43-e1dbb61410aa.d37c3442-df2c-4b46-8e9e-d562652a24f7 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:36:41 devstack sudo[93307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8bd6a1ac-0591-4679-ac43-e1dbb61410aa.d37c3442-df2c-4b46-8e9e-d562652a24f7 Sep 23 14:36:41 devstack sudo[93307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:36:42 devstack sudo[93307]: pam_unix(sudo:session): session closed for user root Sep 23 14:36:42 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-99d8366b-c507-4cb1-a4b9-f880b5d842fd tempest-GroupsV314Test-987203562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8bd6a1ac-0591-4679-ac43-e1dbb61410aa.d37c3442-df2c-4b46-8e9e-d562652a24f7" returned: 0 in 0.546s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:36:42 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-99d8366b-c507-4cb1-a4b9-f880b5d842fd tempest-GroupsV314Test-987203562 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8bd6a1ac-0591-4679-ac43-e1dbb61410aa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 14:36:42 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[afcac40e-41ba-4b10-ac17-b786fee74cd5]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:36:42 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-99d8366b-c507-4cb1-a4b9-f880b5d842fd tempest-GroupsV314Test-987203562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8bd6a1ac-0591-4679-ac43-e1dbb61410aa {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:36:42 devstack sudo[93315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8bd6a1ac-0591-4679-ac43-e1dbb61410aa Sep 23 14:36:42 devstack sudo[93315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:36:42 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5f449a9-3851-42fe-ba04-3d5933f8cca0 tempest-GroupSnapshotsTest-1878904240 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:36:42 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-c5f449a9-3851-42fe-ba04-3d5933f8cca0 tempest-GroupSnapshotsTest-1878904240 None] Flow 'volume_create_manager' (96020244-54b8-4eec-b292-d7107430c9c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:36:42 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-c5f449a9-3851-42fe-ba04-3d5933f8cca0 tempest-GroupSnapshotsTest-1878904240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8b0b509-2ac6-4bd3-b083-7200e260304b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:36:42 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-c5f449a9-3851-42fe-ba04-3d5933f8cca0 tempest-GroupSnapshotsTest-1878904240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8b0b509-2ac6-4bd3-b083-7200e260304b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:36:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-922556883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7727ee7c-2a4f-4c3c-8b25-348db19c766b,host='devstack@QuobyteHD#QuobyteHD',id=2d36a772-334f-4a5c-81c0-944d4e27bcfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2999c542f573402d95e56f45bd48a68f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:36:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:36:42Z,use_quota=True,user_id='084cc64e7b844f9992be81b9145ff791',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(943a9fb8-15c7-44ce-be00-10903e537d8a),volume_type_id=943a9fb8-15c7-44ce-be00-10903e537d8a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:36:42 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-c5f449a9-3851-42fe-ba04-3d5933f8cca0 tempest-GroupSnapshotsTest-1878904240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9b5631b-49fe-44c2-8894-9d709290684d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:36:42 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-c5f449a9-3851-42fe-ba04-3d5933f8cca0 tempest-GroupSnapshotsTest-1878904240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9b5631b-49fe-44c2-8894-9d709290684d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:36:42 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-c5f449a9-3851-42fe-ba04-3d5933f8cca0 tempest-GroupSnapshotsTest-1878904240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a672d63-658f-4081-8b69-8fe6daa388c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:36:42 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-c5f449a9-3851-42fe-ba04-3d5933f8cca0 tempest-GroupSnapshotsTest-1878904240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a672d63-658f-4081-8b69-8fe6daa388c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d36a772-334f-4a5c-81c0-944d4e27bcfe', 'volume_name': 'volume-2d36a772-334f-4a5c-81c0-944d4e27bcfe', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:36:42 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-c5f449a9-3851-42fe-ba04-3d5933f8cca0 tempest-GroupSnapshotsTest-1878904240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25011cfd-ca19-466c-9bd5-633c3ed95f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:36:42 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-c5f449a9-3851-42fe-ba04-3d5933f8cca0 tempest-GroupSnapshotsTest-1878904240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25011cfd-ca19-466c-9bd5-633c3ed95f4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:36:42 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-c5f449a9-3851-42fe-ba04-3d5933f8cca0 tempest-GroupSnapshotsTest-1878904240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a60e00d8-ebd6-4d33-b78a-1fbe5e188a13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:36:42 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-c5f449a9-3851-42fe-ba04-3d5933f8cca0 tempest-GroupSnapshotsTest-1878904240 None] Volume 2d36a772-334f-4a5c-81c0-944d4e27bcfe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d36a772-334f-4a5c-81c0-944d4e27bcfe', 'volume_size': 1} Sep 23 14:36:42 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-c5f449a9-3851-42fe-ba04-3d5933f8cca0 tempest-GroupSnapshotsTest-1878904240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:36:42 devstack sudo[93315]: pam_unix(sudo:session): session closed for user root Sep 23 14:36:42 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-99d8366b-c507-4cb1-a4b9-f880b5d842fd tempest-GroupsV314Test-987203562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8bd6a1ac-0591-4679-ac43-e1dbb61410aa" returned: 0 in 0.715s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:36:42 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-99d8366b-c507-4cb1-a4b9-f880b5d842fd tempest-GroupsV314Test-987203562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8bd6a1ac-0591-4679-ac43-e1dbb61410aa.d37c3442-df2c-4b46-8e9e-d562652a24f7 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:36:43 devstack sudo[93321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8bd6a1ac-0591-4679-ac43-e1dbb61410aa.d37c3442-df2c-4b46-8e9e-d562652a24f7 Sep 23 14:36:43 devstack sudo[93321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:36:43 devstack sudo[93321]: pam_unix(sudo:session): session closed for user root Sep 23 14:36:43 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-99d8366b-c507-4cb1-a4b9-f880b5d842fd tempest-GroupsV314Test-987203562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8bd6a1ac-0591-4679-ac43-e1dbb61410aa.d37c3442-df2c-4b46-8e9e-d562652a24f7" returned: 0 in 0.600s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:36:43 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-99d8366b-c507-4cb1-a4b9-f880b5d842fd tempest-GroupsV314Test-987203562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8bd6a1ac-0591-4679-ac43-e1dbb61410aa.d37c3442-df2c-4b46-8e9e-d562652a24f7 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:36:43 devstack sudo[93327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8bd6a1ac-0591-4679-ac43-e1dbb61410aa.d37c3442-df2c-4b46-8e9e-d562652a24f7 Sep 23 14:36:43 devstack sudo[93327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:36:43 devstack sudo[93327]: pam_unix(sudo:session): session closed for user root Sep 23 14:36:43 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-99d8366b-c507-4cb1-a4b9-f880b5d842fd tempest-GroupsV314Test-987203562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8bd6a1ac-0591-4679-ac43-e1dbb61410aa.d37c3442-df2c-4b46-8e9e-d562652a24f7" returned: 0 in 0.311s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:36:43 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-99d8366b-c507-4cb1-a4b9-f880b5d842fd tempest-GroupsV314Test-987203562 None] Lock "cinder-quobyte-d37c3442-df2c-4b46-8e9e-d562652a24f7" released by "_delete_snapshot" :: held 2.368s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:36:43 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-99d8366b-c507-4cb1-a4b9-f880b5d842fd tempest-GroupsV314Test-987203562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.901s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:36:43 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-c5f449a9-3851-42fe-ba04-3d5933f8cca0 tempest-GroupSnapshotsTest-1878904240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.143s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:36:43 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-c5f449a9-3851-42fe-ba04-3d5933f8cca0 tempest-GroupSnapshotsTest-1878904240 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7727ee7c-2a4f-4c3c-8b25-348db19c766b,created_at=2026-09-23T12:36:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-922556883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7727ee7c-2a4f-4c3c-8b25-348db19c766b,host='devstack@QuobyteHD#QuobyteHD',id=2d36a772-334f-4a5c-81c0-944d4e27bcfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2999c542f573402d95e56f45bd48a68f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:36:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:36:42Z,use_quota=True,user_id='084cc64e7b844f9992be81b9145ff791',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(943a9fb8-15c7-44ce-be00-10903e537d8a),volume_type_id=943a9fb8-15c7-44ce-be00-10903e537d8a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:36:43 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-c5f449a9-3851-42fe-ba04-3d5933f8cca0 tempest-GroupSnapshotsTest-1878904240 None] Creating volume 2d36a772-334f-4a5c-81c0-944d4e27bcfe {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:36:43 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-c5f449a9-3851-42fe-ba04-3d5933f8cca0 tempest-GroupSnapshotsTest-1878904240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:36:43 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-c5f449a9-3851-42fe-ba04-3d5933f8cca0 tempest-GroupSnapshotsTest-1878904240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:36:43 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-c5f449a9-3851-42fe-ba04-3d5933f8cca0 tempest-GroupSnapshotsTest-1878904240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:36:43 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-c5f449a9-3851-42fe-ba04-3d5933f8cca0 tempest-GroupSnapshotsTest-1878904240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:36:43 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-c5f449a9-3851-42fe-ba04-3d5933f8cca0 tempest-GroupSnapshotsTest-1878904240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:36:43 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-c5f449a9-3851-42fe-ba04-3d5933f8cca0 tempest-GroupSnapshotsTest-1878904240 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:36:43 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-c5f449a9-3851-42fe-ba04-3d5933f8cca0 tempest-GroupSnapshotsTest-1878904240 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:36:43 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-c5f449a9-3851-42fe-ba04-3d5933f8cca0 tempest-GroupSnapshotsTest-1878904240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2d36a772-334f-4a5c-81c0-944d4e27bcfe 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:36:43 devstack sudo[93331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2d36a772-334f-4a5c-81c0-944d4e27bcfe 1073741824 Sep 23 14:36:44 devstack sudo[93331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:36:44 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-99d8366b-c507-4cb1-a4b9-f880b5d842fd tempest-GroupsV314Test-987203562 None] Create group from source-group-cdd9d6b8-7b5e-4d7b-b579-80108a77cbec completed successfully. Sep 23 14:36:44 devstack sudo[93331]: pam_unix(sudo:session): session closed for user root Sep 23 14:36:44 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-c5f449a9-3851-42fe-ba04-3d5933f8cca0 tempest-GroupSnapshotsTest-1878904240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2d36a772-334f-4a5c-81c0-944d4e27bcfe 1073741824" returned: 0 in 0.570s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:36:44 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-c5f449a9-3851-42fe-ba04-3d5933f8cca0 tempest-GroupSnapshotsTest-1878904240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2d36a772-334f-4a5c-81c0-944d4e27bcfe {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:36:44 devstack sudo[93337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2d36a772-334f-4a5c-81c0-944d4e27bcfe Sep 23 14:36:44 devstack sudo[93337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:36:44 devstack sudo[93337]: pam_unix(sudo:session): session closed for user root Sep 23 14:36:44 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-c5f449a9-3851-42fe-ba04-3d5933f8cca0 tempest-GroupSnapshotsTest-1878904240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2d36a772-334f-4a5c-81c0-944d4e27bcfe" returned: 0 in 0.263s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:36:44 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-c5f449a9-3851-42fe-ba04-3d5933f8cca0 tempest-GroupSnapshotsTest-1878904240 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:36:44 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-c5f449a9-3851-42fe-ba04-3d5933f8cca0 tempest-GroupSnapshotsTest-1878904240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:36:44 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-c5f449a9-3851-42fe-ba04-3d5933f8cca0 tempest-GroupSnapshotsTest-1878904240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a60e00d8-ebd6-4d33-b78a-1fbe5e188a13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d36a772-334f-4a5c-81c0-944d4e27bcfe', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:36:44 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-c5f449a9-3851-42fe-ba04-3d5933f8cca0 tempest-GroupSnapshotsTest-1878904240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b15f7cd0-7e2a-484a-89c6-70fba8c705cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:36:44 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-c5f449a9-3851-42fe-ba04-3d5933f8cca0 tempest-GroupSnapshotsTest-1878904240 None] Volume volume-2d36a772-334f-4a5c-81c0-944d4e27bcfe (2d36a772-334f-4a5c-81c0-944d4e27bcfe): created successfully Sep 23 14:36:44 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-c5f449a9-3851-42fe-ba04-3d5933f8cca0 tempest-GroupSnapshotsTest-1878904240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b15f7cd0-7e2a-484a-89c6-70fba8c705cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:36:44 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-c5f449a9-3851-42fe-ba04-3d5933f8cca0 tempest-GroupSnapshotsTest-1878904240 None] Flow 'volume_create_manager' (96020244-54b8-4eec-b292-d7107430c9c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:36:44 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-c5f449a9-3851-42fe-ba04-3d5933f8cca0 tempest-GroupSnapshotsTest-1878904240 None] Created volume successfully. Sep 23 14:36:45 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-526ffe86-e8fc-46ad-91b0-50ff74a4a3aa tempest-GroupsV314Test-987203562 None] Acquiring lock "cinder-quobyte-fe451c13-ba7b-4a78-94a2-8372364a1356" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:36:45 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-526ffe86-e8fc-46ad-91b0-50ff74a4a3aa tempest-GroupsV314Test-987203562 None] Lock "cinder-quobyte-fe451c13-ba7b-4a78-94a2-8372364a1356" acquired by "delete_volume" :: waited 0.021s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:36:45 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[2873a3bd-e82d-4d6b-9022-1310d183e765]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:36:45 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-526ffe86-e8fc-46ad-91b0-50ff74a4a3aa tempest-GroupsV314Test-987203562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fe451c13-ba7b-4a78-94a2-8372364a1356 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:36:45 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-ba4e95d3-df41-4490-94d3-af6f77a96a26 tempest-GroupSnapshotsTest-1878904240 None] GroupSnapshot bdd914d1-9c84-416b-998b-50a65b755309: creating. Sep 23 14:36:45 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-ba4e95d3-df41-4490-94d3-af6f77a96a26 tempest-GroupSnapshotsTest-1878904240 None] Group snapshot bdd914d1-9c84-416b-998b-50a65b755309: creating. {{(pid=86310) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 23 14:36:45 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-ba4e95d3-df41-4490-94d3-af6f77a96a26 tempest-GroupSnapshotsTest-1878904240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:36:45 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-ba4e95d3-df41-4490-94d3-af6f77a96a26 tempest-GroupSnapshotsTest-1878904240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:36:45 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-ba4e95d3-df41-4490-94d3-af6f77a96a26 tempest-GroupSnapshotsTest-1878904240 None] Creating offline snapshot e2d421b7-7152-462f-b270-b79652cd780e of volume 2d36a772-334f-4a5c-81c0-944d4e27bcfe {{(pid=86310) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 14:36:45 devstack sudo[93340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fe451c13-ba7b-4a78-94a2-8372364a1356 Sep 23 14:36:45 devstack sudo[93340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:36:45 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3bb73cb-4ad2-4207-b1c3-0e1ccfd40d3c]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:36:45 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ba4e95d3-df41-4490-94d3-af6f77a96a26 tempest-GroupSnapshotsTest-1878904240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2d36a772-334f-4a5c-81c0-944d4e27bcfe {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:36:45 devstack sudo[93342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2d36a772-334f-4a5c-81c0-944d4e27bcfe Sep 23 14:36:45 devstack sudo[93342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:36:45 devstack sudo[93340]: pam_unix(sudo:session): session closed for user root Sep 23 14:36:45 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-526ffe86-e8fc-46ad-91b0-50ff74a4a3aa tempest-GroupsV314Test-987203562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fe451c13-ba7b-4a78-94a2-8372364a1356" returned: 0 in 0.519s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:36:45 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-526ffe86-e8fc-46ad-91b0-50ff74a4a3aa tempest-GroupsV314Test-987203562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fe451c13-ba7b-4a78-94a2-8372364a1356 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:36:46 devstack sudo[93348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fe451c13-ba7b-4a78-94a2-8372364a1356 Sep 23 14:36:46 devstack sudo[93348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:36:46 devstack sudo[93342]: pam_unix(sudo:session): session closed for user root Sep 23 14:36:46 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ba4e95d3-df41-4490-94d3-af6f77a96a26 tempest-GroupSnapshotsTest-1878904240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2d36a772-334f-4a5c-81c0-944d4e27bcfe" returned: 0 in 0.432s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:36:46 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ba4e95d3-df41-4490-94d3-af6f77a96a26 tempest-GroupSnapshotsTest-1878904240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2d36a772-334f-4a5c-81c0-944d4e27bcfe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2d36a772-334f-4a5c-81c0-944d4e27bcfe.e2d421b7-7152-462f-b270-b79652cd780e 1G {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:36:46 devstack sudo[93354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2d36a772-334f-4a5c-81c0-944d4e27bcfe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2d36a772-334f-4a5c-81c0-944d4e27bcfe.e2d421b7-7152-462f-b270-b79652cd780e 1G Sep 23 14:36:46 devstack sudo[93354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:36:46 devstack sudo[93348]: pam_unix(sudo:session): session closed for user root Sep 23 14:36:46 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-526ffe86-e8fc-46ad-91b0-50ff74a4a3aa tempest-GroupsV314Test-987203562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fe451c13-ba7b-4a78-94a2-8372364a1356" returned: 0 in 0.377s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:36:46 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-526ffe86-e8fc-46ad-91b0-50ff74a4a3aa tempest-GroupsV314Test-987203562 None] Lock "cinder-quobyte-fe451c13-ba7b-4a78-94a2-8372364a1356" released by "delete_volume" :: held 0.961s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:36:46 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-526ffe86-e8fc-46ad-91b0-50ff74a4a3aa tempest-GroupsV314Test-987203562 None] Created reservations ['b68e0611-c7ff-4c40-a138-bc5c2588732e'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:36:46 devstack cinder-volume[86310]: WARNING cinder.quota [None req-526ffe86-e8fc-46ad-91b0-50ff74a4a3aa tempest-GroupsV314Test-987203562 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-138026195 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-138026195, it is now deprecated. Please use the default quota class for default quota. Sep 23 14:36:46 devstack cinder-volume[86310]: WARNING cinder.quota [None req-526ffe86-e8fc-46ad-91b0-50ff74a4a3aa tempest-GroupsV314Test-987203562 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-138026195 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-138026195, it is now deprecated. Please use the default quota class for default quota. Sep 23 14:36:46 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-526ffe86-e8fc-46ad-91b0-50ff74a4a3aa tempest-GroupsV314Test-987203562 None] Created reservations ['04d41913-267a-49f2-87a4-7ef313bf6978', 'e5d971af-5c1b-4c2a-bee3-95cdb0e5cf05', '360b604a-e51c-4e4a-9da5-a0e280cc24ca', '86fdb4ab-6cb6-4b9e-8cda-6478532fed68'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:36:46 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-526ffe86-e8fc-46ad-91b0-50ff74a4a3aa tempest-GroupsV314Test-987203562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:36:46 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-526ffe86-e8fc-46ad-91b0-50ff74a4a3aa tempest-GroupsV314Test-987203562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:36:46 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-526ffe86-e8fc-46ad-91b0-50ff74a4a3aa tempest-GroupsV314Test-987203562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:36:46 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-526ffe86-e8fc-46ad-91b0-50ff74a4a3aa tempest-GroupsV314Test-987203562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:36:46 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-526ffe86-e8fc-46ad-91b0-50ff74a4a3aa tempest-GroupsV314Test-987203562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:36:46 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-526ffe86-e8fc-46ad-91b0-50ff74a4a3aa tempest-GroupsV314Test-987203562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:36:46 devstack sudo[93354]: pam_unix(sudo:session): session closed for user root Sep 23 14:36:46 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ba4e95d3-df41-4490-94d3-af6f77a96a26 tempest-GroupSnapshotsTest-1878904240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2d36a772-334f-4a5c-81c0-944d4e27bcfe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2d36a772-334f-4a5c-81c0-944d4e27bcfe.e2d421b7-7152-462f-b270-b79652cd780e 1G" returned: 0 in 0.571s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:36:46 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ba4e95d3-df41-4490-94d3-af6f77a96a26 tempest-GroupSnapshotsTest-1878904240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d36a772-334f-4a5c-81c0-944d4e27bcfe -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2d36a772-334f-4a5c-81c0-944d4e27bcfe.e2d421b7-7152-462f-b270-b79652cd780e {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:36:46 devstack sudo[93360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:36:46 devstack sudo[93360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:36:46 devstack sudo[93362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d36a772-334f-4a5c-81c0-944d4e27bcfe -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2d36a772-334f-4a5c-81c0-944d4e27bcfe.e2d421b7-7152-462f-b270-b79652cd780e Sep 23 14:36:46 devstack sudo[93362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:36:47 devstack sudo[93360]: pam_unix(sudo:session): session closed for user root Sep 23 14:36:47 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-526ffe86-e8fc-46ad-91b0-50ff74a4a3aa tempest-GroupsV314Test-987203562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.433s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:36:47 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-526ffe86-e8fc-46ad-91b0-50ff74a4a3aa tempest-GroupsV314Test-987203562 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:36:47 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-526ffe86-e8fc-46ad-91b0-50ff74a4a3aa tempest-GroupsV314Test-987203562 None] Delete group completed successfully. Sep 23 14:36:47 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-1e646a10-166e-4cd6-a255-f333d13a0b2a tempest-GroupsV314Test-987203562 None] Acquiring lock "cinder-quobyte-8bd6a1ac-0591-4679-ac43-e1dbb61410aa" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:36:47 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-1e646a10-166e-4cd6-a255-f333d13a0b2a tempest-GroupsV314Test-987203562 None] Lock "cinder-quobyte-8bd6a1ac-0591-4679-ac43-e1dbb61410aa" acquired by "delete_volume" :: waited 0.027s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:36:47 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc7eecfe-f102-4949-9920-7cfebe4bea77]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:36:47 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-1e646a10-166e-4cd6-a255-f333d13a0b2a tempest-GroupsV314Test-987203562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8bd6a1ac-0591-4679-ac43-e1dbb61410aa {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:36:47 devstack sudo[93362]: pam_unix(sudo:session): session closed for user root Sep 23 14:36:47 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ba4e95d3-df41-4490-94d3-af6f77a96a26 tempest-GroupSnapshotsTest-1878904240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d36a772-334f-4a5c-81c0-944d4e27bcfe -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2d36a772-334f-4a5c-81c0-944d4e27bcfe.e2d421b7-7152-462f-b270-b79652cd780e" returned: 0 in 0.600s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:36:47 devstack cinder-volume[86310]: WARNING cinder.volume.drivers.remotefs [None req-ba4e95d3-df41-4490-94d3-af6f77a96a26 tempest-GroupSnapshotsTest-1878904240 None] /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2d36a772-334f-4a5c-81c0-944d4e27bcfe.e2d421b7-7152-462f-b270-b79652cd780e is being set with open permissions: ugo+rw: NotImplementedError Sep 23 14:36:47 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ba4e95d3-df41-4490-94d3-af6f77a96a26 tempest-GroupSnapshotsTest-1878904240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2d36a772-334f-4a5c-81c0-944d4e27bcfe.e2d421b7-7152-462f-b270-b79652cd780e {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:36:47 devstack sudo[93370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2d36a772-334f-4a5c-81c0-944d4e27bcfe.e2d421b7-7152-462f-b270-b79652cd780e Sep 23 14:36:47 devstack sudo[93370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:36:47 devstack sudo[93369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8bd6a1ac-0591-4679-ac43-e1dbb61410aa Sep 23 14:36:47 devstack sudo[93369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:36:47 devstack sudo[93370]: pam_unix(sudo:session): session closed for user root Sep 23 14:36:47 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ba4e95d3-df41-4490-94d3-af6f77a96a26 tempest-GroupSnapshotsTest-1878904240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2d36a772-334f-4a5c-81c0-944d4e27bcfe.e2d421b7-7152-462f-b270-b79652cd780e" returned: 0 in 0.277s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:36:47 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ba4e95d3-df41-4490-94d3-af6f77a96a26 tempest-GroupSnapshotsTest-1878904240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2d36a772-334f-4a5c-81c0-944d4e27bcfe.info {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:36:47 devstack sudo[93376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2d36a772-334f-4a5c-81c0-944d4e27bcfe.info Sep 23 14:36:47 devstack sudo[93376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:36:47 devstack sudo[93369]: pam_unix(sudo:session): session closed for user root Sep 23 14:36:47 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-1e646a10-166e-4cd6-a255-f333d13a0b2a tempest-GroupsV314Test-987203562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8bd6a1ac-0591-4679-ac43-e1dbb61410aa" returned: 0 in 0.465s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:36:47 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-1e646a10-166e-4cd6-a255-f333d13a0b2a tempest-GroupsV314Test-987203562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8bd6a1ac-0591-4679-ac43-e1dbb61410aa {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:36:47 devstack sudo[93379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8bd6a1ac-0591-4679-ac43-e1dbb61410aa Sep 23 14:36:47 devstack sudo[93379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:36:47 devstack sudo[93376]: pam_unix(sudo:session): session closed for user root Sep 23 14:36:47 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ba4e95d3-df41-4490-94d3-af6f77a96a26 tempest-GroupSnapshotsTest-1878904240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2d36a772-334f-4a5c-81c0-944d4e27bcfe.info" returned: 0 in 0.325s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:36:47 devstack cinder-volume[86310]: WARNING cinder.volume.drivers.remotefs [None req-ba4e95d3-df41-4490-94d3-af6f77a96a26 tempest-GroupSnapshotsTest-1878904240 None] /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2d36a772-334f-4a5c-81c0-944d4e27bcfe.info is being set with open permissions: ugo+rw: NotImplementedError Sep 23 14:36:47 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ba4e95d3-df41-4490-94d3-af6f77a96a26 tempest-GroupSnapshotsTest-1878904240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2d36a772-334f-4a5c-81c0-944d4e27bcfe.info {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:36:48 devstack sudo[93388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2d36a772-334f-4a5c-81c0-944d4e27bcfe.info Sep 23 14:36:48 devstack sudo[93388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:36:48 devstack sudo[93379]: pam_unix(sudo:session): session closed for user root Sep 23 14:36:48 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-1e646a10-166e-4cd6-a255-f333d13a0b2a tempest-GroupsV314Test-987203562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8bd6a1ac-0591-4679-ac43-e1dbb61410aa" returned: 0 in 0.359s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:36:48 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-1e646a10-166e-4cd6-a255-f333d13a0b2a tempest-GroupsV314Test-987203562 None] Lock "cinder-quobyte-8bd6a1ac-0591-4679-ac43-e1dbb61410aa" released by "delete_volume" :: held 0.927s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:36:48 devstack sudo[93388]: pam_unix(sudo:session): session closed for user root Sep 23 14:36:48 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-1e646a10-166e-4cd6-a255-f333d13a0b2a tempest-GroupsV314Test-987203562 None] Created reservations ['626b10a7-16d4-416f-9e05-c65396776322'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:36:48 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ba4e95d3-df41-4490-94d3-af6f77a96a26 tempest-GroupSnapshotsTest-1878904240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2d36a772-334f-4a5c-81c0-944d4e27bcfe.info" returned: 0 in 0.368s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:36:48 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-ba4e95d3-df41-4490-94d3-af6f77a96a26 tempest-GroupSnapshotsTest-1878904240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.691s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:36:48 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [req-8fb8377b-9ea0-4661-b5c5-b807b6598882 req-80364baf-2cb1-4e5e-8eb1-b0f726eab9f7 tempest-VolumesSnapshotsTestJSON-1398247517 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:36:48 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [req-8fb8377b-9ea0-4661-b5c5-b807b6598882 req-80364baf-2cb1-4e5e-8eb1-b0f726eab9f7 tempest-VolumesSnapshotsTestJSON-1398247517 None] Flow 'volume_create_manager' (7e069e80-9861-4f6c-bf76-0c69096e6b4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:36:48 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [req-8fb8377b-9ea0-4661-b5c5-b807b6598882 req-80364baf-2cb1-4e5e-8eb1-b0f726eab9f7 tempest-VolumesSnapshotsTestJSON-1398247517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4790499f-95e9-4e01-a08d-b51a9770baa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:36:48 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [req-8fb8377b-9ea0-4661-b5c5-b807b6598882 req-80364baf-2cb1-4e5e-8eb1-b0f726eab9f7 tempest-VolumesSnapshotsTestJSON-1398247517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4790499f-95e9-4e01-a08d-b51a9770baa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:36:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-122271270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80237416-b7e4-42f6-85ed-3ee614169a5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c515d12db0b54cc1b5dbd2cd807f8227',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:36:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:36:48Z,use_quota=True,user_id='4d26b7ad3b61409db65b479da8e852ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:36:48 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [req-8fb8377b-9ea0-4661-b5c5-b807b6598882 req-80364baf-2cb1-4e5e-8eb1-b0f726eab9f7 tempest-VolumesSnapshotsTestJSON-1398247517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a321826-56e5-4a35-bb82-73b9ee2fb62f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:36:48 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [req-8fb8377b-9ea0-4661-b5c5-b807b6598882 req-80364baf-2cb1-4e5e-8eb1-b0f726eab9f7 tempest-VolumesSnapshotsTestJSON-1398247517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a321826-56e5-4a35-bb82-73b9ee2fb62f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:36:48 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [req-8fb8377b-9ea0-4661-b5c5-b807b6598882 req-80364baf-2cb1-4e5e-8eb1-b0f726eab9f7 tempest-VolumesSnapshotsTestJSON-1398247517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fecaba8-0c50-42df-b899-b2edfb121045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:36:48 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [req-8fb8377b-9ea0-4661-b5c5-b807b6598882 req-80364baf-2cb1-4e5e-8eb1-b0f726eab9f7 tempest-VolumesSnapshotsTestJSON-1398247517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fecaba8-0c50-42df-b899-b2edfb121045) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80237416-b7e4-42f6-85ed-3ee614169a5f', 'volume_name': 'volume-80237416-b7e4-42f6-85ed-3ee614169a5f', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:36:48 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [req-8fb8377b-9ea0-4661-b5c5-b807b6598882 req-80364baf-2cb1-4e5e-8eb1-b0f726eab9f7 tempest-VolumesSnapshotsTestJSON-1398247517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2003e44-28ca-4b77-b1aa-b54c87b8a752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:36:48 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [req-8fb8377b-9ea0-4661-b5c5-b807b6598882 req-80364baf-2cb1-4e5e-8eb1-b0f726eab9f7 tempest-VolumesSnapshotsTestJSON-1398247517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2003e44-28ca-4b77-b1aa-b54c87b8a752) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:36:48 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [req-8fb8377b-9ea0-4661-b5c5-b807b6598882 req-80364baf-2cb1-4e5e-8eb1-b0f726eab9f7 tempest-VolumesSnapshotsTestJSON-1398247517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e080bcc-43cb-4929-8a8f-01e04eb6ec2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:36:48 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [req-8fb8377b-9ea0-4661-b5c5-b807b6598882 req-80364baf-2cb1-4e5e-8eb1-b0f726eab9f7 tempest-VolumesSnapshotsTestJSON-1398247517 None] Volume 80237416-b7e4-42f6-85ed-3ee614169a5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80237416-b7e4-42f6-85ed-3ee614169a5f', 'volume_size': 1} Sep 23 14:36:48 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [req-8fb8377b-9ea0-4661-b5c5-b807b6598882 req-80364baf-2cb1-4e5e-8eb1-b0f726eab9f7 tempest-VolumesSnapshotsTestJSON-1398247517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:36:48 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [req-8fb8377b-9ea0-4661-b5c5-b807b6598882 req-80364baf-2cb1-4e5e-8eb1-b0f726eab9f7 tempest-VolumesSnapshotsTestJSON-1398247517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:36:48 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [req-8fb8377b-9ea0-4661-b5c5-b807b6598882 req-80364baf-2cb1-4e5e-8eb1-b0f726eab9f7 tempest-VolumesSnapshotsTestJSON-1398247517 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:36:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-122271270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80237416-b7e4-42f6-85ed-3ee614169a5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c515d12db0b54cc1b5dbd2cd807f8227',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:36:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:36:48Z,use_quota=True,user_id='4d26b7ad3b61409db65b479da8e852ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:36:48 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [req-8fb8377b-9ea0-4661-b5c5-b807b6598882 req-80364baf-2cb1-4e5e-8eb1-b0f726eab9f7 tempest-VolumesSnapshotsTestJSON-1398247517 None] Creating volume 80237416-b7e4-42f6-85ed-3ee614169a5f {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:36:48 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [req-8fb8377b-9ea0-4661-b5c5-b807b6598882 req-80364baf-2cb1-4e5e-8eb1-b0f726eab9f7 tempest-VolumesSnapshotsTestJSON-1398247517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:36:48 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [req-8fb8377b-9ea0-4661-b5c5-b807b6598882 req-80364baf-2cb1-4e5e-8eb1-b0f726eab9f7 tempest-VolumesSnapshotsTestJSON-1398247517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:36:48 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [req-8fb8377b-9ea0-4661-b5c5-b807b6598882 req-80364baf-2cb1-4e5e-8eb1-b0f726eab9f7 tempest-VolumesSnapshotsTestJSON-1398247517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:36:48 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [req-8fb8377b-9ea0-4661-b5c5-b807b6598882 req-80364baf-2cb1-4e5e-8eb1-b0f726eab9f7 tempest-VolumesSnapshotsTestJSON-1398247517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:36:48 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [req-8fb8377b-9ea0-4661-b5c5-b807b6598882 req-80364baf-2cb1-4e5e-8eb1-b0f726eab9f7 tempest-VolumesSnapshotsTestJSON-1398247517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:36:48 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [req-8fb8377b-9ea0-4661-b5c5-b807b6598882 req-80364baf-2cb1-4e5e-8eb1-b0f726eab9f7 tempest-VolumesSnapshotsTestJSON-1398247517 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:36:48 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [req-8fb8377b-9ea0-4661-b5c5-b807b6598882 req-80364baf-2cb1-4e5e-8eb1-b0f726eab9f7 tempest-VolumesSnapshotsTestJSON-1398247517 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:36:48 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [req-8fb8377b-9ea0-4661-b5c5-b807b6598882 req-80364baf-2cb1-4e5e-8eb1-b0f726eab9f7 tempest-VolumesSnapshotsTestJSON-1398247517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-80237416-b7e4-42f6-85ed-3ee614169a5f 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:36:48 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-1e646a10-166e-4cd6-a255-f333d13a0b2a tempest-GroupsV314Test-987203562 None] Created reservations ['30fa0b49-692a-43f3-8c26-41b8ff14664f', '02be26f5-43fb-436e-936c-b21ca5382625', 'dbdacafb-18dd-4287-bc93-8b781884cf51', 'a2aed9d8-ec9e-4e4f-869b-ae90403a2d59'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:36:48 devstack sudo[93408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-80237416-b7e4-42f6-85ed-3ee614169a5f 1073741824 Sep 23 14:36:48 devstack sudo[93408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:36:48 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-ba4e95d3-df41-4490-94d3-af6f77a96a26 tempest-GroupSnapshotsTest-1878904240 None] group_snapshot bdd914d1-9c84-416b-998b-50a65b755309: created successfully Sep 23 14:36:48 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-1e646a10-166e-4cd6-a255-f333d13a0b2a tempest-GroupsV314Test-987203562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:36:48 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-1e646a10-166e-4cd6-a255-f333d13a0b2a tempest-GroupsV314Test-987203562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:36:48 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-1e646a10-166e-4cd6-a255-f333d13a0b2a tempest-GroupsV314Test-987203562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:36:48 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-1e646a10-166e-4cd6-a255-f333d13a0b2a tempest-GroupsV314Test-987203562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:36:48 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-1e646a10-166e-4cd6-a255-f333d13a0b2a tempest-GroupsV314Test-987203562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:36:48 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-1e646a10-166e-4cd6-a255-f333d13a0b2a tempest-GroupsV314Test-987203562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:36:48 devstack sudo[93410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:36:48 devstack sudo[93410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:36:49 devstack sudo[93410]: pam_unix(sudo:session): session closed for user root Sep 23 14:36:49 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-1e646a10-166e-4cd6-a255-f333d13a0b2a tempest-GroupsV314Test-987203562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.273s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:36:49 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-1e646a10-166e-4cd6-a255-f333d13a0b2a tempest-GroupsV314Test-987203562 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:36:49 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-1e646a10-166e-4cd6-a255-f333d13a0b2a tempest-GroupsV314Test-987203562 None] Delete group completed successfully. Sep 23 14:36:49 devstack sudo[93408]: pam_unix(sudo:session): session closed for user root Sep 23 14:36:49 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [req-8fb8377b-9ea0-4661-b5c5-b807b6598882 req-80364baf-2cb1-4e5e-8eb1-b0f726eab9f7 tempest-VolumesSnapshotsTestJSON-1398247517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-80237416-b7e4-42f6-85ed-3ee614169a5f 1073741824" returned: 0 in 0.480s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:36:49 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [req-8fb8377b-9ea0-4661-b5c5-b807b6598882 req-80364baf-2cb1-4e5e-8eb1-b0f726eab9f7 tempest-VolumesSnapshotsTestJSON-1398247517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-80237416-b7e4-42f6-85ed-3ee614169a5f {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:36:49 devstack sudo[93418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-80237416-b7e4-42f6-85ed-3ee614169a5f Sep 23 14:36:49 devstack sudo[93418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:36:49 devstack sudo[93418]: pam_unix(sudo:session): session closed for user root Sep 23 14:36:49 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [req-8fb8377b-9ea0-4661-b5c5-b807b6598882 req-80364baf-2cb1-4e5e-8eb1-b0f726eab9f7 tempest-VolumesSnapshotsTestJSON-1398247517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-80237416-b7e4-42f6-85ed-3ee614169a5f" returned: 0 in 0.250s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:36:49 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [req-8fb8377b-9ea0-4661-b5c5-b807b6598882 req-80364baf-2cb1-4e5e-8eb1-b0f726eab9f7 tempest-VolumesSnapshotsTestJSON-1398247517 None] <== create_volume: return (779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:36:49 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [req-8fb8377b-9ea0-4661-b5c5-b807b6598882 req-80364baf-2cb1-4e5e-8eb1-b0f726eab9f7 tempest-VolumesSnapshotsTestJSON-1398247517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.782s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:36:49 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [req-8fb8377b-9ea0-4661-b5c5-b807b6598882 req-80364baf-2cb1-4e5e-8eb1-b0f726eab9f7 tempest-VolumesSnapshotsTestJSON-1398247517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e080bcc-43cb-4929-8a8f-01e04eb6ec2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80237416-b7e4-42f6-85ed-3ee614169a5f', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:36:49 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [req-8fb8377b-9ea0-4661-b5c5-b807b6598882 req-80364baf-2cb1-4e5e-8eb1-b0f726eab9f7 tempest-VolumesSnapshotsTestJSON-1398247517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4071392f-e923-4805-8644-6441c3445c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:36:49 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [req-8fb8377b-9ea0-4661-b5c5-b807b6598882 req-80364baf-2cb1-4e5e-8eb1-b0f726eab9f7 tempest-VolumesSnapshotsTestJSON-1398247517 None] Volume volume-80237416-b7e4-42f6-85ed-3ee614169a5f (80237416-b7e4-42f6-85ed-3ee614169a5f): created successfully Sep 23 14:36:49 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [req-8fb8377b-9ea0-4661-b5c5-b807b6598882 req-80364baf-2cb1-4e5e-8eb1-b0f726eab9f7 tempest-VolumesSnapshotsTestJSON-1398247517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4071392f-e923-4805-8644-6441c3445c72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:36:49 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [req-8fb8377b-9ea0-4661-b5c5-b807b6598882 req-80364baf-2cb1-4e5e-8eb1-b0f726eab9f7 tempest-VolumesSnapshotsTestJSON-1398247517 None] Flow 'volume_create_manager' (7e069e80-9861-4f6c-bf76-0c69096e6b4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:36:49 devstack cinder-volume[86310]: INFO cinder.volume.manager [req-8fb8377b-9ea0-4661-b5c5-b807b6598882 req-80364baf-2cb1-4e5e-8eb1-b0f726eab9f7 tempest-VolumesSnapshotsTestJSON-1398247517 None] Created volume successfully. Sep 23 14:36:49 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-64176069-57f5-4545-8a6a-6707958aa45b tempest-GroupSnapshotsTest-1878904240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:36:49 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-64176069-57f5-4545-8a6a-6707958aa45b tempest-GroupSnapshotsTest-1878904240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:36:49 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-64176069-57f5-4545-8a6a-6707958aa45b tempest-GroupSnapshotsTest-1878904240 None] Acquiring lock "cinder-quobyte-e2d421b7-7152-462f-b270-b79652cd780e-290e817c-8111-4163-ab3d-8c7dee84c378" by "_create_volume_from_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:36:49 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-64176069-57f5-4545-8a6a-6707958aa45b tempest-GroupSnapshotsTest-1878904240 None] Lock "cinder-quobyte-e2d421b7-7152-462f-b270-b79652cd780e-290e817c-8111-4163-ab3d-8c7dee84c378" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:36:49 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-64176069-57f5-4545-8a6a-6707958aa45b tempest-GroupSnapshotsTest-1878904240 None] Creating volume 290e817c-8111-4163-ab3d-8c7dee84c378 from snapshot e2d421b7-7152-462f-b270-b79652cd780e {{(pid=86310) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 23 14:36:49 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-64176069-57f5-4545-8a6a-6707958aa45b tempest-GroupSnapshotsTest-1878904240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:36:49 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-64176069-57f5-4545-8a6a-6707958aa45b tempest-GroupSnapshotsTest-1878904240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:36:49 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-64176069-57f5-4545-8a6a-6707958aa45b tempest-GroupSnapshotsTest-1878904240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:36:49 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-64176069-57f5-4545-8a6a-6707958aa45b tempest-GroupSnapshotsTest-1878904240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:36:49 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-64176069-57f5-4545-8a6a-6707958aa45b tempest-GroupSnapshotsTest-1878904240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:36:49 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-64176069-57f5-4545-8a6a-6707958aa45b tempest-GroupSnapshotsTest-1878904240 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:36:49 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-64176069-57f5-4545-8a6a-6707958aa45b tempest-GroupSnapshotsTest-1878904240 None] Acquiring lock "cinder-quobyte-290e817c-8111-4163-ab3d-8c7dee84c378" by "_copy_volume_from_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:36:49 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-64176069-57f5-4545-8a6a-6707958aa45b tempest-GroupSnapshotsTest-1878904240 None] Lock "cinder-quobyte-290e817c-8111-4163-ab3d-8c7dee84c378" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:36:49 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-64176069-57f5-4545-8a6a-6707958aa45b tempest-GroupSnapshotsTest-1878904240 None] snapshot: e2d421b7-7152-462f-b270-b79652cd780e, volume: 290e817c-8111-4163-ab3d-8c7dee84c378, {{(pid=86310) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 23 14:36:49 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-64176069-57f5-4545-8a6a-6707958aa45b tempest-GroupSnapshotsTest-1878904240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:36:49 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-64176069-57f5-4545-8a6a-6707958aa45b tempest-GroupSnapshotsTest-1878904240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:36:49 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-64176069-57f5-4545-8a6a-6707958aa45b tempest-GroupSnapshotsTest-1878904240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:36:49 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-64176069-57f5-4545-8a6a-6707958aa45b tempest-GroupSnapshotsTest-1878904240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:36:49 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-64176069-57f5-4545-8a6a-6707958aa45b tempest-GroupSnapshotsTest-1878904240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:36:49 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e61c04-f7b3-4cb2-a300-61cf97883d90]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:36:49 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-64176069-57f5-4545-8a6a-6707958aa45b tempest-GroupSnapshotsTest-1878904240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2d36a772-334f-4a5c-81c0-944d4e27bcfe.e2d421b7-7152-462f-b270-b79652cd780e {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:36:49 devstack sudo[93421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2d36a772-334f-4a5c-81c0-944d4e27bcfe.e2d421b7-7152-462f-b270-b79652cd780e Sep 23 14:36:49 devstack sudo[93421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:36:49 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [req-da46a0b1-b4ad-4466-85f0-f76e6976b6b8 req-809bffcc-1e43-4e6d-b3e5-08e2d08ba362 tempest-VolumesSnapshotsTestJSON-1398247517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:36:50 devstack sudo[93421]: pam_unix(sudo:session): session closed for user root Sep 23 14:36:50 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-64176069-57f5-4545-8a6a-6707958aa45b tempest-GroupSnapshotsTest-1878904240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2d36a772-334f-4a5c-81c0-944d4e27bcfe.e2d421b7-7152-462f-b270-b79652cd780e" returned: 0 in 0.472s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:36:50 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-64176069-57f5-4545-8a6a-6707958aa45b tempest-GroupSnapshotsTest-1878904240 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2d36a772-334f-4a5c-81c0-944d4e27bcfe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 14:36:50 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[d67803b4-1aa6-4846-92a2-d939b5bceecb]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:36:50 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-64176069-57f5-4545-8a6a-6707958aa45b tempest-GroupSnapshotsTest-1878904240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2d36a772-334f-4a5c-81c0-944d4e27bcfe {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:36:50 devstack sudo[93426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2d36a772-334f-4a5c-81c0-944d4e27bcfe Sep 23 14:36:50 devstack sudo[93426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:36:50 devstack sudo[93426]: pam_unix(sudo:session): session closed for user root Sep 23 14:36:50 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-64176069-57f5-4545-8a6a-6707958aa45b tempest-GroupSnapshotsTest-1878904240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2d36a772-334f-4a5c-81c0-944d4e27bcfe" returned: 0 in 0.390s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:36:50 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-64176069-57f5-4545-8a6a-6707958aa45b tempest-GroupSnapshotsTest-1878904240 None] will copy from snapshot at /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2d36a772-334f-4a5c-81c0-944d4e27bcfe {{(pid=86310) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 23 14:36:50 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-64176069-57f5-4545-8a6a-6707958aa45b tempest-GroupSnapshotsTest-1878904240 None] Creating direct copy from snapshot {{(pid=86310) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 23 14:36:50 devstack cinder-volume[86310]: DEBUG cinder.utils [None req-64176069-57f5-4545-8a6a-6707958aa45b tempest-GroupSnapshotsTest-1878904240 None] Path /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-290e817c-8111-4163-ab3d-8c7dee84c378 not found in is_blk_device check {{(pid=86310) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 23 14:36:50 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-64176069-57f5-4545-8a6a-6707958aa45b tempest-GroupSnapshotsTest-1878904240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2d36a772-334f-4a5c-81c0-944d4e27bcfe /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-290e817c-8111-4163-ab3d-8c7dee84c378 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:36:50 devstack sudo[93431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2d36a772-334f-4a5c-81c0-944d4e27bcfe /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-290e817c-8111-4163-ab3d-8c7dee84c378 Sep 23 14:36:50 devstack sudo[93431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:36:51 devstack cinder-volume[86310]: DEBUG oslo_service.periodic_task [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86310) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 14:36:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:36:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:36:51 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:36:51 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:36:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:36:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:36:51 devstack sudo[93443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:36:51 devstack sudo[93443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:36:51 devstack sudo[93443]: pam_unix(sudo:session): session closed for user root Sep 23 14:36:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.528s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:36:51 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:36:51 devstack cinder-volume[86310]: DEBUG oslo_service.periodic_task [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Running periodic task VolumeManager._thread_info {{(pid=86310) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 14:36:51 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] thread count: 28 {{(pid=86310) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 14:36:51 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] thread info: [<_MainThread(MainThread, started 128854208852096)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86310) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 14:36:58 devstack sudo[93431]: pam_unix(sudo:session): session closed for user root Sep 23 14:36:58 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-64176069-57f5-4545-8a6a-6707958aa45b tempest-GroupSnapshotsTest-1878904240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2d36a772-334f-4a5c-81c0-944d4e27bcfe /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-290e817c-8111-4163-ab3d-8c7dee84c378" returned: 0 in 8.042s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:36:58 devstack cinder-volume[86310]: DEBUG cinder.image.image_utils [None req-64176069-57f5-4545-8a6a-6707958aa45b tempest-GroupSnapshotsTest-1878904240 None] Image conversion details: src /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2d36a772-334f-4a5c-81c0-944d4e27bcfe, size 1024.00 MB, duration 8.04 sec, destination /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-290e817c-8111-4163-ab3d-8c7dee84c378 {{(pid=86310) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 14:36:58 devstack cinder-volume[86310]: INFO cinder.image.image_utils [None req-64176069-57f5-4545-8a6a-6707958aa45b tempest-GroupSnapshotsTest-1878904240 None] Converted 1024.00 MB image at 127.32 MB/s Sep 23 14:36:58 devstack cinder-volume[86310]: WARNING cinder.volume.drivers.remotefs [None req-64176069-57f5-4545-8a6a-6707958aa45b tempest-GroupSnapshotsTest-1878904240 None] /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-290e817c-8111-4163-ab3d-8c7dee84c378 is being set with open permissions: ugo+rw: NotImplementedError Sep 23 14:36:58 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-64176069-57f5-4545-8a6a-6707958aa45b tempest-GroupSnapshotsTest-1878904240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-290e817c-8111-4163-ab3d-8c7dee84c378 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:36:58 devstack sudo[93449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-290e817c-8111-4163-ab3d-8c7dee84c378 Sep 23 14:36:58 devstack sudo[93449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:36:58 devstack sudo[93449]: pam_unix(sudo:session): session closed for user root Sep 23 14:36:58 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-64176069-57f5-4545-8a6a-6707958aa45b tempest-GroupSnapshotsTest-1878904240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-290e817c-8111-4163-ab3d-8c7dee84c378" returned: 0 in 0.257s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:36:58 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-64176069-57f5-4545-8a6a-6707958aa45b tempest-GroupSnapshotsTest-1878904240 None] Lock "cinder-quobyte-290e817c-8111-4163-ab3d-8c7dee84c378" released by "_copy_volume_from_snapshot" :: held 9.262s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:36:58 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-64176069-57f5-4545-8a6a-6707958aa45b tempest-GroupSnapshotsTest-1878904240 None] Lock "cinder-quobyte-e2d421b7-7152-462f-b270-b79652cd780e-290e817c-8111-4163-ab3d-8c7dee84c378" released by "_create_volume_from_snapshot" :: held 9.336s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:36:58 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-64176069-57f5-4545-8a6a-6707958aa45b tempest-GroupSnapshotsTest-1878904240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.356s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:36:58 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [req-da46a0b1-b4ad-4466-85f0-f76e6976b6b8 req-809bffcc-1e43-4e6d-b3e5-08e2d08ba362 tempest-VolumesSnapshotsTestJSON-1398247517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.052s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:36:58 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [req-da46a0b1-b4ad-4466-85f0-f76e6976b6b8 req-809bffcc-1e43-4e6d-b3e5-08e2d08ba362 tempest-VolumesSnapshotsTestJSON-1398247517 None] Creating offline snapshot 810e1a12-e66f-48de-85cb-d0d23436bda9 of volume 80237416-b7e4-42f6-85ed-3ee614169a5f {{(pid=86310) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 14:36:58 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca422ab6-2eb9-4b66-8e8f-0905eac232c6]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:36:58 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [req-da46a0b1-b4ad-4466-85f0-f76e6976b6b8 req-809bffcc-1e43-4e6d-b3e5-08e2d08ba362 tempest-VolumesSnapshotsTestJSON-1398247517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-80237416-b7e4-42f6-85ed-3ee614169a5f {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:36:59 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-64176069-57f5-4545-8a6a-6707958aa45b tempest-GroupSnapshotsTest-1878904240 None] Create group from source-snapshot-bdd914d1-9c84-416b-998b-50a65b755309 completed successfully. Sep 23 14:36:59 devstack sudo[93452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-80237416-b7e4-42f6-85ed-3ee614169a5f Sep 23 14:36:59 devstack sudo[93452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:36:59 devstack sudo[93452]: pam_unix(sudo:session): session closed for user root Sep 23 14:36:59 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [req-da46a0b1-b4ad-4466-85f0-f76e6976b6b8 req-809bffcc-1e43-4e6d-b3e5-08e2d08ba362 tempest-VolumesSnapshotsTestJSON-1398247517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-80237416-b7e4-42f6-85ed-3ee614169a5f" returned: 0 in 0.379s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:36:59 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [req-da46a0b1-b4ad-4466-85f0-f76e6976b6b8 req-809bffcc-1e43-4e6d-b3e5-08e2d08ba362 tempest-VolumesSnapshotsTestJSON-1398247517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-80237416-b7e4-42f6-85ed-3ee614169a5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-80237416-b7e4-42f6-85ed-3ee614169a5f.810e1a12-e66f-48de-85cb-d0d23436bda9 1G {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:36:59 devstack sudo[93457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-80237416-b7e4-42f6-85ed-3ee614169a5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-80237416-b7e4-42f6-85ed-3ee614169a5f.810e1a12-e66f-48de-85cb-d0d23436bda9 1G Sep 23 14:36:59 devstack sudo[93457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:36:59 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cf1499b-7706-4239-a9a8-8ebfdf0882ad tempest-SnapshotsActionsTest-1506064885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:36:59 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-1cf1499b-7706-4239-a9a8-8ebfdf0882ad tempest-SnapshotsActionsTest-1506064885 None] Flow 'volume_create_manager' (95555811-9d9a-4253-bfcc-c069ce752add) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:36:59 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-1cf1499b-7706-4239-a9a8-8ebfdf0882ad tempest-SnapshotsActionsTest-1506064885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d43740be-dbb0-4afa-8cd9-30e8b7f6f1ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:36:59 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-1cf1499b-7706-4239-a9a8-8ebfdf0882ad tempest-SnapshotsActionsTest-1506064885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d43740be-dbb0-4afa-8cd9-30e8b7f6f1ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:36:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1102896892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdca4f83-4751-4786-a502-ff3a27b0a1da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fa1be1054e14a899c3521c1f7f3168c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:36:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:36:59Z,use_quota=True,user_id='26a226f764f64ccb87308b4d8fce14b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:36:59 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-1cf1499b-7706-4239-a9a8-8ebfdf0882ad tempest-SnapshotsActionsTest-1506064885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b97b63df-4057-4a62-afe8-486fb0fb2cf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:36:59 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-1cf1499b-7706-4239-a9a8-8ebfdf0882ad tempest-SnapshotsActionsTest-1506064885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b97b63df-4057-4a62-afe8-486fb0fb2cf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:36:59 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-1cf1499b-7706-4239-a9a8-8ebfdf0882ad tempest-SnapshotsActionsTest-1506064885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a3b7138-77f1-4ed3-b449-22853327f2ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:36:59 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-1cf1499b-7706-4239-a9a8-8ebfdf0882ad tempest-SnapshotsActionsTest-1506064885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a3b7138-77f1-4ed3-b449-22853327f2ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fdca4f83-4751-4786-a502-ff3a27b0a1da', 'volume_name': 'volume-fdca4f83-4751-4786-a502-ff3a27b0a1da', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:36:59 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-1cf1499b-7706-4239-a9a8-8ebfdf0882ad tempest-SnapshotsActionsTest-1506064885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfda59e5-82d8-483a-93b1-f60455891100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:36:59 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-1cf1499b-7706-4239-a9a8-8ebfdf0882ad tempest-SnapshotsActionsTest-1506064885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfda59e5-82d8-483a-93b1-f60455891100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:36:59 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-1cf1499b-7706-4239-a9a8-8ebfdf0882ad tempest-SnapshotsActionsTest-1506064885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a595a66c-c05a-497f-9b7e-d67e2b50f5ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:36:59 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-1cf1499b-7706-4239-a9a8-8ebfdf0882ad tempest-SnapshotsActionsTest-1506064885 None] Volume fdca4f83-4751-4786-a502-ff3a27b0a1da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fdca4f83-4751-4786-a502-ff3a27b0a1da', 'volume_size': 1} Sep 23 14:36:59 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-1cf1499b-7706-4239-a9a8-8ebfdf0882ad tempest-SnapshotsActionsTest-1506064885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:36:59 devstack sudo[93457]: pam_unix(sudo:session): session closed for user root Sep 23 14:36:59 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [req-da46a0b1-b4ad-4466-85f0-f76e6976b6b8 req-809bffcc-1e43-4e6d-b3e5-08e2d08ba362 tempest-VolumesSnapshotsTestJSON-1398247517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-80237416-b7e4-42f6-85ed-3ee614169a5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-80237416-b7e4-42f6-85ed-3ee614169a5f.810e1a12-e66f-48de-85cb-d0d23436bda9 1G" returned: 0 in 0.409s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:36:59 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [req-da46a0b1-b4ad-4466-85f0-f76e6976b6b8 req-809bffcc-1e43-4e6d-b3e5-08e2d08ba362 tempest-VolumesSnapshotsTestJSON-1398247517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80237416-b7e4-42f6-85ed-3ee614169a5f -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-80237416-b7e4-42f6-85ed-3ee614169a5f.810e1a12-e66f-48de-85cb-d0d23436bda9 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:36:59 devstack sudo[93463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80237416-b7e4-42f6-85ed-3ee614169a5f -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-80237416-b7e4-42f6-85ed-3ee614169a5f.810e1a12-e66f-48de-85cb-d0d23436bda9 Sep 23 14:36:59 devstack sudo[93463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:00 devstack sudo[93463]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:00 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [req-da46a0b1-b4ad-4466-85f0-f76e6976b6b8 req-809bffcc-1e43-4e6d-b3e5-08e2d08ba362 tempest-VolumesSnapshotsTestJSON-1398247517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80237416-b7e4-42f6-85ed-3ee614169a5f -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-80237416-b7e4-42f6-85ed-3ee614169a5f.810e1a12-e66f-48de-85cb-d0d23436bda9" returned: 0 in 0.313s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:00 devstack cinder-volume[86310]: WARNING cinder.volume.drivers.remotefs [req-da46a0b1-b4ad-4466-85f0-f76e6976b6b8 req-809bffcc-1e43-4e6d-b3e5-08e2d08ba362 tempest-VolumesSnapshotsTestJSON-1398247517 None] /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-80237416-b7e4-42f6-85ed-3ee614169a5f.810e1a12-e66f-48de-85cb-d0d23436bda9 is being set with open permissions: ugo+rw Sep 23 14:37:00 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [req-da46a0b1-b4ad-4466-85f0-f76e6976b6b8 req-809bffcc-1e43-4e6d-b3e5-08e2d08ba362 tempest-VolumesSnapshotsTestJSON-1398247517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-80237416-b7e4-42f6-85ed-3ee614169a5f.810e1a12-e66f-48de-85cb-d0d23436bda9 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:00 devstack sudo[93468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-80237416-b7e4-42f6-85ed-3ee614169a5f.810e1a12-e66f-48de-85cb-d0d23436bda9 Sep 23 14:37:00 devstack sudo[93468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:00 devstack sudo[93468]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:00 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [req-da46a0b1-b4ad-4466-85f0-f76e6976b6b8 req-809bffcc-1e43-4e6d-b3e5-08e2d08ba362 tempest-VolumesSnapshotsTestJSON-1398247517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-80237416-b7e4-42f6-85ed-3ee614169a5f.810e1a12-e66f-48de-85cb-d0d23436bda9" returned: 0 in 0.264s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:00 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-8fab6472-741f-4e3a-bd95-0a0d23677c5f tempest-GroupSnapshotsTest-1878904240 None] Acquiring lock "cinder-quobyte-290e817c-8111-4163-ab3d-8c7dee84c378" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:37:00 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-8fab6472-741f-4e3a-bd95-0a0d23677c5f tempest-GroupSnapshotsTest-1878904240 None] Lock "cinder-quobyte-290e817c-8111-4163-ab3d-8c7dee84c378" acquired by "delete_volume" :: waited 0.017s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:37:00 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [req-da46a0b1-b4ad-4466-85f0-f76e6976b6b8 req-809bffcc-1e43-4e6d-b3e5-08e2d08ba362 tempest-VolumesSnapshotsTestJSON-1398247517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-80237416-b7e4-42f6-85ed-3ee614169a5f.info {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:00 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[69caac4a-0083-4f1c-850e-ff7c8b938ba8]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:37:00 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8fab6472-741f-4e3a-bd95-0a0d23677c5f tempest-GroupSnapshotsTest-1878904240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-290e817c-8111-4163-ab3d-8c7dee84c378 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:00 devstack sudo[93471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-80237416-b7e4-42f6-85ed-3ee614169a5f.info Sep 23 14:37:00 devstack sudo[93471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:00 devstack sudo[93472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-290e817c-8111-4163-ab3d-8c7dee84c378 Sep 23 14:37:00 devstack sudo[93472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:00 devstack sudo[93471]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:00 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [req-da46a0b1-b4ad-4466-85f0-f76e6976b6b8 req-809bffcc-1e43-4e6d-b3e5-08e2d08ba362 tempest-VolumesSnapshotsTestJSON-1398247517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-80237416-b7e4-42f6-85ed-3ee614169a5f.info" returned: 0 in 0.273s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:00 devstack cinder-volume[86310]: WARNING cinder.volume.drivers.remotefs [req-da46a0b1-b4ad-4466-85f0-f76e6976b6b8 req-809bffcc-1e43-4e6d-b3e5-08e2d08ba362 tempest-VolumesSnapshotsTestJSON-1398247517 None] /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-80237416-b7e4-42f6-85ed-3ee614169a5f.info is being set with open permissions: ugo+rw Sep 23 14:37:00 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [req-da46a0b1-b4ad-4466-85f0-f76e6976b6b8 req-809bffcc-1e43-4e6d-b3e5-08e2d08ba362 tempest-VolumesSnapshotsTestJSON-1398247517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-80237416-b7e4-42f6-85ed-3ee614169a5f.info {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:00 devstack sudo[93476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-80237416-b7e4-42f6-85ed-3ee614169a5f.info Sep 23 14:37:00 devstack sudo[93476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:00 devstack sudo[93472]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:00 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8fab6472-741f-4e3a-bd95-0a0d23677c5f tempest-GroupSnapshotsTest-1878904240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-290e817c-8111-4163-ab3d-8c7dee84c378" returned: 0 in 0.369s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:00 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8fab6472-741f-4e3a-bd95-0a0d23677c5f tempest-GroupSnapshotsTest-1878904240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-290e817c-8111-4163-ab3d-8c7dee84c378 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:00 devstack sudo[93481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-290e817c-8111-4163-ab3d-8c7dee84c378 Sep 23 14:37:00 devstack sudo[93481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:00 devstack sudo[93476]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:00 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [req-da46a0b1-b4ad-4466-85f0-f76e6976b6b8 req-809bffcc-1e43-4e6d-b3e5-08e2d08ba362 tempest-VolumesSnapshotsTestJSON-1398247517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-80237416-b7e4-42f6-85ed-3ee614169a5f.info" returned: 0 in 0.246s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:00 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [req-da46a0b1-b4ad-4466-85f0-f76e6976b6b8 req-809bffcc-1e43-4e6d-b3e5-08e2d08ba362 tempest-VolumesSnapshotsTestJSON-1398247517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.015s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:37:00 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-1cf1499b-7706-4239-a9a8-8ebfdf0882ad tempest-SnapshotsActionsTest-1506064885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.345s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:37:00 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-1cf1499b-7706-4239-a9a8-8ebfdf0882ad tempest-SnapshotsActionsTest-1506064885 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:36:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1102896892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdca4f83-4751-4786-a502-ff3a27b0a1da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fa1be1054e14a899c3521c1f7f3168c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:36:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:36:59Z,use_quota=True,user_id='26a226f764f64ccb87308b4d8fce14b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:37:00 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-1cf1499b-7706-4239-a9a8-8ebfdf0882ad tempest-SnapshotsActionsTest-1506064885 None] Creating volume fdca4f83-4751-4786-a502-ff3a27b0a1da {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:37:00 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-1cf1499b-7706-4239-a9a8-8ebfdf0882ad tempest-SnapshotsActionsTest-1506064885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:37:00 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-1cf1499b-7706-4239-a9a8-8ebfdf0882ad tempest-SnapshotsActionsTest-1506064885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:37:00 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-1cf1499b-7706-4239-a9a8-8ebfdf0882ad tempest-SnapshotsActionsTest-1506064885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:37:00 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-1cf1499b-7706-4239-a9a8-8ebfdf0882ad tempest-SnapshotsActionsTest-1506064885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:37:00 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-1cf1499b-7706-4239-a9a8-8ebfdf0882ad tempest-SnapshotsActionsTest-1506064885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:37:00 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-1cf1499b-7706-4239-a9a8-8ebfdf0882ad tempest-SnapshotsActionsTest-1506064885 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:37:00 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-1cf1499b-7706-4239-a9a8-8ebfdf0882ad tempest-SnapshotsActionsTest-1506064885 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:37:00 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-1cf1499b-7706-4239-a9a8-8ebfdf0882ad tempest-SnapshotsActionsTest-1506064885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:00 devstack sudo[93484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da 1073741824 Sep 23 14:37:00 devstack sudo[93484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:01 devstack cinder-volume[86310]: INFO cinder.volume.manager [req-da46a0b1-b4ad-4466-85f0-f76e6976b6b8 req-809bffcc-1e43-4e6d-b3e5-08e2d08ba362 tempest-VolumesSnapshotsTestJSON-1398247517 None] Create snapshot completed successfully Sep 23 14:37:01 devstack sudo[93481]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:01 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8fab6472-741f-4e3a-bd95-0a0d23677c5f tempest-GroupSnapshotsTest-1878904240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-290e817c-8111-4163-ab3d-8c7dee84c378" returned: 0 in 0.266s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:01 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-8fab6472-741f-4e3a-bd95-0a0d23677c5f tempest-GroupSnapshotsTest-1878904240 None] Lock "cinder-quobyte-290e817c-8111-4163-ab3d-8c7dee84c378" released by "delete_volume" :: held 0.696s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:37:01 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-8fab6472-741f-4e3a-bd95-0a0d23677c5f tempest-GroupSnapshotsTest-1878904240 None] Created reservations ['13e079d8-9e55-472a-a1f7-b7876cef4291'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:37:01 devstack cinder-volume[86310]: WARNING cinder.quota [None req-8fab6472-741f-4e3a-bd95-0a0d23677c5f tempest-GroupSnapshotsTest-1878904240 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1910690137 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1910690137, it is now deprecated. Please use the default quota class for default quota. Sep 23 14:37:01 devstack cinder-volume[86310]: WARNING cinder.quota [None req-8fab6472-741f-4e3a-bd95-0a0d23677c5f tempest-GroupSnapshotsTest-1878904240 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1910690137 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1910690137, it is now deprecated. Please use the default quota class for default quota. Sep 23 14:37:01 devstack cinder-volume[86310]: DEBUG cinder.coordination [req-3784c658-193a-43a4-a229-428cc2fe98ae req-e46040fc-2946-47af-be07-92f8ad2b0877 tempest-VolumesSnapshotsTestJSON-1398247517 None] Acquiring lock "cinder-810e1a12-e66f-48de-85cb-d0d23436bda9-delete_snapshot" by "delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:37:01 devstack cinder-volume[86310]: DEBUG cinder.coordination [req-3784c658-193a-43a4-a229-428cc2fe98ae req-e46040fc-2946-47af-be07-92f8ad2b0877 tempest-VolumesSnapshotsTestJSON-1398247517 None] Lock "cinder-810e1a12-e66f-48de-85cb-d0d23436bda9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:37:01 devstack cinder-volume[86310]: DEBUG cinder.coordination [req-3784c658-193a-43a4-a229-428cc2fe98ae req-e46040fc-2946-47af-be07-92f8ad2b0877 tempest-VolumesSnapshotsTestJSON-1398247517 None] Acquiring lock "cinder-quobyte-80237416-b7e4-42f6-85ed-3ee614169a5f" by "delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:37:01 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-8fab6472-741f-4e3a-bd95-0a0d23677c5f tempest-GroupSnapshotsTest-1878904240 None] Created reservations ['8a1fe854-290c-4a11-9a60-cd0be8a5745f', '40539aaa-a149-4777-9e8f-54777d8b9117', 'f5bd9fd3-06a5-46cd-812d-29c0249de6b3', '00fddcc5-06ec-4d71-9d56-722daecf3501'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:37:01 devstack cinder-volume[86310]: DEBUG cinder.coordination [req-3784c658-193a-43a4-a229-428cc2fe98ae req-e46040fc-2946-47af-be07-92f8ad2b0877 tempest-VolumesSnapshotsTestJSON-1398247517 None] Lock "cinder-quobyte-80237416-b7e4-42f6-85ed-3ee614169a5f" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:37:01 devstack cinder-volume[86310]: DEBUG cinder.coordination [req-3784c658-193a-43a4-a229-428cc2fe98ae req-e46040fc-2946-47af-be07-92f8ad2b0877 tempest-VolumesSnapshotsTestJSON-1398247517 None] Acquiring lock "cinder-quobyte-810e1a12-e66f-48de-85cb-d0d23436bda9" by "_delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:37:01 devstack cinder-volume[86310]: DEBUG cinder.coordination [req-3784c658-193a-43a4-a229-428cc2fe98ae req-e46040fc-2946-47af-be07-92f8ad2b0877 tempest-VolumesSnapshotsTestJSON-1398247517 None] Lock "cinder-quobyte-810e1a12-e66f-48de-85cb-d0d23436bda9" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:37:01 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [req-3784c658-193a-43a4-a229-428cc2fe98ae req-e46040fc-2946-47af-be07-92f8ad2b0877 tempest-VolumesSnapshotsTestJSON-1398247517 None] Deleting offline snapshot 810e1a12-e66f-48de-85cb-d0d23436bda9 of volume 80237416-b7e4-42f6-85ed-3ee614169a5f {{(pid=86310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 14:37:01 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [req-3784c658-193a-43a4-a229-428cc2fe98ae req-e46040fc-2946-47af-be07-92f8ad2b0877 tempest-VolumesSnapshotsTestJSON-1398247517 None] snapshot_file for this snap is: volume-80237416-b7e4-42f6-85ed-3ee614169a5f.810e1a12-e66f-48de-85cb-d0d23436bda9 {{(pid=86310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 14:37:01 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c97ee4d-ed40-4d86-93ef-0f7c4764372e]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:37:01 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [req-3784c658-193a-43a4-a229-428cc2fe98ae req-e46040fc-2946-47af-be07-92f8ad2b0877 tempest-VolumesSnapshotsTestJSON-1398247517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-80237416-b7e4-42f6-85ed-3ee614169a5f.810e1a12-e66f-48de-85cb-d0d23436bda9 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:01 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-8fab6472-741f-4e3a-bd95-0a0d23677c5f tempest-GroupSnapshotsTest-1878904240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:37:01 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-8fab6472-741f-4e3a-bd95-0a0d23677c5f tempest-GroupSnapshotsTest-1878904240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:37:01 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-8fab6472-741f-4e3a-bd95-0a0d23677c5f tempest-GroupSnapshotsTest-1878904240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:37:01 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-8fab6472-741f-4e3a-bd95-0a0d23677c5f tempest-GroupSnapshotsTest-1878904240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:37:01 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-8fab6472-741f-4e3a-bd95-0a0d23677c5f tempest-GroupSnapshotsTest-1878904240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:37:01 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8fab6472-741f-4e3a-bd95-0a0d23677c5f tempest-GroupSnapshotsTest-1878904240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:01 devstack sudo[93491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:37:01 devstack sudo[93491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:01 devstack sudo[93490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-80237416-b7e4-42f6-85ed-3ee614169a5f.810e1a12-e66f-48de-85cb-d0d23436bda9 Sep 23 14:37:01 devstack sudo[93490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:01 devstack sudo[93484]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:01 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-1cf1499b-7706-4239-a9a8-8ebfdf0882ad tempest-SnapshotsActionsTest-1506064885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da 1073741824" returned: 0 in 0.583s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:01 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-1cf1499b-7706-4239-a9a8-8ebfdf0882ad tempest-SnapshotsActionsTest-1506064885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:01 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-24196710-b35f-4cbe-a56f-6b2ba775f57f tempest-GroupSnapshotsTest-1878904240 None] group_snapshot bdd914d1-9c84-416b-998b-50a65b755309: deleting Sep 23 14:37:01 devstack sudo[93494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da Sep 23 14:37:01 devstack sudo[93494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:01 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-24196710-b35f-4cbe-a56f-6b2ba775f57f tempest-GroupSnapshotsTest-1878904240 None] group_snapshot bdd914d1-9c84-416b-998b-50a65b755309: deleting {{(pid=86310) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 23 14:37:01 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-24196710-b35f-4cbe-a56f-6b2ba775f57f tempest-GroupSnapshotsTest-1878904240 None] Acquiring lock "cinder-quobyte-2d36a772-334f-4a5c-81c0-944d4e27bcfe" by "delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:37:01 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-24196710-b35f-4cbe-a56f-6b2ba775f57f tempest-GroupSnapshotsTest-1878904240 None] Lock "cinder-quobyte-2d36a772-334f-4a5c-81c0-944d4e27bcfe" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:37:01 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-24196710-b35f-4cbe-a56f-6b2ba775f57f tempest-GroupSnapshotsTest-1878904240 None] Acquiring lock "cinder-quobyte-e2d421b7-7152-462f-b270-b79652cd780e" by "_delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:37:01 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-24196710-b35f-4cbe-a56f-6b2ba775f57f tempest-GroupSnapshotsTest-1878904240 None] Lock "cinder-quobyte-e2d421b7-7152-462f-b270-b79652cd780e" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:37:01 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-24196710-b35f-4cbe-a56f-6b2ba775f57f tempest-GroupSnapshotsTest-1878904240 None] Deleting offline snapshot e2d421b7-7152-462f-b270-b79652cd780e of volume 2d36a772-334f-4a5c-81c0-944d4e27bcfe {{(pid=86310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 14:37:01 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-24196710-b35f-4cbe-a56f-6b2ba775f57f tempest-GroupSnapshotsTest-1878904240 None] snapshot_file for this snap is: volume-2d36a772-334f-4a5c-81c0-944d4e27bcfe.e2d421b7-7152-462f-b270-b79652cd780e {{(pid=86310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 14:37:01 devstack sudo[93490]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:01 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9152629-1eb0-47ba-a10d-861c7117f5a8]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:37:01 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-24196710-b35f-4cbe-a56f-6b2ba775f57f tempest-GroupSnapshotsTest-1878904240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2d36a772-334f-4a5c-81c0-944d4e27bcfe.e2d421b7-7152-462f-b270-b79652cd780e {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:01 devstack sudo[93491]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:01 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [req-3784c658-193a-43a4-a229-428cc2fe98ae req-e46040fc-2946-47af-be07-92f8ad2b0877 tempest-VolumesSnapshotsTestJSON-1398247517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-80237416-b7e4-42f6-85ed-3ee614169a5f.810e1a12-e66f-48de-85cb-d0d23436bda9" returned: 0 in 0.502s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:01 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [req-3784c658-193a-43a4-a229-428cc2fe98ae req-e46040fc-2946-47af-be07-92f8ad2b0877 tempest-VolumesSnapshotsTestJSON-1398247517 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-80237416-b7e4-42f6-85ed-3ee614169a5f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 14:37:01 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8fab6472-741f-4e3a-bd95-0a0d23677c5f tempest-GroupSnapshotsTest-1878904240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.431s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:01 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-8fab6472-741f-4e3a-bd95-0a0d23677c5f tempest-GroupSnapshotsTest-1878904240 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:37:01 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-8fab6472-741f-4e3a-bd95-0a0d23677c5f tempest-GroupSnapshotsTest-1878904240 None] Delete group completed successfully. Sep 23 14:37:01 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5139a33-14a0-4aaa-b962-aa3daa577d0f]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:37:01 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [req-3784c658-193a-43a4-a229-428cc2fe98ae req-e46040fc-2946-47af-be07-92f8ad2b0877 tempest-VolumesSnapshotsTestJSON-1398247517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-80237416-b7e4-42f6-85ed-3ee614169a5f {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:01 devstack sudo[93502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2d36a772-334f-4a5c-81c0-944d4e27bcfe.e2d421b7-7152-462f-b270-b79652cd780e Sep 23 14:37:01 devstack sudo[93502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:01 devstack sudo[93494]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:01 devstack sudo[93503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-80237416-b7e4-42f6-85ed-3ee614169a5f Sep 23 14:37:01 devstack sudo[93503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:01 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-1cf1499b-7706-4239-a9a8-8ebfdf0882ad tempest-SnapshotsActionsTest-1506064885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da" returned: 0 in 0.399s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:01 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-1cf1499b-7706-4239-a9a8-8ebfdf0882ad tempest-SnapshotsActionsTest-1506064885 None] <== create_volume: return (1042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:37:01 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-1cf1499b-7706-4239-a9a8-8ebfdf0882ad tempest-SnapshotsActionsTest-1506064885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:37:02 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-1cf1499b-7706-4239-a9a8-8ebfdf0882ad tempest-SnapshotsActionsTest-1506064885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a595a66c-c05a-497f-9b7e-d67e2b50f5ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdca4f83-4751-4786-a502-ff3a27b0a1da', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:37:02 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-1cf1499b-7706-4239-a9a8-8ebfdf0882ad tempest-SnapshotsActionsTest-1506064885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e6c7bf2-e105-47fd-a828-ce3b65221e5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:37:02 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-1cf1499b-7706-4239-a9a8-8ebfdf0882ad tempest-SnapshotsActionsTest-1506064885 None] Volume volume-fdca4f83-4751-4786-a502-ff3a27b0a1da (fdca4f83-4751-4786-a502-ff3a27b0a1da): created successfully Sep 23 14:37:02 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-1cf1499b-7706-4239-a9a8-8ebfdf0882ad tempest-SnapshotsActionsTest-1506064885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e6c7bf2-e105-47fd-a828-ce3b65221e5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:37:02 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-1cf1499b-7706-4239-a9a8-8ebfdf0882ad tempest-SnapshotsActionsTest-1506064885 None] Flow 'volume_create_manager' (95555811-9d9a-4253-bfcc-c069ce752add) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:37:02 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-1cf1499b-7706-4239-a9a8-8ebfdf0882ad tempest-SnapshotsActionsTest-1506064885 None] Created volume successfully. Sep 23 14:37:02 devstack sudo[93502]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:02 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-24196710-b35f-4cbe-a56f-6b2ba775f57f tempest-GroupSnapshotsTest-1878904240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2d36a772-334f-4a5c-81c0-944d4e27bcfe.e2d421b7-7152-462f-b270-b79652cd780e" returned: 0 in 0.417s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:02 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-24196710-b35f-4cbe-a56f-6b2ba775f57f tempest-GroupSnapshotsTest-1878904240 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2d36a772-334f-4a5c-81c0-944d4e27bcfe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 14:37:02 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa558181-edf6-4d29-b73d-18604acbb26d]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:37:02 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-24196710-b35f-4cbe-a56f-6b2ba775f57f tempest-GroupSnapshotsTest-1878904240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2d36a772-334f-4a5c-81c0-944d4e27bcfe {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:02 devstack sudo[93503]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:02 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [req-3784c658-193a-43a4-a229-428cc2fe98ae req-e46040fc-2946-47af-be07-92f8ad2b0877 tempest-VolumesSnapshotsTestJSON-1398247517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-80237416-b7e4-42f6-85ed-3ee614169a5f" returned: 0 in 0.455s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:02 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [req-3784c658-193a-43a4-a229-428cc2fe98ae req-e46040fc-2946-47af-be07-92f8ad2b0877 tempest-VolumesSnapshotsTestJSON-1398247517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-80237416-b7e4-42f6-85ed-3ee614169a5f.810e1a12-e66f-48de-85cb-d0d23436bda9 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:02 devstack sudo[93519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-80237416-b7e4-42f6-85ed-3ee614169a5f.810e1a12-e66f-48de-85cb-d0d23436bda9 Sep 23 14:37:02 devstack sudo[93519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:02 devstack sudo[93517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2d36a772-334f-4a5c-81c0-944d4e27bcfe Sep 23 14:37:02 devstack sudo[93517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:02 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-190c90b6-34b8-4e8e-90dd-557ef2079e51 tempest-AttachVolumeTestJSON-760750814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:37:02 devstack sudo[93519]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:02 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-190c90b6-34b8-4e8e-90dd-557ef2079e51 tempest-AttachVolumeTestJSON-760750814 None] Flow 'volume_create_manager' (c5eae4fd-e308-4b48-a610-0b67fa62c068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:37:02 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-190c90b6-34b8-4e8e-90dd-557ef2079e51 tempest-AttachVolumeTestJSON-760750814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abe06551-fe9a-4038-8f1c-a2334378d14c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:37:02 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [req-3784c658-193a-43a4-a229-428cc2fe98ae req-e46040fc-2946-47af-be07-92f8ad2b0877 tempest-VolumesSnapshotsTestJSON-1398247517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-80237416-b7e4-42f6-85ed-3ee614169a5f.810e1a12-e66f-48de-85cb-d0d23436bda9" returned: 0 in 0.449s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:02 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [req-3784c658-193a-43a4-a229-428cc2fe98ae req-e46040fc-2946-47af-be07-92f8ad2b0877 tempest-VolumesSnapshotsTestJSON-1398247517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-80237416-b7e4-42f6-85ed-3ee614169a5f.810e1a12-e66f-48de-85cb-d0d23436bda9 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:02 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-190c90b6-34b8-4e8e-90dd-557ef2079e51 tempest-AttachVolumeTestJSON-760750814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abe06551-fe9a-4038-8f1c-a2334378d14c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:37:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-404160808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b1b5b1d-2346-4dbf-9051-e7d92a4c6aec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='296c240cb76d4b8883f8994e35b4ce87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:37:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:37:03Z,use_quota=True,user_id='dd9cafb3b16d490d97bb60aee7723a4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:37:02 devstack sudo[93527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-80237416-b7e4-42f6-85ed-3ee614169a5f.810e1a12-e66f-48de-85cb-d0d23436bda9 Sep 23 14:37:02 devstack sudo[93527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:02 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-190c90b6-34b8-4e8e-90dd-557ef2079e51 tempest-AttachVolumeTestJSON-760750814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32d0f5ea-94db-4fbd-a646-a7cbf49493f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:37:02 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-190c90b6-34b8-4e8e-90dd-557ef2079e51 tempest-AttachVolumeTestJSON-760750814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32d0f5ea-94db-4fbd-a646-a7cbf49493f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:37:02 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-190c90b6-34b8-4e8e-90dd-557ef2079e51 tempest-AttachVolumeTestJSON-760750814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78df33ce-aa8e-4248-8d13-7cdaad9aefd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:37:02 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-190c90b6-34b8-4e8e-90dd-557ef2079e51 tempest-AttachVolumeTestJSON-760750814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78df33ce-aa8e-4248-8d13-7cdaad9aefd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b1b5b1d-2346-4dbf-9051-e7d92a4c6aec', 'volume_name': 'volume-1b1b5b1d-2346-4dbf-9051-e7d92a4c6aec', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:37:02 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-190c90b6-34b8-4e8e-90dd-557ef2079e51 tempest-AttachVolumeTestJSON-760750814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3ed8961-c91b-4c83-9478-4f372b4cb618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:37:02 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-190c90b6-34b8-4e8e-90dd-557ef2079e51 tempest-AttachVolumeTestJSON-760750814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3ed8961-c91b-4c83-9478-4f372b4cb618) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:37:02 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-190c90b6-34b8-4e8e-90dd-557ef2079e51 tempest-AttachVolumeTestJSON-760750814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfbdaa5b-1171-4468-a4dd-0587bd864773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:37:02 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-190c90b6-34b8-4e8e-90dd-557ef2079e51 tempest-AttachVolumeTestJSON-760750814 None] Volume 1b1b5b1d-2346-4dbf-9051-e7d92a4c6aec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b1b5b1d-2346-4dbf-9051-e7d92a4c6aec', 'volume_size': 1} Sep 23 14:37:02 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-190c90b6-34b8-4e8e-90dd-557ef2079e51 tempest-AttachVolumeTestJSON-760750814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:37:02 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-190c90b6-34b8-4e8e-90dd-557ef2079e51 tempest-AttachVolumeTestJSON-760750814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:37:02 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-190c90b6-34b8-4e8e-90dd-557ef2079e51 tempest-AttachVolumeTestJSON-760750814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:37:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-404160808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b1b5b1d-2346-4dbf-9051-e7d92a4c6aec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='296c240cb76d4b8883f8994e35b4ce87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:37:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:37:03Z,use_quota=True,user_id='dd9cafb3b16d490d97bb60aee7723a4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:37:02 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-190c90b6-34b8-4e8e-90dd-557ef2079e51 tempest-AttachVolumeTestJSON-760750814 None] Creating volume 1b1b5b1d-2346-4dbf-9051-e7d92a4c6aec {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:37:02 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-190c90b6-34b8-4e8e-90dd-557ef2079e51 tempest-AttachVolumeTestJSON-760750814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:37:02 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-190c90b6-34b8-4e8e-90dd-557ef2079e51 tempest-AttachVolumeTestJSON-760750814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:37:02 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-190c90b6-34b8-4e8e-90dd-557ef2079e51 tempest-AttachVolumeTestJSON-760750814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:37:02 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-190c90b6-34b8-4e8e-90dd-557ef2079e51 tempest-AttachVolumeTestJSON-760750814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:37:02 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-190c90b6-34b8-4e8e-90dd-557ef2079e51 tempest-AttachVolumeTestJSON-760750814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:37:02 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-190c90b6-34b8-4e8e-90dd-557ef2079e51 tempest-AttachVolumeTestJSON-760750814 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:37:02 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-190c90b6-34b8-4e8e-90dd-557ef2079e51 tempest-AttachVolumeTestJSON-760750814 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:37:02 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-190c90b6-34b8-4e8e-90dd-557ef2079e51 tempest-AttachVolumeTestJSON-760750814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-1b1b5b1d-2346-4dbf-9051-e7d92a4c6aec 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:02 devstack sudo[93517]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:02 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-24196710-b35f-4cbe-a56f-6b2ba775f57f tempest-GroupSnapshotsTest-1878904240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2d36a772-334f-4a5c-81c0-944d4e27bcfe" returned: 0 in 0.622s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:02 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-24196710-b35f-4cbe-a56f-6b2ba775f57f tempest-GroupSnapshotsTest-1878904240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2d36a772-334f-4a5c-81c0-944d4e27bcfe.e2d421b7-7152-462f-b270-b79652cd780e {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:02 devstack sudo[93530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-1b1b5b1d-2346-4dbf-9051-e7d92a4c6aec 1073741824 Sep 23 14:37:02 devstack sudo[93530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:02 devstack sudo[93531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2d36a772-334f-4a5c-81c0-944d4e27bcfe.e2d421b7-7152-462f-b270-b79652cd780e Sep 23 14:37:02 devstack sudo[93531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:02 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-a16b0e39-b743-4106-9728-e15d46a96327 tempest-SnapshotsActionsTest-1506064885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:37:03 devstack sudo[93527]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:03 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [req-3784c658-193a-43a4-a229-428cc2fe98ae req-e46040fc-2946-47af-be07-92f8ad2b0877 tempest-VolumesSnapshotsTestJSON-1398247517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-80237416-b7e4-42f6-85ed-3ee614169a5f.810e1a12-e66f-48de-85cb-d0d23436bda9" returned: 0 in 0.306s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:03 devstack cinder-volume[86310]: DEBUG cinder.coordination [req-3784c658-193a-43a4-a229-428cc2fe98ae req-e46040fc-2946-47af-be07-92f8ad2b0877 tempest-VolumesSnapshotsTestJSON-1398247517 None] Lock "cinder-quobyte-810e1a12-e66f-48de-85cb-d0d23436bda9" released by "_delete_snapshot" :: held 1.860s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:37:03 devstack cinder-volume[86310]: DEBUG cinder.coordination [req-3784c658-193a-43a4-a229-428cc2fe98ae req-e46040fc-2946-47af-be07-92f8ad2b0877 tempest-VolumesSnapshotsTestJSON-1398247517 None] Lock "cinder-quobyte-80237416-b7e4-42f6-85ed-3ee614169a5f" released by "delete_snapshot" :: held 1.898s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:37:03 devstack cinder-volume[86310]: WARNING cinder.quota [req-3784c658-193a-43a4-a229-428cc2fe98ae req-e46040fc-2946-47af-be07-92f8ad2b0877 tempest-VolumesSnapshotsTestJSON-1398247517 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 23 14:37:03 devstack cinder-volume[86310]: DEBUG cinder.quota [req-3784c658-193a-43a4-a229-428cc2fe98ae req-e46040fc-2946-47af-be07-92f8ad2b0877 tempest-VolumesSnapshotsTestJSON-1398247517 None] Created reservations ['5a001dd1-ec25-4429-b1eb-be59d7e8e7f7', '929161dd-7805-4f38-9af2-0ac9fd709af2', 'b9fb94cb-f834-4511-a909-bfcce9a0254d', 'bb09c0b7-f0e2-4279-bca6-2137f127b4e8'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:37:03 devstack sudo[93531]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:03 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-24196710-b35f-4cbe-a56f-6b2ba775f57f tempest-GroupSnapshotsTest-1878904240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2d36a772-334f-4a5c-81c0-944d4e27bcfe.e2d421b7-7152-462f-b270-b79652cd780e" returned: 0 in 0.407s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:03 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-24196710-b35f-4cbe-a56f-6b2ba775f57f tempest-GroupSnapshotsTest-1878904240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2d36a772-334f-4a5c-81c0-944d4e27bcfe.e2d421b7-7152-462f-b270-b79652cd780e {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:03 devstack sudo[93542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2d36a772-334f-4a5c-81c0-944d4e27bcfe.e2d421b7-7152-462f-b270-b79652cd780e Sep 23 14:37:03 devstack sudo[93542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:03 devstack cinder-volume[86310]: INFO cinder.volume.manager [req-3784c658-193a-43a4-a229-428cc2fe98ae req-e46040fc-2946-47af-be07-92f8ad2b0877 tempest-VolumesSnapshotsTestJSON-1398247517 None] Delete snapshot completed successfully. Sep 23 14:37:03 devstack cinder-volume[86310]: DEBUG cinder.coordination [req-3784c658-193a-43a4-a229-428cc2fe98ae req-e46040fc-2946-47af-be07-92f8ad2b0877 tempest-VolumesSnapshotsTestJSON-1398247517 None] Lock "cinder-810e1a12-e66f-48de-85cb-d0d23436bda9-delete_snapshot" released by "delete_snapshot" :: held 2.138s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:37:03 devstack sudo[93530]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:03 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-190c90b6-34b8-4e8e-90dd-557ef2079e51 tempest-AttachVolumeTestJSON-760750814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-1b1b5b1d-2346-4dbf-9051-e7d92a4c6aec 1073741824" returned: 0 in 0.549s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:03 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-190c90b6-34b8-4e8e-90dd-557ef2079e51 tempest-AttachVolumeTestJSON-760750814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-1b1b5b1d-2346-4dbf-9051-e7d92a4c6aec {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:03 devstack sudo[93544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-1b1b5b1d-2346-4dbf-9051-e7d92a4c6aec Sep 23 14:37:03 devstack sudo[93544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:03 devstack cinder-volume[86310]: DEBUG cinder.coordination [req-a707e917-25ce-4e13-a542-653a83eaef05 req-f5145f0c-1737-4e0b-ad90-3572cd56c0b8 tempest-VolumesSnapshotsTestJSON-1398247517 None] Acquiring lock "cinder-80237416-b7e4-42f6-85ed-3ee614169a5f-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:37:03 devstack cinder-volume[86310]: DEBUG cinder.coordination [req-a707e917-25ce-4e13-a542-653a83eaef05 req-f5145f0c-1737-4e0b-ad90-3572cd56c0b8 tempest-VolumesSnapshotsTestJSON-1398247517 None] Lock "cinder-80237416-b7e4-42f6-85ed-3ee614169a5f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:37:03 devstack cinder-volume[86310]: DEBUG cinder.coordination [req-a707e917-25ce-4e13-a542-653a83eaef05 req-f5145f0c-1737-4e0b-ad90-3572cd56c0b8 tempest-VolumesSnapshotsTestJSON-1398247517 None] Acquiring lock "cinder-quobyte-80237416-b7e4-42f6-85ed-3ee614169a5f" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:37:03 devstack sudo[93542]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:03 devstack cinder-volume[86310]: DEBUG cinder.coordination [req-a707e917-25ce-4e13-a542-653a83eaef05 req-f5145f0c-1737-4e0b-ad90-3572cd56c0b8 tempest-VolumesSnapshotsTestJSON-1398247517 None] Lock "cinder-quobyte-80237416-b7e4-42f6-85ed-3ee614169a5f" acquired by "delete_volume" :: waited 0.023s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:37:03 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-24196710-b35f-4cbe-a56f-6b2ba775f57f tempest-GroupSnapshotsTest-1878904240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2d36a772-334f-4a5c-81c0-944d4e27bcfe.e2d421b7-7152-462f-b270-b79652cd780e" returned: 0 in 0.334s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:03 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[afbf1126-4450-4e04-9df6-a009df0a004c]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:37:03 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [req-a707e917-25ce-4e13-a542-653a83eaef05 req-f5145f0c-1737-4e0b-ad90-3572cd56c0b8 tempest-VolumesSnapshotsTestJSON-1398247517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-80237416-b7e4-42f6-85ed-3ee614169a5f {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:03 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-24196710-b35f-4cbe-a56f-6b2ba775f57f tempest-GroupSnapshotsTest-1878904240 None] Lock "cinder-quobyte-e2d421b7-7152-462f-b270-b79652cd780e" released by "_delete_snapshot" :: held 1.919s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:37:03 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-24196710-b35f-4cbe-a56f-6b2ba775f57f tempest-GroupSnapshotsTest-1878904240 None] Lock "cinder-quobyte-2d36a772-334f-4a5c-81c0-944d4e27bcfe" released by "delete_snapshot" :: held 1.952s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:37:03 devstack cinder-volume[86310]: WARNING cinder.quota [None req-24196710-b35f-4cbe-a56f-6b2ba775f57f tempest-GroupSnapshotsTest-1878904240 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1910690137 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1910690137, it is now deprecated. Please use the default quota class for default quota. Sep 23 14:37:03 devstack sudo[93544]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:03 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-190c90b6-34b8-4e8e-90dd-557ef2079e51 tempest-AttachVolumeTestJSON-760750814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-1b1b5b1d-2346-4dbf-9051-e7d92a4c6aec" returned: 0 in 0.304s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:03 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-190c90b6-34b8-4e8e-90dd-557ef2079e51 tempest-AttachVolumeTestJSON-760750814 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:37:03 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-190c90b6-34b8-4e8e-90dd-557ef2079e51 tempest-AttachVolumeTestJSON-760750814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:37:03 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-a16b0e39-b743-4106-9728-e15d46a96327 tempest-SnapshotsActionsTest-1506064885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.792s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:37:03 devstack sudo[93547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-80237416-b7e4-42f6-85ed-3ee614169a5f Sep 23 14:37:03 devstack sudo[93547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:03 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-190c90b6-34b8-4e8e-90dd-557ef2079e51 tempest-AttachVolumeTestJSON-760750814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfbdaa5b-1171-4468-a4dd-0587bd864773) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b1b5b1d-2346-4dbf-9051-e7d92a4c6aec', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:37:03 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-190c90b6-34b8-4e8e-90dd-557ef2079e51 tempest-AttachVolumeTestJSON-760750814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae812d1e-2a61-4482-b5e9-3775c803d660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:37:03 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-24196710-b35f-4cbe-a56f-6b2ba775f57f tempest-GroupSnapshotsTest-1878904240 None] Created reservations ['06d7bd9a-3d6a-4a35-b75e-beb02867fa72', '83920d6b-2be8-4bee-88af-d5954d435e66', '6d8c50aa-136c-4482-8058-ee618c8f81c9', '4dc0af76-854f-4ef0-a8cc-c41434b1c12d'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:37:03 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-a16b0e39-b743-4106-9728-e15d46a96327 tempest-SnapshotsActionsTest-1506064885 None] Creating offline snapshot 92c1f448-97e4-498b-8f82-cff2a39ed421 of volume fdca4f83-4751-4786-a502-ff3a27b0a1da {{(pid=86310) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 14:37:03 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-190c90b6-34b8-4e8e-90dd-557ef2079e51 tempest-AttachVolumeTestJSON-760750814 None] Volume volume-1b1b5b1d-2346-4dbf-9051-e7d92a4c6aec (1b1b5b1d-2346-4dbf-9051-e7d92a4c6aec): created successfully Sep 23 14:37:03 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-190c90b6-34b8-4e8e-90dd-557ef2079e51 tempest-AttachVolumeTestJSON-760750814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae812d1e-2a61-4482-b5e9-3775c803d660) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:37:03 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-190c90b6-34b8-4e8e-90dd-557ef2079e51 tempest-AttachVolumeTestJSON-760750814 None] Flow 'volume_create_manager' (c5eae4fd-e308-4b48-a610-0b67fa62c068) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:37:03 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e9dd3d5-38e0-4152-b1be-ed0bb7c217e4]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:37:03 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a16b0e39-b743-4106-9728-e15d46a96327 tempest-SnapshotsActionsTest-1506064885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:03 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-190c90b6-34b8-4e8e-90dd-557ef2079e51 tempest-AttachVolumeTestJSON-760750814 None] Created volume successfully. Sep 23 14:37:03 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-24196710-b35f-4cbe-a56f-6b2ba775f57f tempest-GroupSnapshotsTest-1878904240 None] group_snapshot bdd914d1-9c84-416b-998b-50a65b755309: deleted successfully Sep 23 14:37:03 devstack sudo[93550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da Sep 23 14:37:03 devstack sudo[93550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:04 devstack sudo[93547]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:04 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [req-a707e917-25ce-4e13-a542-653a83eaef05 req-f5145f0c-1737-4e0b-ad90-3572cd56c0b8 tempest-VolumesSnapshotsTestJSON-1398247517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-80237416-b7e4-42f6-85ed-3ee614169a5f" returned: 0 in 0.420s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:04 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [req-a707e917-25ce-4e13-a542-653a83eaef05 req-f5145f0c-1737-4e0b-ad90-3572cd56c0b8 tempest-VolumesSnapshotsTestJSON-1398247517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-80237416-b7e4-42f6-85ed-3ee614169a5f {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:04 devstack sudo[93555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-80237416-b7e4-42f6-85ed-3ee614169a5f Sep 23 14:37:04 devstack sudo[93555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:04 devstack sudo[93550]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:04 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a16b0e39-b743-4106-9728-e15d46a96327 tempest-SnapshotsActionsTest-1506064885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da" returned: 0 in 0.398s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:04 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a16b0e39-b743-4106-9728-e15d46a96327 tempest-SnapshotsActionsTest-1506064885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.92c1f448-97e4-498b-8f82-cff2a39ed421 1G {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:04 devstack sudo[93561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.92c1f448-97e4-498b-8f82-cff2a39ed421 1G Sep 23 14:37:04 devstack sudo[93561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:04 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-922b7bc1-2f54-47e8-8a7f-5bf94d73f914 tempest-GroupSnapshotsTest-1878904240 None] Acquiring lock "cinder-quobyte-2d36a772-334f-4a5c-81c0-944d4e27bcfe" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:37:04 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-922b7bc1-2f54-47e8-8a7f-5bf94d73f914 tempest-GroupSnapshotsTest-1878904240 None] Lock "cinder-quobyte-2d36a772-334f-4a5c-81c0-944d4e27bcfe" acquired by "delete_volume" :: waited 0.020s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:37:04 devstack sudo[93555]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:04 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [req-a707e917-25ce-4e13-a542-653a83eaef05 req-f5145f0c-1737-4e0b-ad90-3572cd56c0b8 tempest-VolumesSnapshotsTestJSON-1398247517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-80237416-b7e4-42f6-85ed-3ee614169a5f" returned: 0 in 0.305s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:04 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[6381c1eb-247e-4a5c-b84c-840ab0dbd602]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:37:04 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-922b7bc1-2f54-47e8-8a7f-5bf94d73f914 tempest-GroupSnapshotsTest-1878904240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2d36a772-334f-4a5c-81c0-944d4e27bcfe {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:04 devstack cinder-volume[86310]: DEBUG cinder.coordination [req-a707e917-25ce-4e13-a542-653a83eaef05 req-f5145f0c-1737-4e0b-ad90-3572cd56c0b8 tempest-VolumesSnapshotsTestJSON-1398247517 None] Lock "cinder-quobyte-80237416-b7e4-42f6-85ed-3ee614169a5f" released by "delete_volume" :: held 0.824s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:37:04 devstack cinder-volume[86310]: DEBUG cinder.quota [req-a707e917-25ce-4e13-a542-653a83eaef05 req-f5145f0c-1737-4e0b-ad90-3572cd56c0b8 tempest-VolumesSnapshotsTestJSON-1398247517 None] Created reservations ['ed81570f-e743-435d-953a-6d4fafc01d8f', 'c1d555fa-d17a-402a-a8e2-b75de74b7ea3', '8af895da-65e1-4654-8971-146b03e08154', '005221b9-b925-4051-bdf3-27b6e45fe695'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:37:04 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [req-a707e917-25ce-4e13-a542-653a83eaef05 req-f5145f0c-1737-4e0b-ad90-3572cd56c0b8 tempest-VolumesSnapshotsTestJSON-1398247517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:37:04 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [req-a707e917-25ce-4e13-a542-653a83eaef05 req-f5145f0c-1737-4e0b-ad90-3572cd56c0b8 tempest-VolumesSnapshotsTestJSON-1398247517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:37:04 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [req-a707e917-25ce-4e13-a542-653a83eaef05 req-f5145f0c-1737-4e0b-ad90-3572cd56c0b8 tempest-VolumesSnapshotsTestJSON-1398247517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:37:04 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [req-a707e917-25ce-4e13-a542-653a83eaef05 req-f5145f0c-1737-4e0b-ad90-3572cd56c0b8 tempest-VolumesSnapshotsTestJSON-1398247517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:37:04 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [req-a707e917-25ce-4e13-a542-653a83eaef05 req-f5145f0c-1737-4e0b-ad90-3572cd56c0b8 tempest-VolumesSnapshotsTestJSON-1398247517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:37:04 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [req-a707e917-25ce-4e13-a542-653a83eaef05 req-f5145f0c-1737-4e0b-ad90-3572cd56c0b8 tempest-VolumesSnapshotsTestJSON-1398247517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:04 devstack sudo[93564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2d36a772-334f-4a5c-81c0-944d4e27bcfe Sep 23 14:37:04 devstack sudo[93564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:04 devstack sudo[93568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:37:04 devstack sudo[93568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:04 devstack sudo[93561]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:04 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a16b0e39-b743-4106-9728-e15d46a96327 tempest-SnapshotsActionsTest-1506064885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.92c1f448-97e4-498b-8f82-cff2a39ed421 1G" returned: 0 in 0.544s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:04 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a16b0e39-b743-4106-9728-e15d46a96327 tempest-SnapshotsActionsTest-1506064885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fdca4f83-4751-4786-a502-ff3a27b0a1da -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.92c1f448-97e4-498b-8f82-cff2a39ed421 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:04 devstack sudo[93575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fdca4f83-4751-4786-a502-ff3a27b0a1da -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.92c1f448-97e4-498b-8f82-cff2a39ed421 Sep 23 14:37:04 devstack sudo[93575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:04 devstack sudo[93568]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:04 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [req-a707e917-25ce-4e13-a542-653a83eaef05 req-f5145f0c-1737-4e0b-ad90-3572cd56c0b8 tempest-VolumesSnapshotsTestJSON-1398247517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.370s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:04 devstack cinder-volume[86310]: DEBUG cinder.manager [req-a707e917-25ce-4e13-a542-653a83eaef05 req-f5145f0c-1737-4e0b-ad90-3572cd56c0b8 tempest-VolumesSnapshotsTestJSON-1398247517 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:37:04 devstack sudo[93564]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:04 devstack cinder-volume[86310]: INFO cinder.volume.manager [req-a707e917-25ce-4e13-a542-653a83eaef05 req-f5145f0c-1737-4e0b-ad90-3572cd56c0b8 tempest-VolumesSnapshotsTestJSON-1398247517 None] Deleted volume successfully. Sep 23 14:37:04 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-922b7bc1-2f54-47e8-8a7f-5bf94d73f914 tempest-GroupSnapshotsTest-1878904240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2d36a772-334f-4a5c-81c0-944d4e27bcfe" returned: 0 in 0.530s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:04 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-922b7bc1-2f54-47e8-8a7f-5bf94d73f914 tempest-GroupSnapshotsTest-1878904240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2d36a772-334f-4a5c-81c0-944d4e27bcfe {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:04 devstack sudo[93578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2d36a772-334f-4a5c-81c0-944d4e27bcfe Sep 23 14:37:04 devstack sudo[93578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:04 devstack cinder-volume[86310]: DEBUG cinder.coordination [req-a707e917-25ce-4e13-a542-653a83eaef05 req-f5145f0c-1737-4e0b-ad90-3572cd56c0b8 tempest-VolumesSnapshotsTestJSON-1398247517 None] Lock "cinder-80237416-b7e4-42f6-85ed-3ee614169a5f-delete_volume" released by "delete_volume" :: held 1.490s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:37:05 devstack sudo[93578]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:05 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-922b7bc1-2f54-47e8-8a7f-5bf94d73f914 tempest-GroupSnapshotsTest-1878904240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2d36a772-334f-4a5c-81c0-944d4e27bcfe" returned: 0 in 0.333s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:05 devstack sudo[93575]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:05 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a16b0e39-b743-4106-9728-e15d46a96327 tempest-SnapshotsActionsTest-1506064885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fdca4f83-4751-4786-a502-ff3a27b0a1da -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.92c1f448-97e4-498b-8f82-cff2a39ed421" returned: 0 in 0.493s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:05 devstack cinder-volume[86310]: WARNING cinder.volume.drivers.remotefs [None req-a16b0e39-b743-4106-9728-e15d46a96327 tempest-SnapshotsActionsTest-1506064885 None] /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.92c1f448-97e4-498b-8f82-cff2a39ed421 is being set with open permissions: ugo+rw Sep 23 14:37:05 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a16b0e39-b743-4106-9728-e15d46a96327 tempest-SnapshotsActionsTest-1506064885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.92c1f448-97e4-498b-8f82-cff2a39ed421 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:05 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-922b7bc1-2f54-47e8-8a7f-5bf94d73f914 tempest-GroupSnapshotsTest-1878904240 None] Lock "cinder-quobyte-2d36a772-334f-4a5c-81c0-944d4e27bcfe" released by "delete_volume" :: held 0.950s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:37:05 devstack sudo[93589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.92c1f448-97e4-498b-8f82-cff2a39ed421 Sep 23 14:37:05 devstack sudo[93589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:05 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-922b7bc1-2f54-47e8-8a7f-5bf94d73f914 tempest-GroupSnapshotsTest-1878904240 None] Created reservations ['fbf078b7-a35a-4d4a-827b-1a4c4d62d7ba'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:37:05 devstack cinder-volume[86310]: WARNING cinder.db.api [None req-922b7bc1-2f54-47e8-8a7f-5bf94d73f914 tempest-GroupSnapshotsTest-1878904240 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1910690137'] Sep 23 14:37:05 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-922b7bc1-2f54-47e8-8a7f-5bf94d73f914 tempest-GroupSnapshotsTest-1878904240 None] Created reservations ['36aa22f9-552b-465a-9dd1-7bd4d90ad12d', '8cf01691-f72b-4506-8f42-a16725cd1cdb', 'dd2354ee-35d4-44af-83c8-399d06b9a074', '5d136cd1-a511-4fbc-9389-1fb91d63340b'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:37:05 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-922b7bc1-2f54-47e8-8a7f-5bf94d73f914 tempest-GroupSnapshotsTest-1878904240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:37:05 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-922b7bc1-2f54-47e8-8a7f-5bf94d73f914 tempest-GroupSnapshotsTest-1878904240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:37:05 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-922b7bc1-2f54-47e8-8a7f-5bf94d73f914 tempest-GroupSnapshotsTest-1878904240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:37:05 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-922b7bc1-2f54-47e8-8a7f-5bf94d73f914 tempest-GroupSnapshotsTest-1878904240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:37:05 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-922b7bc1-2f54-47e8-8a7f-5bf94d73f914 tempest-GroupSnapshotsTest-1878904240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:37:05 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-922b7bc1-2f54-47e8-8a7f-5bf94d73f914 tempest-GroupSnapshotsTest-1878904240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:05 devstack sudo[93592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:37:05 devstack sudo[93592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:05 devstack sudo[93589]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:05 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a16b0e39-b743-4106-9728-e15d46a96327 tempest-SnapshotsActionsTest-1506064885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.92c1f448-97e4-498b-8f82-cff2a39ed421" returned: 0 in 0.363s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:05 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a16b0e39-b743-4106-9728-e15d46a96327 tempest-SnapshotsActionsTest-1506064885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.info {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:05 devstack sudo[93595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.info Sep 23 14:37:05 devstack sudo[93595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:05 devstack sudo[93592]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:05 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-922b7bc1-2f54-47e8-8a7f-5bf94d73f914 tempest-GroupSnapshotsTest-1878904240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.336s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:05 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-922b7bc1-2f54-47e8-8a7f-5bf94d73f914 tempest-GroupSnapshotsTest-1878904240 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:37:05 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-922b7bc1-2f54-47e8-8a7f-5bf94d73f914 tempest-GroupSnapshotsTest-1878904240 None] Delete group completed successfully. Sep 23 14:37:05 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [req-b7ed3a67-0e46-479d-8ce9-c760771b2f94 req-160b4b98-e19f-4949-8a16-5d64f76ed049 tempest-AttachVolumeTestJSON-760750814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:37:06 devstack sudo[93595]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:06 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a16b0e39-b743-4106-9728-e15d46a96327 tempest-SnapshotsActionsTest-1506064885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.info" returned: 0 in 0.316s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:06 devstack cinder-volume[86310]: WARNING cinder.volume.drivers.remotefs [None req-a16b0e39-b743-4106-9728-e15d46a96327 tempest-SnapshotsActionsTest-1506064885 None] /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.info is being set with open permissions: ugo+rw Sep 23 14:37:06 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a16b0e39-b743-4106-9728-e15d46a96327 tempest-SnapshotsActionsTest-1506064885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.info {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:06 devstack sudo[93607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.info Sep 23 14:37:06 devstack sudo[93607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:06 devstack sudo[93607]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:06 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a16b0e39-b743-4106-9728-e15d46a96327 tempest-SnapshotsActionsTest-1506064885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.info" returned: 0 in 0.253s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:06 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-a16b0e39-b743-4106-9728-e15d46a96327 tempest-SnapshotsActionsTest-1506064885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.529s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:37:06 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [req-b7ed3a67-0e46-479d-8ce9-c760771b2f94 req-160b4b98-e19f-4949-8a16-5d64f76ed049 tempest-AttachVolumeTestJSON-760750814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.291s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:37:06 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [req-b7ed3a67-0e46-479d-8ce9-c760771b2f94 req-160b4b98-e19f-4949-8a16-5d64f76ed049 tempest-AttachVolumeTestJSON-760750814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:37:06 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-a16b0e39-b743-4106-9728-e15d46a96327 tempest-SnapshotsActionsTest-1506064885 None] Create snapshot completed successfully Sep 23 14:37:06 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [req-b7ed3a67-0e46-479d-8ce9-c760771b2f94 req-160b4b98-e19f-4949-8a16-5d64f76ed049 tempest-AttachVolumeTestJSON-760750814 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362', 'name': 'volume-1b1b5b1d-2346-4dbf-9051-e7d92a4c6aec', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '16c40ee1-135f-4e8e-991c-2342f384e025', 'enforce_multipath': True} {{(pid=86310) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 14:37:06 devstack cinder-volume[86310]: INFO cinder.volume.manager [req-b7ed3a67-0e46-479d-8ce9-c760771b2f94 req-160b4b98-e19f-4949-8a16-5d64f76ed049 tempest-AttachVolumeTestJSON-760750814 None] attachment_update completed successfully. Sep 23 14:37:07 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-fa263b8d-12a8-4839-84aa-ddcebeafc92f tempest-GroupSnapshotsTest-1878904240 None] Group tempest-GroupSnapshotsTest-Group-787413432: creating Sep 23 14:37:07 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-fa263b8d-12a8-4839-84aa-ddcebeafc92f tempest-GroupSnapshotsTest-1878904240 None] Group tempest-GroupSnapshotsTest-Group-787413432: created successfully Sep 23 14:37:07 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-fa263b8d-12a8-4839-84aa-ddcebeafc92f tempest-GroupSnapshotsTest-1878904240 None] Create group completed successfully. Sep 23 14:37:07 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-06d4f009-6ff3-4a19-9601-b2414510e3c9 tempest-SnapshotsActionsTest-1506064885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:37:07 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-06d4f009-6ff3-4a19-9601-b2414510e3c9 tempest-SnapshotsActionsTest-1506064885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:37:07 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-06d4f009-6ff3-4a19-9601-b2414510e3c9 tempest-SnapshotsActionsTest-1506064885 None] Creating offline snapshot a9f4d524-a7e1-49bf-a7c1-bd889218020a of volume fdca4f83-4751-4786-a502-ff3a27b0a1da {{(pid=86310) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 14:37:07 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7ef25e8-8e0a-4953-9dcf-2f0945c5268c]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:37:07 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-06d4f009-6ff3-4a19-9601-b2414510e3c9 tempest-SnapshotsActionsTest-1506064885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.92c1f448-97e4-498b-8f82-cff2a39ed421 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:08 devstack sudo[94022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.92c1f448-97e4-498b-8f82-cff2a39ed421 Sep 23 14:37:08 devstack sudo[94022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:08 devstack sudo[94022]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:08 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-06d4f009-6ff3-4a19-9601-b2414510e3c9 tempest-SnapshotsActionsTest-1506064885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.92c1f448-97e4-498b-8f82-cff2a39ed421" returned: 0 in 0.540s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:08 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-06d4f009-6ff3-4a19-9601-b2414510e3c9 tempest-SnapshotsActionsTest-1506064885 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fdca4f83-4751-4786-a502-ff3a27b0a1da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 14:37:08 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-06d4f009-6ff3-4a19-9601-b2414510e3c9 tempest-SnapshotsActionsTest-1506064885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.92c1f448-97e4-498b-8f82-cff2a39ed421,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.a9f4d524-a7e1-49bf-a7c1-bd889218020a 1G {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:08 devstack sudo[94030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.92c1f448-97e4-498b-8f82-cff2a39ed421,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.a9f4d524-a7e1-49bf-a7c1-bd889218020a 1G Sep 23 14:37:08 devstack sudo[94030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:09 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae251d9f-f016-49d1-ae0c-a53bcd883f88 tempest-GroupSnapshotsTest-1878904240 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:37:09 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-ae251d9f-f016-49d1-ae0c-a53bcd883f88 tempest-GroupSnapshotsTest-1878904240 None] Flow 'volume_create_manager' (9e449442-e41d-48d2-ac0d-164f9723abb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:37:09 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-ae251d9f-f016-49d1-ae0c-a53bcd883f88 tempest-GroupSnapshotsTest-1878904240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20760051-2609-45a2-b360-ac2ede96ce60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:37:09 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-ae251d9f-f016-49d1-ae0c-a53bcd883f88 tempest-GroupSnapshotsTest-1878904240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20760051-2609-45a2-b360-ac2ede96ce60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:37:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1564408040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5b0def4c-aab2-40ad-89af-2a62558607c1,host='devstack@QuobyteHD#QuobyteHD',id=d2659de0-7a93-403b-a04f-62e2404f8b95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2999c542f573402d95e56f45bd48a68f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:37:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:37:09Z,use_quota=True,user_id='084cc64e7b844f9992be81b9145ff791',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9832bd8-22c1-4c83-a691-dfff9887dfaa),volume_type_id=c9832bd8-22c1-4c83-a691-dfff9887dfaa)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:37:09 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-ae251d9f-f016-49d1-ae0c-a53bcd883f88 tempest-GroupSnapshotsTest-1878904240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c78f6f88-7084-42dd-a5e4-38c93c90b186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:37:09 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-ae251d9f-f016-49d1-ae0c-a53bcd883f88 tempest-GroupSnapshotsTest-1878904240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c78f6f88-7084-42dd-a5e4-38c93c90b186) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:37:09 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-ae251d9f-f016-49d1-ae0c-a53bcd883f88 tempest-GroupSnapshotsTest-1878904240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d7f7318-c2b8-44c9-85ba-d37cec98dc6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:37:09 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-ae251d9f-f016-49d1-ae0c-a53bcd883f88 tempest-GroupSnapshotsTest-1878904240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d7f7318-c2b8-44c9-85ba-d37cec98dc6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2659de0-7a93-403b-a04f-62e2404f8b95', 'volume_name': 'volume-d2659de0-7a93-403b-a04f-62e2404f8b95', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:37:09 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-ae251d9f-f016-49d1-ae0c-a53bcd883f88 tempest-GroupSnapshotsTest-1878904240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e3c9138-411a-412f-8e0b-b592d5fe4b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:37:09 devstack sudo[94030]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:09 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-ae251d9f-f016-49d1-ae0c-a53bcd883f88 tempest-GroupSnapshotsTest-1878904240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e3c9138-411a-412f-8e0b-b592d5fe4b38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:37:09 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-ae251d9f-f016-49d1-ae0c-a53bcd883f88 tempest-GroupSnapshotsTest-1878904240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8621ea7-d58c-434d-81e2-2cfcb986d0e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:37:09 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-ae251d9f-f016-49d1-ae0c-a53bcd883f88 tempest-GroupSnapshotsTest-1878904240 None] Volume d2659de0-7a93-403b-a04f-62e2404f8b95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2659de0-7a93-403b-a04f-62e2404f8b95', 'volume_size': 1} Sep 23 14:37:09 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-ae251d9f-f016-49d1-ae0c-a53bcd883f88 tempest-GroupSnapshotsTest-1878904240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:37:09 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-06d4f009-6ff3-4a19-9601-b2414510e3c9 tempest-SnapshotsActionsTest-1506064885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.92c1f448-97e4-498b-8f82-cff2a39ed421,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.a9f4d524-a7e1-49bf-a7c1-bd889218020a 1G" returned: 0 in 0.652s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:09 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-06d4f009-6ff3-4a19-9601-b2414510e3c9 tempest-SnapshotsActionsTest-1506064885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.92c1f448-97e4-498b-8f82-cff2a39ed421 -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.a9f4d524-a7e1-49bf-a7c1-bd889218020a {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:09 devstack sudo[94041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.92c1f448-97e4-498b-8f82-cff2a39ed421 -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.a9f4d524-a7e1-49bf-a7c1-bd889218020a Sep 23 14:37:09 devstack sudo[94041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:09 devstack sudo[94041]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:09 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-06d4f009-6ff3-4a19-9601-b2414510e3c9 tempest-SnapshotsActionsTest-1506064885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.92c1f448-97e4-498b-8f82-cff2a39ed421 -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.a9f4d524-a7e1-49bf-a7c1-bd889218020a" returned: 0 in 0.314s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:09 devstack cinder-volume[86310]: WARNING cinder.volume.drivers.remotefs [None req-06d4f009-6ff3-4a19-9601-b2414510e3c9 tempest-SnapshotsActionsTest-1506064885 None] /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.a9f4d524-a7e1-49bf-a7c1-bd889218020a is being set with open permissions: ugo+rw Sep 23 14:37:09 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-06d4f009-6ff3-4a19-9601-b2414510e3c9 tempest-SnapshotsActionsTest-1506064885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.a9f4d524-a7e1-49bf-a7c1-bd889218020a {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:09 devstack sudo[94046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.a9f4d524-a7e1-49bf-a7c1-bd889218020a Sep 23 14:37:09 devstack sudo[94046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:09 devstack sudo[94046]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:09 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-06d4f009-6ff3-4a19-9601-b2414510e3c9 tempest-SnapshotsActionsTest-1506064885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.a9f4d524-a7e1-49bf-a7c1-bd889218020a" returned: 0 in 0.255s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:09 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-06d4f009-6ff3-4a19-9601-b2414510e3c9 tempest-SnapshotsActionsTest-1506064885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.894s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:37:09 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-ae251d9f-f016-49d1-ae0c-a53bcd883f88 tempest-GroupSnapshotsTest-1878904240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.621s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:37:09 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-ae251d9f-f016-49d1-ae0c-a53bcd883f88 tempest-GroupSnapshotsTest-1878904240 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5b0def4c-aab2-40ad-89af-2a62558607c1,created_at=2026-09-23T12:37:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1564408040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5b0def4c-aab2-40ad-89af-2a62558607c1,host='devstack@QuobyteHD#QuobyteHD',id=d2659de0-7a93-403b-a04f-62e2404f8b95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2999c542f573402d95e56f45bd48a68f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:37:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:37:09Z,use_quota=True,user_id='084cc64e7b844f9992be81b9145ff791',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9832bd8-22c1-4c83-a691-dfff9887dfaa),volume_type_id=c9832bd8-22c1-4c83-a691-dfff9887dfaa)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:37:09 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-ae251d9f-f016-49d1-ae0c-a53bcd883f88 tempest-GroupSnapshotsTest-1878904240 None] Creating volume d2659de0-7a93-403b-a04f-62e2404f8b95 {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:37:09 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-ae251d9f-f016-49d1-ae0c-a53bcd883f88 tempest-GroupSnapshotsTest-1878904240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:37:09 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-ae251d9f-f016-49d1-ae0c-a53bcd883f88 tempest-GroupSnapshotsTest-1878904240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:37:09 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-ae251d9f-f016-49d1-ae0c-a53bcd883f88 tempest-GroupSnapshotsTest-1878904240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:37:09 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-ae251d9f-f016-49d1-ae0c-a53bcd883f88 tempest-GroupSnapshotsTest-1878904240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:37:09 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-ae251d9f-f016-49d1-ae0c-a53bcd883f88 tempest-GroupSnapshotsTest-1878904240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:37:09 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-ae251d9f-f016-49d1-ae0c-a53bcd883f88 tempest-GroupSnapshotsTest-1878904240 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:37:09 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-ae251d9f-f016-49d1-ae0c-a53bcd883f88 tempest-GroupSnapshotsTest-1878904240 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:37:09 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ae251d9f-f016-49d1-ae0c-a53bcd883f88 tempest-GroupSnapshotsTest-1878904240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d2659de0-7a93-403b-a04f-62e2404f8b95 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:09 devstack sudo[94049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d2659de0-7a93-403b-a04f-62e2404f8b95 1073741824 Sep 23 14:37:09 devstack sudo[94049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:09 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-06d4f009-6ff3-4a19-9601-b2414510e3c9 tempest-SnapshotsActionsTest-1506064885 None] Create snapshot completed successfully Sep 23 14:37:10 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-9e0b856a-8a95-4ab3-a8db-bedd471c97e7 tempest-SnapshotsActionsTest-912270741 None] Acquiring lock "cinder-a9f4d524-a7e1-49bf-a7c1-bd889218020a-delete_snapshot" by "delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:37:10 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-9e0b856a-8a95-4ab3-a8db-bedd471c97e7 tempest-SnapshotsActionsTest-912270741 None] Lock "cinder-a9f4d524-a7e1-49bf-a7c1-bd889218020a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:37:10 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-9e0b856a-8a95-4ab3-a8db-bedd471c97e7 tempest-SnapshotsActionsTest-912270741 None] Acquiring lock "cinder-quobyte-fdca4f83-4751-4786-a502-ff3a27b0a1da" by "delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:37:10 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-9e0b856a-8a95-4ab3-a8db-bedd471c97e7 tempest-SnapshotsActionsTest-912270741 None] Lock "cinder-quobyte-fdca4f83-4751-4786-a502-ff3a27b0a1da" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:37:10 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-9e0b856a-8a95-4ab3-a8db-bedd471c97e7 tempest-SnapshotsActionsTest-912270741 None] Acquiring lock "cinder-quobyte-a9f4d524-a7e1-49bf-a7c1-bd889218020a" by "_delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:37:10 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-9e0b856a-8a95-4ab3-a8db-bedd471c97e7 tempest-SnapshotsActionsTest-912270741 None] Lock "cinder-quobyte-a9f4d524-a7e1-49bf-a7c1-bd889218020a" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:37:10 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-9e0b856a-8a95-4ab3-a8db-bedd471c97e7 tempest-SnapshotsActionsTest-912270741 None] Deleting offline snapshot a9f4d524-a7e1-49bf-a7c1-bd889218020a of volume fdca4f83-4751-4786-a502-ff3a27b0a1da {{(pid=86310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 14:37:10 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-9e0b856a-8a95-4ab3-a8db-bedd471c97e7 tempest-SnapshotsActionsTest-912270741 None] snapshot_file for this snap is: volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.a9f4d524-a7e1-49bf-a7c1-bd889218020a {{(pid=86310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 14:37:10 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[44c15697-6203-4f49-8a99-360558d733fb]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:37:10 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-9e0b856a-8a95-4ab3-a8db-bedd471c97e7 tempest-SnapshotsActionsTest-912270741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.a9f4d524-a7e1-49bf-a7c1-bd889218020a {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:10 devstack sudo[94049]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:10 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ae251d9f-f016-49d1-ae0c-a53bcd883f88 tempest-GroupSnapshotsTest-1878904240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d2659de0-7a93-403b-a04f-62e2404f8b95 1073741824" returned: 0 in 0.730s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:10 devstack sudo[94056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.a9f4d524-a7e1-49bf-a7c1-bd889218020a Sep 23 14:37:10 devstack sudo[94056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:10 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ae251d9f-f016-49d1-ae0c-a53bcd883f88 tempest-GroupSnapshotsTest-1878904240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d2659de0-7a93-403b-a04f-62e2404f8b95 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:10 devstack sudo[94058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d2659de0-7a93-403b-a04f-62e2404f8b95 Sep 23 14:37:10 devstack sudo[94058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:10 devstack sudo[94056]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:10 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-9e0b856a-8a95-4ab3-a8db-bedd471c97e7 tempest-SnapshotsActionsTest-912270741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.a9f4d524-a7e1-49bf-a7c1-bd889218020a" returned: 0 in 0.491s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:10 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-9e0b856a-8a95-4ab3-a8db-bedd471c97e7 tempest-SnapshotsActionsTest-912270741 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fdca4f83-4751-4786-a502-ff3a27b0a1da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 14:37:10 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f497af9-6bfe-46c9-9255-1a200e39ad17]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:37:10 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-9e0b856a-8a95-4ab3-a8db-bedd471c97e7 tempest-SnapshotsActionsTest-912270741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.92c1f448-97e4-498b-8f82-cff2a39ed421 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:10 devstack sudo[94058]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:10 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ae251d9f-f016-49d1-ae0c-a53bcd883f88 tempest-GroupSnapshotsTest-1878904240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d2659de0-7a93-403b-a04f-62e2404f8b95" returned: 0 in 0.330s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:10 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-ae251d9f-f016-49d1-ae0c-a53bcd883f88 tempest-GroupSnapshotsTest-1878904240 None] <== create_volume: return (1124ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:37:10 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-ae251d9f-f016-49d1-ae0c-a53bcd883f88 tempest-GroupSnapshotsTest-1878904240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.127s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:37:10 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-ae251d9f-f016-49d1-ae0c-a53bcd883f88 tempest-GroupSnapshotsTest-1878904240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8621ea7-d58c-434d-81e2-2cfcb986d0e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2659de0-7a93-403b-a04f-62e2404f8b95', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:37:10 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-ae251d9f-f016-49d1-ae0c-a53bcd883f88 tempest-GroupSnapshotsTest-1878904240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de086e55-8481-475c-89ad-6a31a22469cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:37:10 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-ae251d9f-f016-49d1-ae0c-a53bcd883f88 tempest-GroupSnapshotsTest-1878904240 None] Volume volume-d2659de0-7a93-403b-a04f-62e2404f8b95 (d2659de0-7a93-403b-a04f-62e2404f8b95): created successfully Sep 23 14:37:10 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-ae251d9f-f016-49d1-ae0c-a53bcd883f88 tempest-GroupSnapshotsTest-1878904240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de086e55-8481-475c-89ad-6a31a22469cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:37:10 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-ae251d9f-f016-49d1-ae0c-a53bcd883f88 tempest-GroupSnapshotsTest-1878904240 None] Flow 'volume_create_manager' (9e449442-e41d-48d2-ac0d-164f9723abb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:37:11 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-ae251d9f-f016-49d1-ae0c-a53bcd883f88 tempest-GroupSnapshotsTest-1878904240 None] Created volume successfully. Sep 23 14:37:11 devstack sudo[94066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.92c1f448-97e4-498b-8f82-cff2a39ed421 Sep 23 14:37:11 devstack sudo[94066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:11 devstack sudo[94066]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:11 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-9e0b856a-8a95-4ab3-a8db-bedd471c97e7 tempest-SnapshotsActionsTest-912270741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.92c1f448-97e4-498b-8f82-cff2a39ed421" returned: 0 in 0.528s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:11 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-9e0b856a-8a95-4ab3-a8db-bedd471c97e7 tempest-SnapshotsActionsTest-912270741 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fdca4f83-4751-4786-a502-ff3a27b0a1da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 14:37:11 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-9e0b856a-8a95-4ab3-a8db-bedd471c97e7 tempest-SnapshotsActionsTest-912270741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.a9f4d524-a7e1-49bf-a7c1-bd889218020a {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:11 devstack sudo[94108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.a9f4d524-a7e1-49bf-a7c1-bd889218020a Sep 23 14:37:11 devstack sudo[94108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:12 devstack sudo[94108]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:12 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-9e0b856a-8a95-4ab3-a8db-bedd471c97e7 tempest-SnapshotsActionsTest-912270741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.a9f4d524-a7e1-49bf-a7c1-bd889218020a" returned: 0 in 0.711s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:12 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-9e0b856a-8a95-4ab3-a8db-bedd471c97e7 tempest-SnapshotsActionsTest-912270741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.a9f4d524-a7e1-49bf-a7c1-bd889218020a {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:12 devstack sudo[94217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.a9f4d524-a7e1-49bf-a7c1-bd889218020a Sep 23 14:37:12 devstack sudo[94217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:12 devstack sudo[94217]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:12 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-9e0b856a-8a95-4ab3-a8db-bedd471c97e7 tempest-SnapshotsActionsTest-912270741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.a9f4d524-a7e1-49bf-a7c1-bd889218020a" returned: 0 in 0.338s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:12 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-9e0b856a-8a95-4ab3-a8db-bedd471c97e7 tempest-SnapshotsActionsTest-912270741 None] Lock "cinder-quobyte-a9f4d524-a7e1-49bf-a7c1-bd889218020a" released by "_delete_snapshot" :: held 2.255s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:37:12 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-9e0b856a-8a95-4ab3-a8db-bedd471c97e7 tempest-SnapshotsActionsTest-912270741 None] Lock "cinder-quobyte-fdca4f83-4751-4786-a502-ff3a27b0a1da" released by "delete_snapshot" :: held 2.312s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:37:12 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-9e0b856a-8a95-4ab3-a8db-bedd471c97e7 tempest-SnapshotsActionsTest-912270741 None] Created reservations ['bdc096b2-61b2-4293-b85a-bd66aceab6e7', '94a06b06-f9d9-4f42-b175-4bde14d6dcce', 'b2aaaf3e-9767-470b-a8dc-6b57462aa20f', '90bef04e-da98-4098-a424-0b2491458fb8'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:37:12 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-9e0b856a-8a95-4ab3-a8db-bedd471c97e7 tempest-SnapshotsActionsTest-912270741 None] Delete snapshot completed successfully. Sep 23 14:37:12 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-9e0b856a-8a95-4ab3-a8db-bedd471c97e7 tempest-SnapshotsActionsTest-912270741 None] Lock "cinder-a9f4d524-a7e1-49bf-a7c1-bd889218020a-delete_snapshot" released by "delete_snapshot" :: held 2.510s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:37:12 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-46a13eab-04c8-4257-9427-48f6092132ae tempest-GroupSnapshotsTest-1878904240 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:37:12 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-46a13eab-04c8-4257-9427-48f6092132ae tempest-GroupSnapshotsTest-1878904240 None] Flow 'volume_create_manager' (be06b0a4-a471-4f98-8a65-820ca3332aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:37:12 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-46a13eab-04c8-4257-9427-48f6092132ae tempest-GroupSnapshotsTest-1878904240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b97a1157-dd4b-46cd-8470-cbebda22b307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:37:12 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-46a13eab-04c8-4257-9427-48f6092132ae tempest-GroupSnapshotsTest-1878904240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b97a1157-dd4b-46cd-8470-cbebda22b307) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:37:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-852515537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5b0def4c-aab2-40ad-89af-2a62558607c1,host='devstack@QuobyteHD#QuobyteHD',id=eccdb0d9-179f-4f2e-966e-ab00dcd954d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2999c542f573402d95e56f45bd48a68f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:37:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:37:13Z,use_quota=True,user_id='084cc64e7b844f9992be81b9145ff791',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9832bd8-22c1-4c83-a691-dfff9887dfaa),volume_type_id=c9832bd8-22c1-4c83-a691-dfff9887dfaa)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:37:12 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-46a13eab-04c8-4257-9427-48f6092132ae tempest-GroupSnapshotsTest-1878904240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42e1c9de-b50e-4649-8c77-15f8aeca151e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:37:12 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-46a13eab-04c8-4257-9427-48f6092132ae tempest-GroupSnapshotsTest-1878904240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42e1c9de-b50e-4649-8c77-15f8aeca151e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:37:12 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-46a13eab-04c8-4257-9427-48f6092132ae tempest-GroupSnapshotsTest-1878904240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3c430fd-ca1d-44de-a0c5-97b0abb21daa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:37:12 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-46a13eab-04c8-4257-9427-48f6092132ae tempest-GroupSnapshotsTest-1878904240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3c430fd-ca1d-44de-a0c5-97b0abb21daa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eccdb0d9-179f-4f2e-966e-ab00dcd954d6', 'volume_name': 'volume-eccdb0d9-179f-4f2e-966e-ab00dcd954d6', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:37:12 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-46a13eab-04c8-4257-9427-48f6092132ae tempest-GroupSnapshotsTest-1878904240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7087dc3e-6766-4cec-a4c1-1235246d3d95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:37:12 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-46a13eab-04c8-4257-9427-48f6092132ae tempest-GroupSnapshotsTest-1878904240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7087dc3e-6766-4cec-a4c1-1235246d3d95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:37:12 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-46a13eab-04c8-4257-9427-48f6092132ae tempest-GroupSnapshotsTest-1878904240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0535d22d-e59e-433f-a738-42e8fd72161b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:37:12 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-46a13eab-04c8-4257-9427-48f6092132ae tempest-GroupSnapshotsTest-1878904240 None] Volume eccdb0d9-179f-4f2e-966e-ab00dcd954d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eccdb0d9-179f-4f2e-966e-ab00dcd954d6', 'volume_size': 1} Sep 23 14:37:12 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-46a13eab-04c8-4257-9427-48f6092132ae tempest-GroupSnapshotsTest-1878904240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:37:12 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-46a13eab-04c8-4257-9427-48f6092132ae tempest-GroupSnapshotsTest-1878904240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:37:12 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-46a13eab-04c8-4257-9427-48f6092132ae tempest-GroupSnapshotsTest-1878904240 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5b0def4c-aab2-40ad-89af-2a62558607c1,created_at=2026-09-23T12:37:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-852515537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5b0def4c-aab2-40ad-89af-2a62558607c1,host='devstack@QuobyteHD#QuobyteHD',id=eccdb0d9-179f-4f2e-966e-ab00dcd954d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2999c542f573402d95e56f45bd48a68f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:37:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:37:13Z,use_quota=True,user_id='084cc64e7b844f9992be81b9145ff791',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9832bd8-22c1-4c83-a691-dfff9887dfaa),volume_type_id=c9832bd8-22c1-4c83-a691-dfff9887dfaa)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:37:12 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-46a13eab-04c8-4257-9427-48f6092132ae tempest-GroupSnapshotsTest-1878904240 None] Creating volume eccdb0d9-179f-4f2e-966e-ab00dcd954d6 {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:37:12 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-46a13eab-04c8-4257-9427-48f6092132ae tempest-GroupSnapshotsTest-1878904240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:37:12 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-46a13eab-04c8-4257-9427-48f6092132ae tempest-GroupSnapshotsTest-1878904240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:37:12 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-46a13eab-04c8-4257-9427-48f6092132ae tempest-GroupSnapshotsTest-1878904240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:37:12 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-46a13eab-04c8-4257-9427-48f6092132ae tempest-GroupSnapshotsTest-1878904240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:37:12 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-46a13eab-04c8-4257-9427-48f6092132ae tempest-GroupSnapshotsTest-1878904240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:37:12 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-46a13eab-04c8-4257-9427-48f6092132ae tempest-GroupSnapshotsTest-1878904240 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:37:12 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-46a13eab-04c8-4257-9427-48f6092132ae tempest-GroupSnapshotsTest-1878904240 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:37:12 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-46a13eab-04c8-4257-9427-48f6092132ae tempest-GroupSnapshotsTest-1878904240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-eccdb0d9-179f-4f2e-966e-ab00dcd954d6 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:12 devstack sudo[94239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-eccdb0d9-179f-4f2e-966e-ab00dcd954d6 1073741824 Sep 23 14:37:12 devstack sudo[94239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:13 devstack sudo[94239]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:13 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-46a13eab-04c8-4257-9427-48f6092132ae tempest-GroupSnapshotsTest-1878904240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-eccdb0d9-179f-4f2e-966e-ab00dcd954d6 1073741824" returned: 0 in 0.814s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:13 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-46a13eab-04c8-4257-9427-48f6092132ae tempest-GroupSnapshotsTest-1878904240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-eccdb0d9-179f-4f2e-966e-ab00dcd954d6 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:13 devstack sudo[94612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-eccdb0d9-179f-4f2e-966e-ab00dcd954d6 Sep 23 14:37:13 devstack sudo[94612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:14 devstack sudo[94612]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:14 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-46a13eab-04c8-4257-9427-48f6092132ae tempest-GroupSnapshotsTest-1878904240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-eccdb0d9-179f-4f2e-966e-ab00dcd954d6" returned: 0 in 0.534s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:14 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-46a13eab-04c8-4257-9427-48f6092132ae tempest-GroupSnapshotsTest-1878904240 None] <== create_volume: return (1426ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:37:14 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-46a13eab-04c8-4257-9427-48f6092132ae tempest-GroupSnapshotsTest-1878904240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.429s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:37:14 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-46a13eab-04c8-4257-9427-48f6092132ae tempest-GroupSnapshotsTest-1878904240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0535d22d-e59e-433f-a738-42e8fd72161b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eccdb0d9-179f-4f2e-966e-ab00dcd954d6', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:37:14 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-46a13eab-04c8-4257-9427-48f6092132ae tempest-GroupSnapshotsTest-1878904240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5c26da7-ed36-4956-9d8f-6e2f8950038b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:37:14 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-46a13eab-04c8-4257-9427-48f6092132ae tempest-GroupSnapshotsTest-1878904240 None] Volume volume-eccdb0d9-179f-4f2e-966e-ab00dcd954d6 (eccdb0d9-179f-4f2e-966e-ab00dcd954d6): created successfully Sep 23 14:37:14 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-46a13eab-04c8-4257-9427-48f6092132ae tempest-GroupSnapshotsTest-1878904240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5c26da7-ed36-4956-9d8f-6e2f8950038b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:37:14 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-46a13eab-04c8-4257-9427-48f6092132ae tempest-GroupSnapshotsTest-1878904240 None] Flow 'volume_create_manager' (be06b0a4-a471-4f98-8a65-820ca3332aa2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:37:14 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-46a13eab-04c8-4257-9427-48f6092132ae tempest-GroupSnapshotsTest-1878904240 None] Created volume successfully. Sep 23 14:37:14 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-77d6c6c1-9adc-45ad-9893-ae1cfa96f723 tempest-SnapshotsActionsTest-1506064885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:37:14 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-77d6c6c1-9adc-45ad-9893-ae1cfa96f723 tempest-SnapshotsActionsTest-1506064885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:37:14 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-77d6c6c1-9adc-45ad-9893-ae1cfa96f723 tempest-SnapshotsActionsTest-1506064885 None] Creating offline snapshot de8ad95c-9df8-4b17-8f91-9e1d9f474861 of volume fdca4f83-4751-4786-a502-ff3a27b0a1da {{(pid=86310) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 14:37:14 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4da162a-21fa-4bd5-9c39-2cc3e8f264bc]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:37:14 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-77d6c6c1-9adc-45ad-9893-ae1cfa96f723 tempest-SnapshotsActionsTest-1506064885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.92c1f448-97e4-498b-8f82-cff2a39ed421 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:14 devstack sudo[94620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.92c1f448-97e4-498b-8f82-cff2a39ed421 Sep 23 14:37:14 devstack sudo[94620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:15 devstack sudo[94620]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:15 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-77d6c6c1-9adc-45ad-9893-ae1cfa96f723 tempest-SnapshotsActionsTest-1506064885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.92c1f448-97e4-498b-8f82-cff2a39ed421" returned: 0 in 0.538s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:15 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-77d6c6c1-9adc-45ad-9893-ae1cfa96f723 tempest-SnapshotsActionsTest-1506064885 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fdca4f83-4751-4786-a502-ff3a27b0a1da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 14:37:15 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-77d6c6c1-9adc-45ad-9893-ae1cfa96f723 tempest-SnapshotsActionsTest-1506064885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.92c1f448-97e4-498b-8f82-cff2a39ed421,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.de8ad95c-9df8-4b17-8f91-9e1d9f474861 1G {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:15 devstack sudo[94627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.92c1f448-97e4-498b-8f82-cff2a39ed421,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.de8ad95c-9df8-4b17-8f91-9e1d9f474861 1G Sep 23 14:37:15 devstack sudo[94627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:15 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-e565cdc8-2a1d-4941-aee5-ec17eba5a2af tempest-GroupSnapshotsTest-1878904240 None] Update group completed successfully. Sep 23 14:37:15 devstack sudo[94627]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:15 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-77d6c6c1-9adc-45ad-9893-ae1cfa96f723 tempest-SnapshotsActionsTest-1506064885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.92c1f448-97e4-498b-8f82-cff2a39ed421,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.de8ad95c-9df8-4b17-8f91-9e1d9f474861 1G" returned: 0 in 0.696s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:15 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-77d6c6c1-9adc-45ad-9893-ae1cfa96f723 tempest-SnapshotsActionsTest-1506064885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.92c1f448-97e4-498b-8f82-cff2a39ed421 -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.de8ad95c-9df8-4b17-8f91-9e1d9f474861 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:15 devstack sudo[94634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.92c1f448-97e4-498b-8f82-cff2a39ed421 -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.de8ad95c-9df8-4b17-8f91-9e1d9f474861 Sep 23 14:37:15 devstack sudo[94634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:16 devstack sudo[94634]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:16 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-77d6c6c1-9adc-45ad-9893-ae1cfa96f723 tempest-SnapshotsActionsTest-1506064885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.92c1f448-97e4-498b-8f82-cff2a39ed421 -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.de8ad95c-9df8-4b17-8f91-9e1d9f474861" returned: 0 in 0.446s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:16 devstack cinder-volume[86310]: WARNING cinder.volume.drivers.remotefs [None req-77d6c6c1-9adc-45ad-9893-ae1cfa96f723 tempest-SnapshotsActionsTest-1506064885 None] /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.de8ad95c-9df8-4b17-8f91-9e1d9f474861 is being set with open permissions: ugo+rw Sep 23 14:37:16 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-77d6c6c1-9adc-45ad-9893-ae1cfa96f723 tempest-SnapshotsActionsTest-1506064885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.de8ad95c-9df8-4b17-8f91-9e1d9f474861 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:16 devstack sudo[94673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.de8ad95c-9df8-4b17-8f91-9e1d9f474861 Sep 23 14:37:16 devstack sudo[94673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:16 devstack sudo[94673]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:16 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-77d6c6c1-9adc-45ad-9893-ae1cfa96f723 tempest-SnapshotsActionsTest-1506064885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.de8ad95c-9df8-4b17-8f91-9e1d9f474861" returned: 0 in 0.347s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:16 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-77d6c6c1-9adc-45ad-9893-ae1cfa96f723 tempest-SnapshotsActionsTest-1506064885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.210s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:37:16 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-77d6c6c1-9adc-45ad-9893-ae1cfa96f723 tempest-SnapshotsActionsTest-1506064885 None] Create snapshot completed successfully Sep 23 14:37:16 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-572e2af3-767b-49d7-93b0-3eb0696e2ef6 tempest-GroupSnapshotsTest-1878904240 None] Update group completed successfully. Sep 23 14:37:17 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-a39ee016-39b8-4314-b9f3-df8c5cd9772c tempest-SnapshotsActionsTest-912270741 None] Acquiring lock "cinder-de8ad95c-9df8-4b17-8f91-9e1d9f474861-delete_snapshot" by "delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:37:17 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-a39ee016-39b8-4314-b9f3-df8c5cd9772c tempest-SnapshotsActionsTest-912270741 None] Lock "cinder-de8ad95c-9df8-4b17-8f91-9e1d9f474861-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:37:17 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-a39ee016-39b8-4314-b9f3-df8c5cd9772c tempest-SnapshotsActionsTest-912270741 None] Acquiring lock "cinder-quobyte-fdca4f83-4751-4786-a502-ff3a27b0a1da" by "delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:37:17 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-a39ee016-39b8-4314-b9f3-df8c5cd9772c tempest-SnapshotsActionsTest-912270741 None] Lock "cinder-quobyte-fdca4f83-4751-4786-a502-ff3a27b0a1da" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:37:17 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-a39ee016-39b8-4314-b9f3-df8c5cd9772c tempest-SnapshotsActionsTest-912270741 None] Acquiring lock "cinder-quobyte-de8ad95c-9df8-4b17-8f91-9e1d9f474861" by "_delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:37:17 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-a39ee016-39b8-4314-b9f3-df8c5cd9772c tempest-SnapshotsActionsTest-912270741 None] Lock "cinder-quobyte-de8ad95c-9df8-4b17-8f91-9e1d9f474861" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:37:17 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-a39ee016-39b8-4314-b9f3-df8c5cd9772c tempest-SnapshotsActionsTest-912270741 None] Deleting offline snapshot de8ad95c-9df8-4b17-8f91-9e1d9f474861 of volume fdca4f83-4751-4786-a502-ff3a27b0a1da {{(pid=86310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 14:37:17 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-a39ee016-39b8-4314-b9f3-df8c5cd9772c tempest-SnapshotsActionsTest-912270741 None] snapshot_file for this snap is: volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.de8ad95c-9df8-4b17-8f91-9e1d9f474861 {{(pid=86310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 14:37:17 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e9f8a20-db22-4e77-92b4-a65a4ce2c4b4]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:37:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a39ee016-39b8-4314-b9f3-df8c5cd9772c tempest-SnapshotsActionsTest-912270741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.de8ad95c-9df8-4b17-8f91-9e1d9f474861 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:18 devstack sudo[94678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.de8ad95c-9df8-4b17-8f91-9e1d9f474861 Sep 23 14:37:18 devstack sudo[94678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:18 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-291aa684-d37d-449d-87e4-e2957bebf0a3 tempest-GroupSnapshotsTest-1878904240 None] Update group completed successfully. Sep 23 14:37:18 devstack sudo[94678]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:18 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a39ee016-39b8-4314-b9f3-df8c5cd9772c tempest-SnapshotsActionsTest-912270741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.de8ad95c-9df8-4b17-8f91-9e1d9f474861" returned: 0 in 0.492s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:18 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-a39ee016-39b8-4314-b9f3-df8c5cd9772c tempest-SnapshotsActionsTest-912270741 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fdca4f83-4751-4786-a502-ff3a27b0a1da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 14:37:18 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[35206a71-8da8-4acc-b44f-1ea1944135a1]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:37:18 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a39ee016-39b8-4314-b9f3-df8c5cd9772c tempest-SnapshotsActionsTest-912270741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.92c1f448-97e4-498b-8f82-cff2a39ed421 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:18 devstack sudo[94683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.92c1f448-97e4-498b-8f82-cff2a39ed421 Sep 23 14:37:18 devstack sudo[94683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:18 devstack sudo[94683]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:18 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a39ee016-39b8-4314-b9f3-df8c5cd9772c tempest-SnapshotsActionsTest-912270741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.92c1f448-97e4-498b-8f82-cff2a39ed421" returned: 0 in 0.422s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:18 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-a39ee016-39b8-4314-b9f3-df8c5cd9772c tempest-SnapshotsActionsTest-912270741 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fdca4f83-4751-4786-a502-ff3a27b0a1da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 14:37:18 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a39ee016-39b8-4314-b9f3-df8c5cd9772c tempest-SnapshotsActionsTest-912270741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.de8ad95c-9df8-4b17-8f91-9e1d9f474861 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:18 devstack sudo[94688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.de8ad95c-9df8-4b17-8f91-9e1d9f474861 Sep 23 14:37:18 devstack sudo[94688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:19 devstack sudo[94688]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:19 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a39ee016-39b8-4314-b9f3-df8c5cd9772c tempest-SnapshotsActionsTest-912270741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.de8ad95c-9df8-4b17-8f91-9e1d9f474861" returned: 0 in 0.488s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:19 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a39ee016-39b8-4314-b9f3-df8c5cd9772c tempest-SnapshotsActionsTest-912270741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.de8ad95c-9df8-4b17-8f91-9e1d9f474861 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:19 devstack sudo[94693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.de8ad95c-9df8-4b17-8f91-9e1d9f474861 Sep 23 14:37:19 devstack sudo[94693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:19 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-443fb420-579e-4af3-ba03-a2072486ce23 tempest-GroupSnapshotsTest-1878904240 None] Update group completed successfully. Sep 23 14:37:19 devstack sudo[94693]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:19 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a39ee016-39b8-4314-b9f3-df8c5cd9772c tempest-SnapshotsActionsTest-912270741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.de8ad95c-9df8-4b17-8f91-9e1d9f474861" returned: 0 in 0.292s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:19 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-a39ee016-39b8-4314-b9f3-df8c5cd9772c tempest-SnapshotsActionsTest-912270741 None] Lock "cinder-quobyte-de8ad95c-9df8-4b17-8f91-9e1d9f474861" released by "_delete_snapshot" :: held 1.813s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:37:19 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-a39ee016-39b8-4314-b9f3-df8c5cd9772c tempest-SnapshotsActionsTest-912270741 None] Lock "cinder-quobyte-fdca4f83-4751-4786-a502-ff3a27b0a1da" released by "delete_snapshot" :: held 1.845s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:37:19 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-a39ee016-39b8-4314-b9f3-df8c5cd9772c tempest-SnapshotsActionsTest-912270741 None] Created reservations ['08ee5be9-4a14-4ba8-80f3-6e294988b405', '0f4e6a26-deaa-45a3-a887-a7f969904b3d', '1734cd84-927a-4467-98b5-680a2bf23e31', '2cf1f18e-ebb2-4b33-bcee-d2cf8d6c63d4'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:37:19 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-a39ee016-39b8-4314-b9f3-df8c5cd9772c tempest-SnapshotsActionsTest-912270741 None] Delete snapshot completed successfully. Sep 23 14:37:19 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-a39ee016-39b8-4314-b9f3-df8c5cd9772c tempest-SnapshotsActionsTest-912270741 None] Lock "cinder-de8ad95c-9df8-4b17-8f91-9e1d9f474861-delete_snapshot" released by "delete_snapshot" :: held 1.999s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:37:20 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-73d80e87-df5b-4241-b6fe-cdbebc81ba10 tempest-SnapshotsActionsTest-1506064885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:37:20 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-73d80e87-df5b-4241-b6fe-cdbebc81ba10 tempest-SnapshotsActionsTest-1506064885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:37:20 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-73d80e87-df5b-4241-b6fe-cdbebc81ba10 tempest-SnapshotsActionsTest-1506064885 None] Creating offline snapshot 8f903e0f-1939-432f-a120-ddcc30943bc5 of volume fdca4f83-4751-4786-a502-ff3a27b0a1da {{(pid=86310) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 14:37:20 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ec70cd2-9b4e-412a-810b-aaa516c5791c]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:37:20 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-73d80e87-df5b-4241-b6fe-cdbebc81ba10 tempest-SnapshotsActionsTest-1506064885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.92c1f448-97e4-498b-8f82-cff2a39ed421 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:20 devstack sudo[94696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.92c1f448-97e4-498b-8f82-cff2a39ed421 Sep 23 14:37:20 devstack sudo[94696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:20 devstack sudo[94696]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:20 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-73d80e87-df5b-4241-b6fe-cdbebc81ba10 tempest-SnapshotsActionsTest-1506064885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.92c1f448-97e4-498b-8f82-cff2a39ed421" returned: 0 in 0.484s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:20 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-73d80e87-df5b-4241-b6fe-cdbebc81ba10 tempest-SnapshotsActionsTest-1506064885 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fdca4f83-4751-4786-a502-ff3a27b0a1da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 14:37:20 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-73d80e87-df5b-4241-b6fe-cdbebc81ba10 tempest-SnapshotsActionsTest-1506064885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.92c1f448-97e4-498b-8f82-cff2a39ed421,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.8f903e0f-1939-432f-a120-ddcc30943bc5 1G {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:20 devstack sudo[94701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.92c1f448-97e4-498b-8f82-cff2a39ed421,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.8f903e0f-1939-432f-a120-ddcc30943bc5 1G Sep 23 14:37:20 devstack sudo[94701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:21 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2a52785-2f3c-4fb0-8b21-7183b8728544 tempest-VolumeSnapshotQuotasNegativeTestJSON-1925218350 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:37:21 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-e2a52785-2f3c-4fb0-8b21-7183b8728544 tempest-VolumeSnapshotQuotasNegativeTestJSON-1925218350 None] Flow 'volume_create_manager' (6ce56246-b1eb-4fa0-b03d-223186953003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:37:21 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-e2a52785-2f3c-4fb0-8b21-7183b8728544 tempest-VolumeSnapshotQuotasNegativeTestJSON-1925218350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10447a77-4e4b-4534-8c84-9a31b31c8fa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:37:21 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-e2a52785-2f3c-4fb0-8b21-7183b8728544 tempest-VolumeSnapshotQuotasNegativeTestJSON-1925218350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10447a77-4e4b-4534-8c84-9a31b31c8fa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:37:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1873730152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ecf3319-3744-4c7f-8a40-9879645f2be6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5abb122c624b46d8a5f8c672d4800e0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:37:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:37:21Z,use_quota=True,user_id='46b994bf0d084023a5695da6400a1c2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:37:21 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-e2a52785-2f3c-4fb0-8b21-7183b8728544 tempest-VolumeSnapshotQuotasNegativeTestJSON-1925218350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (236def29-724b-4a07-aa24-f07cee3b5f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:37:21 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-e2a52785-2f3c-4fb0-8b21-7183b8728544 tempest-VolumeSnapshotQuotasNegativeTestJSON-1925218350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (236def29-724b-4a07-aa24-f07cee3b5f94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:37:21 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-e2a52785-2f3c-4fb0-8b21-7183b8728544 tempest-VolumeSnapshotQuotasNegativeTestJSON-1925218350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cd1fd7c-873c-4e36-969b-1113c536ec48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:37:21 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-e2a52785-2f3c-4fb0-8b21-7183b8728544 tempest-VolumeSnapshotQuotasNegativeTestJSON-1925218350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cd1fd7c-873c-4e36-969b-1113c536ec48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ecf3319-3744-4c7f-8a40-9879645f2be6', 'volume_name': 'volume-8ecf3319-3744-4c7f-8a40-9879645f2be6', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:37:21 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-e2a52785-2f3c-4fb0-8b21-7183b8728544 tempest-VolumeSnapshotQuotasNegativeTestJSON-1925218350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa370ae0-bdba-4203-9b6b-25e8aa06d1a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:37:21 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-e2a52785-2f3c-4fb0-8b21-7183b8728544 tempest-VolumeSnapshotQuotasNegativeTestJSON-1925218350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa370ae0-bdba-4203-9b6b-25e8aa06d1a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:37:21 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-e2a52785-2f3c-4fb0-8b21-7183b8728544 tempest-VolumeSnapshotQuotasNegativeTestJSON-1925218350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4c45659-34ba-437c-8d08-c81b5a48333d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:37:21 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-e2a52785-2f3c-4fb0-8b21-7183b8728544 tempest-VolumeSnapshotQuotasNegativeTestJSON-1925218350 None] Volume 8ecf3319-3744-4c7f-8a40-9879645f2be6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ecf3319-3744-4c7f-8a40-9879645f2be6', 'volume_size': 1} Sep 23 14:37:21 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-e2a52785-2f3c-4fb0-8b21-7183b8728544 tempest-VolumeSnapshotQuotasNegativeTestJSON-1925218350 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:37:21 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-6b1af3b0-5475-466d-a9f2-180c450f45cc tempest-GroupSnapshotsTest-1878904240 None] GroupSnapshot 152941c8-abdd-4bd1-ba63-f524575d89cb: creating. Sep 23 14:37:21 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-6b1af3b0-5475-466d-a9f2-180c450f45cc tempest-GroupSnapshotsTest-1878904240 None] Group snapshot 152941c8-abdd-4bd1-ba63-f524575d89cb: creating. {{(pid=86310) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 23 14:37:21 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-6b1af3b0-5475-466d-a9f2-180c450f45cc tempest-GroupSnapshotsTest-1878904240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:37:21 devstack sudo[94701]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:21 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-73d80e87-df5b-4241-b6fe-cdbebc81ba10 tempest-SnapshotsActionsTest-1506064885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.92c1f448-97e4-498b-8f82-cff2a39ed421,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.8f903e0f-1939-432f-a120-ddcc30943bc5 1G" returned: 0 in 0.516s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:21 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-73d80e87-df5b-4241-b6fe-cdbebc81ba10 tempest-SnapshotsActionsTest-1506064885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.92c1f448-97e4-498b-8f82-cff2a39ed421 -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.8f903e0f-1939-432f-a120-ddcc30943bc5 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:21 devstack sudo[94707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.92c1f448-97e4-498b-8f82-cff2a39ed421 -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.8f903e0f-1939-432f-a120-ddcc30943bc5 Sep 23 14:37:21 devstack sudo[94707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:21 devstack sudo[94707]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:21 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-73d80e87-df5b-4241-b6fe-cdbebc81ba10 tempest-SnapshotsActionsTest-1506064885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.92c1f448-97e4-498b-8f82-cff2a39ed421 -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.8f903e0f-1939-432f-a120-ddcc30943bc5" returned: 0 in 0.283s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:21 devstack cinder-volume[86310]: WARNING cinder.volume.drivers.remotefs [None req-73d80e87-df5b-4241-b6fe-cdbebc81ba10 tempest-SnapshotsActionsTest-1506064885 None] /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.8f903e0f-1939-432f-a120-ddcc30943bc5 is being set with open permissions: ugo+rw Sep 23 14:37:21 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-73d80e87-df5b-4241-b6fe-cdbebc81ba10 tempest-SnapshotsActionsTest-1506064885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.8f903e0f-1939-432f-a120-ddcc30943bc5 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:21 devstack sudo[94712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.8f903e0f-1939-432f-a120-ddcc30943bc5 Sep 23 14:37:21 devstack sudo[94712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:21 devstack sudo[94712]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:21 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-73d80e87-df5b-4241-b6fe-cdbebc81ba10 tempest-SnapshotsActionsTest-1506064885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.8f903e0f-1939-432f-a120-ddcc30943bc5" returned: 0 in 0.254s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:21 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-73d80e87-df5b-4241-b6fe-cdbebc81ba10 tempest-SnapshotsActionsTest-1506064885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.650s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:37:21 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-e2a52785-2f3c-4fb0-8b21-7183b8728544 tempest-VolumeSnapshotQuotasNegativeTestJSON-1925218350 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.791s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:37:21 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-e2a52785-2f3c-4fb0-8b21-7183b8728544 tempest-VolumeSnapshotQuotasNegativeTestJSON-1925218350 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:37:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1873730152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ecf3319-3744-4c7f-8a40-9879645f2be6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5abb122c624b46d8a5f8c672d4800e0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:37:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:37:21Z,use_quota=True,user_id='46b994bf0d084023a5695da6400a1c2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:37:21 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-e2a52785-2f3c-4fb0-8b21-7183b8728544 tempest-VolumeSnapshotQuotasNegativeTestJSON-1925218350 None] Creating volume 8ecf3319-3744-4c7f-8a40-9879645f2be6 {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:37:21 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-e2a52785-2f3c-4fb0-8b21-7183b8728544 tempest-VolumeSnapshotQuotasNegativeTestJSON-1925218350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:37:21 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-e2a52785-2f3c-4fb0-8b21-7183b8728544 tempest-VolumeSnapshotQuotasNegativeTestJSON-1925218350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:37:21 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-e2a52785-2f3c-4fb0-8b21-7183b8728544 tempest-VolumeSnapshotQuotasNegativeTestJSON-1925218350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:37:21 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-e2a52785-2f3c-4fb0-8b21-7183b8728544 tempest-VolumeSnapshotQuotasNegativeTestJSON-1925218350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:37:21 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-e2a52785-2f3c-4fb0-8b21-7183b8728544 tempest-VolumeSnapshotQuotasNegativeTestJSON-1925218350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:37:21 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-e2a52785-2f3c-4fb0-8b21-7183b8728544 tempest-VolumeSnapshotQuotasNegativeTestJSON-1925218350 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:37:21 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-e2a52785-2f3c-4fb0-8b21-7183b8728544 tempest-VolumeSnapshotQuotasNegativeTestJSON-1925218350 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:37:21 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-e2a52785-2f3c-4fb0-8b21-7183b8728544 tempest-VolumeSnapshotQuotasNegativeTestJSON-1925218350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8ecf3319-3744-4c7f-8a40-9879645f2be6 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:21 devstack sudo[94715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8ecf3319-3744-4c7f-8a40-9879645f2be6 1073741824 Sep 23 14:37:21 devstack sudo[94715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:21 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-73d80e87-df5b-4241-b6fe-cdbebc81ba10 tempest-SnapshotsActionsTest-1506064885 None] Create snapshot completed successfully Sep 23 14:37:22 devstack sudo[94715]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:22 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-e2a52785-2f3c-4fb0-8b21-7183b8728544 tempest-VolumeSnapshotQuotasNegativeTestJSON-1925218350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8ecf3319-3744-4c7f-8a40-9879645f2be6 1073741824" returned: 0 in 0.476s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:22 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-e2a52785-2f3c-4fb0-8b21-7183b8728544 tempest-VolumeSnapshotQuotasNegativeTestJSON-1925218350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8ecf3319-3744-4c7f-8a40-9879645f2be6 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:22 devstack sudo[94722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8ecf3319-3744-4c7f-8a40-9879645f2be6 Sep 23 14:37:22 devstack sudo[94722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:22 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-968f613e-5b8f-49bb-ba20-22667e89248f tempest-SnapshotsActionsTest-912270741 None] Acquiring lock "cinder-8f903e0f-1939-432f-a120-ddcc30943bc5-delete_snapshot" by "delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:37:22 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-968f613e-5b8f-49bb-ba20-22667e89248f tempest-SnapshotsActionsTest-912270741 None] Lock "cinder-8f903e0f-1939-432f-a120-ddcc30943bc5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:37:22 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-968f613e-5b8f-49bb-ba20-22667e89248f tempest-SnapshotsActionsTest-912270741 None] Acquiring lock "cinder-quobyte-fdca4f83-4751-4786-a502-ff3a27b0a1da" by "delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:37:22 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-968f613e-5b8f-49bb-ba20-22667e89248f tempest-SnapshotsActionsTest-912270741 None] Lock "cinder-quobyte-fdca4f83-4751-4786-a502-ff3a27b0a1da" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:37:22 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-968f613e-5b8f-49bb-ba20-22667e89248f tempest-SnapshotsActionsTest-912270741 None] Acquiring lock "cinder-quobyte-8f903e0f-1939-432f-a120-ddcc30943bc5" by "_delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:37:22 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-968f613e-5b8f-49bb-ba20-22667e89248f tempest-SnapshotsActionsTest-912270741 None] Lock "cinder-quobyte-8f903e0f-1939-432f-a120-ddcc30943bc5" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:37:22 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-968f613e-5b8f-49bb-ba20-22667e89248f tempest-SnapshotsActionsTest-912270741 None] Deleting offline snapshot 8f903e0f-1939-432f-a120-ddcc30943bc5 of volume fdca4f83-4751-4786-a502-ff3a27b0a1da {{(pid=86310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 14:37:22 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-968f613e-5b8f-49bb-ba20-22667e89248f tempest-SnapshotsActionsTest-912270741 None] snapshot_file for this snap is: volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.8f903e0f-1939-432f-a120-ddcc30943bc5 {{(pid=86310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 14:37:22 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b6e2070-33e6-40ef-bae9-eefb9f1a9c0f]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:37:22 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-968f613e-5b8f-49bb-ba20-22667e89248f tempest-SnapshotsActionsTest-912270741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.8f903e0f-1939-432f-a120-ddcc30943bc5 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:22 devstack sudo[94722]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:22 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-e2a52785-2f3c-4fb0-8b21-7183b8728544 tempest-VolumeSnapshotQuotasNegativeTestJSON-1925218350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8ecf3319-3744-4c7f-8a40-9879645f2be6" returned: 0 in 0.285s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:22 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-e2a52785-2f3c-4fb0-8b21-7183b8728544 tempest-VolumeSnapshotQuotasNegativeTestJSON-1925218350 None] <== create_volume: return (808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:37:22 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-e2a52785-2f3c-4fb0-8b21-7183b8728544 tempest-VolumeSnapshotQuotasNegativeTestJSON-1925218350 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.811s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:37:22 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-6b1af3b0-5475-466d-a9f2-180c450f45cc tempest-GroupSnapshotsTest-1878904240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.565s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:37:22 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-6b1af3b0-5475-466d-a9f2-180c450f45cc tempest-GroupSnapshotsTest-1878904240 None] Creating offline snapshot 2d7cf593-c4c8-4fee-9b6f-5d567e10764b of volume d2659de0-7a93-403b-a04f-62e2404f8b95 {{(pid=86310) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 14:37:22 devstack sudo[94724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.8f903e0f-1939-432f-a120-ddcc30943bc5 Sep 23 14:37:22 devstack sudo[94724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:22 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-e2a52785-2f3c-4fb0-8b21-7183b8728544 tempest-VolumeSnapshotQuotasNegativeTestJSON-1925218350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4c45659-34ba-437c-8d08-c81b5a48333d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ecf3319-3744-4c7f-8a40-9879645f2be6', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:37:22 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-e2a52785-2f3c-4fb0-8b21-7183b8728544 tempest-VolumeSnapshotQuotasNegativeTestJSON-1925218350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78224398-8285-4651-9d18-1a6ee0c49e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:37:22 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[afa7639e-63db-4e8f-8311-5f2dc6ac8c38]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:37:22 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-6b1af3b0-5475-466d-a9f2-180c450f45cc tempest-GroupSnapshotsTest-1878904240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d2659de0-7a93-403b-a04f-62e2404f8b95 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:22 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-e2a52785-2f3c-4fb0-8b21-7183b8728544 tempest-VolumeSnapshotQuotasNegativeTestJSON-1925218350 None] Volume volume-8ecf3319-3744-4c7f-8a40-9879645f2be6 (8ecf3319-3744-4c7f-8a40-9879645f2be6): created successfully Sep 23 14:37:22 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-e2a52785-2f3c-4fb0-8b21-7183b8728544 tempest-VolumeSnapshotQuotasNegativeTestJSON-1925218350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78224398-8285-4651-9d18-1a6ee0c49e3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:37:22 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-e2a52785-2f3c-4fb0-8b21-7183b8728544 tempest-VolumeSnapshotQuotasNegativeTestJSON-1925218350 None] Flow 'volume_create_manager' (6ce56246-b1eb-4fa0-b03d-223186953003) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:37:22 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-e2a52785-2f3c-4fb0-8b21-7183b8728544 tempest-VolumeSnapshotQuotasNegativeTestJSON-1925218350 None] Created volume successfully. Sep 23 14:37:22 devstack sudo[94727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d2659de0-7a93-403b-a04f-62e2404f8b95 Sep 23 14:37:22 devstack sudo[94727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:23 devstack sudo[94724]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:23 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-968f613e-5b8f-49bb-ba20-22667e89248f tempest-SnapshotsActionsTest-912270741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.8f903e0f-1939-432f-a120-ddcc30943bc5" returned: 0 in 0.512s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:23 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-968f613e-5b8f-49bb-ba20-22667e89248f tempest-SnapshotsActionsTest-912270741 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fdca4f83-4751-4786-a502-ff3a27b0a1da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 14:37:23 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd79b46-1268-430b-9ecc-1ce2db226499]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:37:23 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-968f613e-5b8f-49bb-ba20-22667e89248f tempest-SnapshotsActionsTest-912270741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.92c1f448-97e4-498b-8f82-cff2a39ed421 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:23 devstack sudo[94727]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:23 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-6b1af3b0-5475-466d-a9f2-180c450f45cc tempest-GroupSnapshotsTest-1878904240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d2659de0-7a93-403b-a04f-62e2404f8b95" returned: 0 in 0.435s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:23 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-6b1af3b0-5475-466d-a9f2-180c450f45cc tempest-GroupSnapshotsTest-1878904240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d2659de0-7a93-403b-a04f-62e2404f8b95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d2659de0-7a93-403b-a04f-62e2404f8b95.2d7cf593-c4c8-4fee-9b6f-5d567e10764b 1G {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:23 devstack sudo[94736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d2659de0-7a93-403b-a04f-62e2404f8b95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d2659de0-7a93-403b-a04f-62e2404f8b95.2d7cf593-c4c8-4fee-9b6f-5d567e10764b 1G Sep 23 14:37:23 devstack sudo[94736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:23 devstack sudo[94735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.92c1f448-97e4-498b-8f82-cff2a39ed421 Sep 23 14:37:23 devstack sudo[94735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:23 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-89265f7e-a3c5-4c82-baab-290525837433 tempest-VolumeSnapshotQuotasNegativeTestJSON-1925218350 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:37:23 devstack sudo[94735]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:23 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-968f613e-5b8f-49bb-ba20-22667e89248f tempest-SnapshotsActionsTest-912270741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.92c1f448-97e4-498b-8f82-cff2a39ed421" returned: 0 in 0.451s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:23 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-968f613e-5b8f-49bb-ba20-22667e89248f tempest-SnapshotsActionsTest-912270741 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fdca4f83-4751-4786-a502-ff3a27b0a1da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 14:37:23 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-968f613e-5b8f-49bb-ba20-22667e89248f tempest-SnapshotsActionsTest-912270741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.8f903e0f-1939-432f-a120-ddcc30943bc5 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:23 devstack sudo[94746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.8f903e0f-1939-432f-a120-ddcc30943bc5 Sep 23 14:37:23 devstack sudo[94746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:23 devstack sudo[94736]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:23 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-6b1af3b0-5475-466d-a9f2-180c450f45cc tempest-GroupSnapshotsTest-1878904240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d2659de0-7a93-403b-a04f-62e2404f8b95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d2659de0-7a93-403b-a04f-62e2404f8b95.2d7cf593-c4c8-4fee-9b6f-5d567e10764b 1G" returned: 0 in 0.496s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:23 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-6b1af3b0-5475-466d-a9f2-180c450f45cc tempest-GroupSnapshotsTest-1878904240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2659de0-7a93-403b-a04f-62e2404f8b95 -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d2659de0-7a93-403b-a04f-62e2404f8b95.2d7cf593-c4c8-4fee-9b6f-5d567e10764b {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:23 devstack sudo[94748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2659de0-7a93-403b-a04f-62e2404f8b95 -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d2659de0-7a93-403b-a04f-62e2404f8b95.2d7cf593-c4c8-4fee-9b6f-5d567e10764b Sep 23 14:37:23 devstack sudo[94748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:24 devstack sudo[94748]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:24 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-6b1af3b0-5475-466d-a9f2-180c450f45cc tempest-GroupSnapshotsTest-1878904240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2659de0-7a93-403b-a04f-62e2404f8b95 -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d2659de0-7a93-403b-a04f-62e2404f8b95.2d7cf593-c4c8-4fee-9b6f-5d567e10764b" returned: 0 in 0.302s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:24 devstack cinder-volume[86310]: WARNING cinder.volume.drivers.remotefs [None req-6b1af3b0-5475-466d-a9f2-180c450f45cc tempest-GroupSnapshotsTest-1878904240 None] /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d2659de0-7a93-403b-a04f-62e2404f8b95.2d7cf593-c4c8-4fee-9b6f-5d567e10764b is being set with open permissions: ugo+rw: NotImplementedError Sep 23 14:37:24 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-6b1af3b0-5475-466d-a9f2-180c450f45cc tempest-GroupSnapshotsTest-1878904240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d2659de0-7a93-403b-a04f-62e2404f8b95.2d7cf593-c4c8-4fee-9b6f-5d567e10764b {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:24 devstack sudo[94746]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:24 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-968f613e-5b8f-49bb-ba20-22667e89248f tempest-SnapshotsActionsTest-912270741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.8f903e0f-1939-432f-a120-ddcc30943bc5" returned: 0 in 0.396s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:24 devstack sudo[94758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d2659de0-7a93-403b-a04f-62e2404f8b95.2d7cf593-c4c8-4fee-9b6f-5d567e10764b Sep 23 14:37:24 devstack sudo[94758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:24 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-968f613e-5b8f-49bb-ba20-22667e89248f tempest-SnapshotsActionsTest-912270741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.8f903e0f-1939-432f-a120-ddcc30943bc5 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:24 devstack sudo[94760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.8f903e0f-1939-432f-a120-ddcc30943bc5 Sep 23 14:37:24 devstack sudo[94760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:24 devstack sudo[94758]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:24 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-6b1af3b0-5475-466d-a9f2-180c450f45cc tempest-GroupSnapshotsTest-1878904240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d2659de0-7a93-403b-a04f-62e2404f8b95.2d7cf593-c4c8-4fee-9b6f-5d567e10764b" returned: 0 in 0.257s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:24 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-6b1af3b0-5475-466d-a9f2-180c450f45cc tempest-GroupSnapshotsTest-1878904240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d2659de0-7a93-403b-a04f-62e2404f8b95.info {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:24 devstack sudo[94760]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:24 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-968f613e-5b8f-49bb-ba20-22667e89248f tempest-SnapshotsActionsTest-912270741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.8f903e0f-1939-432f-a120-ddcc30943bc5" returned: 0 in 0.301s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:24 devstack sudo[94764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d2659de0-7a93-403b-a04f-62e2404f8b95.info Sep 23 14:37:24 devstack sudo[94764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:24 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-968f613e-5b8f-49bb-ba20-22667e89248f tempest-SnapshotsActionsTest-912270741 None] Lock "cinder-quobyte-8f903e0f-1939-432f-a120-ddcc30943bc5" released by "_delete_snapshot" :: held 1.796s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:37:24 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-968f613e-5b8f-49bb-ba20-22667e89248f tempest-SnapshotsActionsTest-912270741 None] Lock "cinder-quobyte-fdca4f83-4751-4786-a502-ff3a27b0a1da" released by "delete_snapshot" :: held 1.831s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:37:24 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-968f613e-5b8f-49bb-ba20-22667e89248f tempest-SnapshotsActionsTest-912270741 None] Created reservations ['b4f0f24e-dbdf-46d6-8bbc-91b1ba0c272d', '4b847551-1abb-4567-a022-7565e5205e24', '55052c17-b4fb-4841-bbb3-9d3d88728e46', '0c7c060d-8b60-4cd4-8009-6f2a17f4455c'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:37:24 devstack sudo[94764]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:24 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-6b1af3b0-5475-466d-a9f2-180c450f45cc tempest-GroupSnapshotsTest-1878904240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d2659de0-7a93-403b-a04f-62e2404f8b95.info" returned: 0 in 0.286s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:24 devstack cinder-volume[86310]: WARNING cinder.volume.drivers.remotefs [None req-6b1af3b0-5475-466d-a9f2-180c450f45cc tempest-GroupSnapshotsTest-1878904240 None] /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d2659de0-7a93-403b-a04f-62e2404f8b95.info is being set with open permissions: ugo+rw: NotImplementedError Sep 23 14:37:24 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-6b1af3b0-5475-466d-a9f2-180c450f45cc tempest-GroupSnapshotsTest-1878904240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d2659de0-7a93-403b-a04f-62e2404f8b95.info {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:24 devstack sudo[94767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d2659de0-7a93-403b-a04f-62e2404f8b95.info Sep 23 14:37:24 devstack sudo[94767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:24 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-968f613e-5b8f-49bb-ba20-22667e89248f tempest-SnapshotsActionsTest-912270741 None] Delete snapshot completed successfully. Sep 23 14:37:24 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-968f613e-5b8f-49bb-ba20-22667e89248f tempest-SnapshotsActionsTest-912270741 None] Lock "cinder-8f903e0f-1939-432f-a120-ddcc30943bc5-delete_snapshot" released by "delete_snapshot" :: held 2.130s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:37:24 devstack sudo[94767]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:24 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-6b1af3b0-5475-466d-a9f2-180c450f45cc tempest-GroupSnapshotsTest-1878904240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d2659de0-7a93-403b-a04f-62e2404f8b95.info" returned: 0 in 0.273s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:24 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-6b1af3b0-5475-466d-a9f2-180c450f45cc tempest-GroupSnapshotsTest-1878904240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.189s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:37:24 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-6b1af3b0-5475-466d-a9f2-180c450f45cc tempest-GroupSnapshotsTest-1878904240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:37:24 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-6b1af3b0-5475-466d-a9f2-180c450f45cc tempest-GroupSnapshotsTest-1878904240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:37:24 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-6b1af3b0-5475-466d-a9f2-180c450f45cc tempest-GroupSnapshotsTest-1878904240 None] Creating offline snapshot 7f12b452-a025-4eaa-a0dd-6471794ef608 of volume eccdb0d9-179f-4f2e-966e-ab00dcd954d6 {{(pid=86310) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 14:37:24 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[3079abf0-2a8e-4113-be04-6a70879fd692]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:37:24 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-6b1af3b0-5475-466d-a9f2-180c450f45cc tempest-GroupSnapshotsTest-1878904240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-eccdb0d9-179f-4f2e-966e-ab00dcd954d6 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:25 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-bd4877c8-abcf-4fc0-875b-051ebab91811 tempest-SnapshotsActionsTest-1506064885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:37:25 devstack sudo[94770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-eccdb0d9-179f-4f2e-966e-ab00dcd954d6 Sep 23 14:37:25 devstack sudo[94770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:25 devstack sudo[94770]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:25 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-6b1af3b0-5475-466d-a9f2-180c450f45cc tempest-GroupSnapshotsTest-1878904240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-eccdb0d9-179f-4f2e-966e-ab00dcd954d6" returned: 0 in 0.400s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:25 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-6b1af3b0-5475-466d-a9f2-180c450f45cc tempest-GroupSnapshotsTest-1878904240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-eccdb0d9-179f-4f2e-966e-ab00dcd954d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-eccdb0d9-179f-4f2e-966e-ab00dcd954d6.7f12b452-a025-4eaa-a0dd-6471794ef608 1G {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:25 devstack sudo[94775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-eccdb0d9-179f-4f2e-966e-ab00dcd954d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-eccdb0d9-179f-4f2e-966e-ab00dcd954d6.7f12b452-a025-4eaa-a0dd-6471794ef608 1G Sep 23 14:37:25 devstack sudo[94775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:25 devstack sudo[94775]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:25 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-6b1af3b0-5475-466d-a9f2-180c450f45cc tempest-GroupSnapshotsTest-1878904240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-eccdb0d9-179f-4f2e-966e-ab00dcd954d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-eccdb0d9-179f-4f2e-966e-ab00dcd954d6.7f12b452-a025-4eaa-a0dd-6471794ef608 1G" returned: 0 in 0.414s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:25 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-6b1af3b0-5475-466d-a9f2-180c450f45cc tempest-GroupSnapshotsTest-1878904240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eccdb0d9-179f-4f2e-966e-ab00dcd954d6 -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-eccdb0d9-179f-4f2e-966e-ab00dcd954d6.7f12b452-a025-4eaa-a0dd-6471794ef608 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:25 devstack sudo[94780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eccdb0d9-179f-4f2e-966e-ab00dcd954d6 -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-eccdb0d9-179f-4f2e-966e-ab00dcd954d6.7f12b452-a025-4eaa-a0dd-6471794ef608 Sep 23 14:37:25 devstack sudo[94780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:26 devstack sudo[94780]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:26 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-6b1af3b0-5475-466d-a9f2-180c450f45cc tempest-GroupSnapshotsTest-1878904240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eccdb0d9-179f-4f2e-966e-ab00dcd954d6 -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-eccdb0d9-179f-4f2e-966e-ab00dcd954d6.7f12b452-a025-4eaa-a0dd-6471794ef608" returned: 0 in 0.289s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:26 devstack cinder-volume[86310]: WARNING cinder.volume.drivers.remotefs [None req-6b1af3b0-5475-466d-a9f2-180c450f45cc tempest-GroupSnapshotsTest-1878904240 None] /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-eccdb0d9-179f-4f2e-966e-ab00dcd954d6.7f12b452-a025-4eaa-a0dd-6471794ef608 is being set with open permissions: ugo+rw: NotImplementedError Sep 23 14:37:26 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-6b1af3b0-5475-466d-a9f2-180c450f45cc tempest-GroupSnapshotsTest-1878904240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-eccdb0d9-179f-4f2e-966e-ab00dcd954d6.7f12b452-a025-4eaa-a0dd-6471794ef608 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:26 devstack sudo[94785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-eccdb0d9-179f-4f2e-966e-ab00dcd954d6.7f12b452-a025-4eaa-a0dd-6471794ef608 Sep 23 14:37:26 devstack sudo[94785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:26 devstack sudo[94785]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:26 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-6b1af3b0-5475-466d-a9f2-180c450f45cc tempest-GroupSnapshotsTest-1878904240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-eccdb0d9-179f-4f2e-966e-ab00dcd954d6.7f12b452-a025-4eaa-a0dd-6471794ef608" returned: 0 in 0.261s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:26 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-6b1af3b0-5475-466d-a9f2-180c450f45cc tempest-GroupSnapshotsTest-1878904240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-eccdb0d9-179f-4f2e-966e-ab00dcd954d6.info {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:26 devstack sudo[94788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-eccdb0d9-179f-4f2e-966e-ab00dcd954d6.info Sep 23 14:37:26 devstack sudo[94788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:26 devstack sudo[94788]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:26 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-6b1af3b0-5475-466d-a9f2-180c450f45cc tempest-GroupSnapshotsTest-1878904240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-eccdb0d9-179f-4f2e-966e-ab00dcd954d6.info" returned: 0 in 0.268s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:26 devstack cinder-volume[86310]: WARNING cinder.volume.drivers.remotefs [None req-6b1af3b0-5475-466d-a9f2-180c450f45cc tempest-GroupSnapshotsTest-1878904240 None] /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-eccdb0d9-179f-4f2e-966e-ab00dcd954d6.info is being set with open permissions: ugo+rw: NotImplementedError Sep 23 14:37:26 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-6b1af3b0-5475-466d-a9f2-180c450f45cc tempest-GroupSnapshotsTest-1878904240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-eccdb0d9-179f-4f2e-966e-ab00dcd954d6.info {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:26 devstack sudo[94791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-eccdb0d9-179f-4f2e-966e-ab00dcd954d6.info Sep 23 14:37:26 devstack sudo[94791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:26 devstack sudo[94791]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:26 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-6b1af3b0-5475-466d-a9f2-180c450f45cc tempest-GroupSnapshotsTest-1878904240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-eccdb0d9-179f-4f2e-966e-ab00dcd954d6.info" returned: 0 in 0.247s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:26 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-6b1af3b0-5475-466d-a9f2-180c450f45cc tempest-GroupSnapshotsTest-1878904240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.975s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:37:26 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-89265f7e-a3c5-4c82-baab-290525837433 tempest-VolumeSnapshotQuotasNegativeTestJSON-1925218350 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.513s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:37:26 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-89265f7e-a3c5-4c82-baab-290525837433 tempest-VolumeSnapshotQuotasNegativeTestJSON-1925218350 None] Creating offline snapshot d0aea958-d853-4665-bd99-e90e275e924c of volume 8ecf3319-3744-4c7f-8a40-9879645f2be6 {{(pid=86310) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 14:37:26 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[da68ec18-bf14-4a42-9270-c3f0d7c24241]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:37:26 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-89265f7e-a3c5-4c82-baab-290525837433 tempest-VolumeSnapshotQuotasNegativeTestJSON-1925218350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8ecf3319-3744-4c7f-8a40-9879645f2be6 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:27 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-6b1af3b0-5475-466d-a9f2-180c450f45cc tempest-GroupSnapshotsTest-1878904240 None] group_snapshot 152941c8-abdd-4bd1-ba63-f524575d89cb: created successfully Sep 23 14:37:27 devstack sudo[94794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8ecf3319-3744-4c7f-8a40-9879645f2be6 Sep 23 14:37:27 devstack sudo[94794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:27 devstack sudo[94794]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:27 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-89265f7e-a3c5-4c82-baab-290525837433 tempest-VolumeSnapshotQuotasNegativeTestJSON-1925218350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8ecf3319-3744-4c7f-8a40-9879645f2be6" returned: 0 in 0.410s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:27 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-89265f7e-a3c5-4c82-baab-290525837433 tempest-VolumeSnapshotQuotasNegativeTestJSON-1925218350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8ecf3319-3744-4c7f-8a40-9879645f2be6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8ecf3319-3744-4c7f-8a40-9879645f2be6.d0aea958-d853-4665-bd99-e90e275e924c 1G {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:27 devstack sudo[94807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8ecf3319-3744-4c7f-8a40-9879645f2be6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8ecf3319-3744-4c7f-8a40-9879645f2be6.d0aea958-d853-4665-bd99-e90e275e924c 1G Sep 23 14:37:27 devstack sudo[94807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:27 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-67e91461-ba07-4849-9f63-518cadaff1fe tempest-GroupSnapshotsTest-1878904240 None] group_snapshot 152941c8-abdd-4bd1-ba63-f524575d89cb: deleting Sep 23 14:37:27 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-67e91461-ba07-4849-9f63-518cadaff1fe tempest-GroupSnapshotsTest-1878904240 None] group_snapshot 152941c8-abdd-4bd1-ba63-f524575d89cb: deleting {{(pid=86310) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 23 14:37:27 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-67e91461-ba07-4849-9f63-518cadaff1fe tempest-GroupSnapshotsTest-1878904240 None] Acquiring lock "cinder-quobyte-d2659de0-7a93-403b-a04f-62e2404f8b95" by "delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:37:27 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-67e91461-ba07-4849-9f63-518cadaff1fe tempest-GroupSnapshotsTest-1878904240 None] Lock "cinder-quobyte-d2659de0-7a93-403b-a04f-62e2404f8b95" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:37:27 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-67e91461-ba07-4849-9f63-518cadaff1fe tempest-GroupSnapshotsTest-1878904240 None] Acquiring lock "cinder-quobyte-2d7cf593-c4c8-4fee-9b6f-5d567e10764b" by "_delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:37:27 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-67e91461-ba07-4849-9f63-518cadaff1fe tempest-GroupSnapshotsTest-1878904240 None] Lock "cinder-quobyte-2d7cf593-c4c8-4fee-9b6f-5d567e10764b" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:37:27 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-67e91461-ba07-4849-9f63-518cadaff1fe tempest-GroupSnapshotsTest-1878904240 None] Deleting offline snapshot 2d7cf593-c4c8-4fee-9b6f-5d567e10764b of volume d2659de0-7a93-403b-a04f-62e2404f8b95 {{(pid=86310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 14:37:27 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-67e91461-ba07-4849-9f63-518cadaff1fe tempest-GroupSnapshotsTest-1878904240 None] snapshot_file for this snap is: volume-d2659de0-7a93-403b-a04f-62e2404f8b95.2d7cf593-c4c8-4fee-9b6f-5d567e10764b {{(pid=86310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 14:37:27 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[a93a1e23-d8ec-43b0-92f6-9362bcd8c99c]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:37:27 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-67e91461-ba07-4849-9f63-518cadaff1fe tempest-GroupSnapshotsTest-1878904240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d2659de0-7a93-403b-a04f-62e2404f8b95.2d7cf593-c4c8-4fee-9b6f-5d567e10764b {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:27 devstack sudo[94807]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:27 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-89265f7e-a3c5-4c82-baab-290525837433 tempest-VolumeSnapshotQuotasNegativeTestJSON-1925218350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8ecf3319-3744-4c7f-8a40-9879645f2be6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8ecf3319-3744-4c7f-8a40-9879645f2be6.d0aea958-d853-4665-bd99-e90e275e924c 1G" returned: 0 in 0.553s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:27 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-89265f7e-a3c5-4c82-baab-290525837433 tempest-VolumeSnapshotQuotasNegativeTestJSON-1925218350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ecf3319-3744-4c7f-8a40-9879645f2be6 -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8ecf3319-3744-4c7f-8a40-9879645f2be6.d0aea958-d853-4665-bd99-e90e275e924c {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:27 devstack sudo[94816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ecf3319-3744-4c7f-8a40-9879645f2be6 -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8ecf3319-3744-4c7f-8a40-9879645f2be6.d0aea958-d853-4665-bd99-e90e275e924c Sep 23 14:37:27 devstack sudo[94816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:27 devstack sudo[94815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d2659de0-7a93-403b-a04f-62e2404f8b95.2d7cf593-c4c8-4fee-9b6f-5d567e10764b Sep 23 14:37:28 devstack sudo[94815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:28 devstack sudo[94815]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:28 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-67e91461-ba07-4849-9f63-518cadaff1fe tempest-GroupSnapshotsTest-1878904240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d2659de0-7a93-403b-a04f-62e2404f8b95.2d7cf593-c4c8-4fee-9b6f-5d567e10764b" returned: 0 in 0.431s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:28 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-67e91461-ba07-4849-9f63-518cadaff1fe tempest-GroupSnapshotsTest-1878904240 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2659de0-7a93-403b-a04f-62e2404f8b95(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 14:37:28 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bfc538d-8637-4292-890b-a367f977d23c]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:37:28 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-67e91461-ba07-4849-9f63-518cadaff1fe tempest-GroupSnapshotsTest-1878904240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d2659de0-7a93-403b-a04f-62e2404f8b95 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:28 devstack sudo[94816]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:28 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-89265f7e-a3c5-4c82-baab-290525837433 tempest-VolumeSnapshotQuotasNegativeTestJSON-1925218350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ecf3319-3744-4c7f-8a40-9879645f2be6 -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8ecf3319-3744-4c7f-8a40-9879645f2be6.d0aea958-d853-4665-bd99-e90e275e924c" returned: 0 in 0.432s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:28 devstack cinder-volume[86310]: WARNING cinder.volume.drivers.remotefs [None req-89265f7e-a3c5-4c82-baab-290525837433 tempest-VolumeSnapshotQuotasNegativeTestJSON-1925218350 None] /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8ecf3319-3744-4c7f-8a40-9879645f2be6.d0aea958-d853-4665-bd99-e90e275e924c is being set with open permissions: ugo+rw Sep 23 14:37:28 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-89265f7e-a3c5-4c82-baab-290525837433 tempest-VolumeSnapshotQuotasNegativeTestJSON-1925218350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8ecf3319-3744-4c7f-8a40-9879645f2be6.d0aea958-d853-4665-bd99-e90e275e924c {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:28 devstack sudo[94832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8ecf3319-3744-4c7f-8a40-9879645f2be6.d0aea958-d853-4665-bd99-e90e275e924c Sep 23 14:37:28 devstack sudo[94832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:28 devstack sudo[94831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d2659de0-7a93-403b-a04f-62e2404f8b95 Sep 23 14:37:28 devstack sudo[94831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:28 devstack sudo[94832]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:28 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-89265f7e-a3c5-4c82-baab-290525837433 tempest-VolumeSnapshotQuotasNegativeTestJSON-1925218350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8ecf3319-3744-4c7f-8a40-9879645f2be6.d0aea958-d853-4665-bd99-e90e275e924c" returned: 0 in 0.279s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:28 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-89265f7e-a3c5-4c82-baab-290525837433 tempest-VolumeSnapshotQuotasNegativeTestJSON-1925218350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8ecf3319-3744-4c7f-8a40-9879645f2be6.info {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:28 devstack sudo[94841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8ecf3319-3744-4c7f-8a40-9879645f2be6.info Sep 23 14:37:28 devstack sudo[94841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:28 devstack sudo[94831]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:28 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-67e91461-ba07-4849-9f63-518cadaff1fe tempest-GroupSnapshotsTest-1878904240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d2659de0-7a93-403b-a04f-62e2404f8b95" returned: 0 in 0.420s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:28 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-67e91461-ba07-4849-9f63-518cadaff1fe tempest-GroupSnapshotsTest-1878904240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d2659de0-7a93-403b-a04f-62e2404f8b95.2d7cf593-c4c8-4fee-9b6f-5d567e10764b {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:28 devstack sudo[94845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d2659de0-7a93-403b-a04f-62e2404f8b95.2d7cf593-c4c8-4fee-9b6f-5d567e10764b Sep 23 14:37:28 devstack sudo[94845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:28 devstack sudo[94841]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:28 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-89265f7e-a3c5-4c82-baab-290525837433 tempest-VolumeSnapshotQuotasNegativeTestJSON-1925218350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8ecf3319-3744-4c7f-8a40-9879645f2be6.info" returned: 0 in 0.271s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:28 devstack cinder-volume[86310]: WARNING cinder.volume.drivers.remotefs [None req-89265f7e-a3c5-4c82-baab-290525837433 tempest-VolumeSnapshotQuotasNegativeTestJSON-1925218350 None] /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8ecf3319-3744-4c7f-8a40-9879645f2be6.info is being set with open permissions: ugo+rw Sep 23 14:37:28 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-89265f7e-a3c5-4c82-baab-290525837433 tempest-VolumeSnapshotQuotasNegativeTestJSON-1925218350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8ecf3319-3744-4c7f-8a40-9879645f2be6.info {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:28 devstack sudo[94848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8ecf3319-3744-4c7f-8a40-9879645f2be6.info Sep 23 14:37:28 devstack sudo[94848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:29 devstack sudo[94845]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:29 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-67e91461-ba07-4849-9f63-518cadaff1fe tempest-GroupSnapshotsTest-1878904240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d2659de0-7a93-403b-a04f-62e2404f8b95.2d7cf593-c4c8-4fee-9b6f-5d567e10764b" returned: 0 in 0.333s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:29 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-67e91461-ba07-4849-9f63-518cadaff1fe tempest-GroupSnapshotsTest-1878904240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d2659de0-7a93-403b-a04f-62e2404f8b95.2d7cf593-c4c8-4fee-9b6f-5d567e10764b {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:29 devstack sudo[94853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d2659de0-7a93-403b-a04f-62e2404f8b95.2d7cf593-c4c8-4fee-9b6f-5d567e10764b Sep 23 14:37:29 devstack sudo[94853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:29 devstack sudo[94848]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:29 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-89265f7e-a3c5-4c82-baab-290525837433 tempest-VolumeSnapshotQuotasNegativeTestJSON-1925218350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8ecf3319-3744-4c7f-8a40-9879645f2be6.info" returned: 0 in 0.266s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:29 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-89265f7e-a3c5-4c82-baab-290525837433 tempest-VolumeSnapshotQuotasNegativeTestJSON-1925218350 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.325s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:37:29 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-bd4877c8-abcf-4fc0-875b-051ebab91811 tempest-SnapshotsActionsTest-1506064885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.167s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:37:29 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-bd4877c8-abcf-4fc0-875b-051ebab91811 tempest-SnapshotsActionsTest-1506064885 None] Creating offline snapshot e53ee00c-8198-4716-a897-4d7888674308 of volume fdca4f83-4751-4786-a502-ff3a27b0a1da {{(pid=86310) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 14:37:29 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-89265f7e-a3c5-4c82-baab-290525837433 tempest-VolumeSnapshotQuotasNegativeTestJSON-1925218350 None] Create snapshot completed successfully Sep 23 14:37:29 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d28e88-7d09-4437-949b-7e170c88195b]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:37:29 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-bd4877c8-abcf-4fc0-875b-051ebab91811 tempest-SnapshotsActionsTest-1506064885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.92c1f448-97e4-498b-8f82-cff2a39ed421 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:29 devstack sudo[94853]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:29 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-67e91461-ba07-4849-9f63-518cadaff1fe tempest-GroupSnapshotsTest-1878904240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d2659de0-7a93-403b-a04f-62e2404f8b95.2d7cf593-c4c8-4fee-9b6f-5d567e10764b" returned: 0 in 0.288s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:29 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-67e91461-ba07-4849-9f63-518cadaff1fe tempest-GroupSnapshotsTest-1878904240 None] Lock "cinder-quobyte-2d7cf593-c4c8-4fee-9b6f-5d567e10764b" released by "_delete_snapshot" :: held 1.592s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:37:29 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-67e91461-ba07-4849-9f63-518cadaff1fe tempest-GroupSnapshotsTest-1878904240 None] Lock "cinder-quobyte-d2659de0-7a93-403b-a04f-62e2404f8b95" released by "delete_snapshot" :: held 1.623s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:37:29 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-67e91461-ba07-4849-9f63-518cadaff1fe tempest-GroupSnapshotsTest-1878904240 None] Acquiring lock "cinder-quobyte-eccdb0d9-179f-4f2e-966e-ab00dcd954d6" by "delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:37:29 devstack sudo[94857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.92c1f448-97e4-498b-8f82-cff2a39ed421 Sep 23 14:37:29 devstack sudo[94857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:29 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-67e91461-ba07-4849-9f63-518cadaff1fe tempest-GroupSnapshotsTest-1878904240 None] Lock "cinder-quobyte-eccdb0d9-179f-4f2e-966e-ab00dcd954d6" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:37:29 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-67e91461-ba07-4849-9f63-518cadaff1fe tempest-GroupSnapshotsTest-1878904240 None] Acquiring lock "cinder-quobyte-7f12b452-a025-4eaa-a0dd-6471794ef608" by "_delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:37:29 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-67e91461-ba07-4849-9f63-518cadaff1fe tempest-GroupSnapshotsTest-1878904240 None] Lock "cinder-quobyte-7f12b452-a025-4eaa-a0dd-6471794ef608" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:37:29 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-67e91461-ba07-4849-9f63-518cadaff1fe tempest-GroupSnapshotsTest-1878904240 None] Deleting offline snapshot 7f12b452-a025-4eaa-a0dd-6471794ef608 of volume eccdb0d9-179f-4f2e-966e-ab00dcd954d6 {{(pid=86310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 14:37:29 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-67e91461-ba07-4849-9f63-518cadaff1fe tempest-GroupSnapshotsTest-1878904240 None] snapshot_file for this snap is: volume-eccdb0d9-179f-4f2e-966e-ab00dcd954d6.7f12b452-a025-4eaa-a0dd-6471794ef608 {{(pid=86310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 14:37:29 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[965103c9-6f70-4ffa-8701-034ee652f1f2]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:37:29 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-67e91461-ba07-4849-9f63-518cadaff1fe tempest-GroupSnapshotsTest-1878904240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-eccdb0d9-179f-4f2e-966e-ab00dcd954d6.7f12b452-a025-4eaa-a0dd-6471794ef608 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:29 devstack sudo[94859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-eccdb0d9-179f-4f2e-966e-ab00dcd954d6.7f12b452-a025-4eaa-a0dd-6471794ef608 Sep 23 14:37:29 devstack sudo[94859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:29 devstack sudo[94857]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:29 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-bd4877c8-abcf-4fc0-875b-051ebab91811 tempest-SnapshotsActionsTest-1506064885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.92c1f448-97e4-498b-8f82-cff2a39ed421" returned: 0 in 0.419s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:29 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-bd4877c8-abcf-4fc0-875b-051ebab91811 tempest-SnapshotsActionsTest-1506064885 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fdca4f83-4751-4786-a502-ff3a27b0a1da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 14:37:29 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-bd4877c8-abcf-4fc0-875b-051ebab91811 tempest-SnapshotsActionsTest-1506064885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.92c1f448-97e4-498b-8f82-cff2a39ed421,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.e53ee00c-8198-4716-a897-4d7888674308 1G {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:29 devstack sudo[94864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.92c1f448-97e4-498b-8f82-cff2a39ed421,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.e53ee00c-8198-4716-a897-4d7888674308 1G Sep 23 14:37:29 devstack sudo[94864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:29 devstack sudo[94859]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:29 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-67e91461-ba07-4849-9f63-518cadaff1fe tempest-GroupSnapshotsTest-1878904240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-eccdb0d9-179f-4f2e-966e-ab00dcd954d6.7f12b452-a025-4eaa-a0dd-6471794ef608" returned: 0 in 0.416s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:29 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-67e91461-ba07-4849-9f63-518cadaff1fe tempest-GroupSnapshotsTest-1878904240 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eccdb0d9-179f-4f2e-966e-ab00dcd954d6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 14:37:29 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[f012c063-1948-433b-9264-03394dceed9a]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:37:29 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-67e91461-ba07-4849-9f63-518cadaff1fe tempest-GroupSnapshotsTest-1878904240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-eccdb0d9-179f-4f2e-966e-ab00dcd954d6 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:30 devstack sudo[94870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-eccdb0d9-179f-4f2e-966e-ab00dcd954d6 Sep 23 14:37:30 devstack sudo[94870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:30 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-f9e02df8-511a-4141-9981-271ed0633796 tempest-VolumeSnapshotQuotasNegativeTestJSON-1925218350 None] Acquiring lock "cinder-d0aea958-d853-4665-bd99-e90e275e924c-delete_snapshot" by "delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:37:30 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-f9e02df8-511a-4141-9981-271ed0633796 tempest-VolumeSnapshotQuotasNegativeTestJSON-1925218350 None] Lock "cinder-d0aea958-d853-4665-bd99-e90e275e924c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:37:30 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-f9e02df8-511a-4141-9981-271ed0633796 tempest-VolumeSnapshotQuotasNegativeTestJSON-1925218350 None] Acquiring lock "cinder-quobyte-8ecf3319-3744-4c7f-8a40-9879645f2be6" by "delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:37:30 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-f9e02df8-511a-4141-9981-271ed0633796 tempest-VolumeSnapshotQuotasNegativeTestJSON-1925218350 None] Lock "cinder-quobyte-8ecf3319-3744-4c7f-8a40-9879645f2be6" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:37:30 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-f9e02df8-511a-4141-9981-271ed0633796 tempest-VolumeSnapshotQuotasNegativeTestJSON-1925218350 None] Acquiring lock "cinder-quobyte-d0aea958-d853-4665-bd99-e90e275e924c" by "_delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:37:30 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-f9e02df8-511a-4141-9981-271ed0633796 tempest-VolumeSnapshotQuotasNegativeTestJSON-1925218350 None] Lock "cinder-quobyte-d0aea958-d853-4665-bd99-e90e275e924c" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:37:30 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-f9e02df8-511a-4141-9981-271ed0633796 tempest-VolumeSnapshotQuotasNegativeTestJSON-1925218350 None] Deleting offline snapshot d0aea958-d853-4665-bd99-e90e275e924c of volume 8ecf3319-3744-4c7f-8a40-9879645f2be6 {{(pid=86310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 14:37:30 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-f9e02df8-511a-4141-9981-271ed0633796 tempest-VolumeSnapshotQuotasNegativeTestJSON-1925218350 None] snapshot_file for this snap is: volume-8ecf3319-3744-4c7f-8a40-9879645f2be6.d0aea958-d853-4665-bd99-e90e275e924c {{(pid=86310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 14:37:30 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e002b7-8d60-4cfa-94b1-e8ea9556dc25]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:37:30 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-f9e02df8-511a-4141-9981-271ed0633796 tempest-VolumeSnapshotQuotasNegativeTestJSON-1925218350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8ecf3319-3744-4c7f-8a40-9879645f2be6.d0aea958-d853-4665-bd99-e90e275e924c {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:30 devstack sudo[94864]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:30 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-bd4877c8-abcf-4fc0-875b-051ebab91811 tempest-SnapshotsActionsTest-1506064885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.92c1f448-97e4-498b-8f82-cff2a39ed421,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.e53ee00c-8198-4716-a897-4d7888674308 1G" returned: 0 in 0.562s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:30 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-bd4877c8-abcf-4fc0-875b-051ebab91811 tempest-SnapshotsActionsTest-1506064885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.92c1f448-97e4-498b-8f82-cff2a39ed421 -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.e53ee00c-8198-4716-a897-4d7888674308 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:30 devstack sudo[94878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.92c1f448-97e4-498b-8f82-cff2a39ed421 -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.e53ee00c-8198-4716-a897-4d7888674308 Sep 23 14:37:30 devstack sudo[94878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:30 devstack sudo[94870]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:30 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-67e91461-ba07-4849-9f63-518cadaff1fe tempest-GroupSnapshotsTest-1878904240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-eccdb0d9-179f-4f2e-966e-ab00dcd954d6" returned: 0 in 0.439s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:30 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-67e91461-ba07-4849-9f63-518cadaff1fe tempest-GroupSnapshotsTest-1878904240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-eccdb0d9-179f-4f2e-966e-ab00dcd954d6.7f12b452-a025-4eaa-a0dd-6471794ef608 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:30 devstack sudo[94876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8ecf3319-3744-4c7f-8a40-9879645f2be6.d0aea958-d853-4665-bd99-e90e275e924c Sep 23 14:37:30 devstack sudo[94876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:30 devstack sudo[94881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-eccdb0d9-179f-4f2e-966e-ab00dcd954d6.7f12b452-a025-4eaa-a0dd-6471794ef608 Sep 23 14:37:30 devstack sudo[94881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:30 devstack sudo[94878]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:30 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-bd4877c8-abcf-4fc0-875b-051ebab91811 tempest-SnapshotsActionsTest-1506064885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.92c1f448-97e4-498b-8f82-cff2a39ed421 -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.e53ee00c-8198-4716-a897-4d7888674308" returned: 0 in 0.330s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:30 devstack cinder-volume[86310]: WARNING cinder.volume.drivers.remotefs [None req-bd4877c8-abcf-4fc0-875b-051ebab91811 tempest-SnapshotsActionsTest-1506064885 None] /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.e53ee00c-8198-4716-a897-4d7888674308 is being set with open permissions: ugo+rw Sep 23 14:37:30 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-bd4877c8-abcf-4fc0-875b-051ebab91811 tempest-SnapshotsActionsTest-1506064885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.e53ee00c-8198-4716-a897-4d7888674308 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:30 devstack sudo[94892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.e53ee00c-8198-4716-a897-4d7888674308 Sep 23 14:37:30 devstack sudo[94892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:30 devstack sudo[94876]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:30 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-f9e02df8-511a-4141-9981-271ed0633796 tempest-VolumeSnapshotQuotasNegativeTestJSON-1925218350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8ecf3319-3744-4c7f-8a40-9879645f2be6.d0aea958-d853-4665-bd99-e90e275e924c" returned: 0 in 0.389s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:30 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-f9e02df8-511a-4141-9981-271ed0633796 tempest-VolumeSnapshotQuotasNegativeTestJSON-1925218350 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8ecf3319-3744-4c7f-8a40-9879645f2be6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 14:37:30 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[9941069b-6753-4573-8ac3-782601cf3290]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:37:30 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-f9e02df8-511a-4141-9981-271ed0633796 tempest-VolumeSnapshotQuotasNegativeTestJSON-1925218350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8ecf3319-3744-4c7f-8a40-9879645f2be6 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:30 devstack sudo[94881]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:30 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-67e91461-ba07-4849-9f63-518cadaff1fe tempest-GroupSnapshotsTest-1878904240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-eccdb0d9-179f-4f2e-966e-ab00dcd954d6.7f12b452-a025-4eaa-a0dd-6471794ef608" returned: 0 in 0.360s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:30 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-67e91461-ba07-4849-9f63-518cadaff1fe tempest-GroupSnapshotsTest-1878904240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-eccdb0d9-179f-4f2e-966e-ab00dcd954d6.7f12b452-a025-4eaa-a0dd-6471794ef608 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:30 devstack sudo[94897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-eccdb0d9-179f-4f2e-966e-ab00dcd954d6.7f12b452-a025-4eaa-a0dd-6471794ef608 Sep 23 14:37:30 devstack sudo[94897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:30 devstack sudo[94896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8ecf3319-3744-4c7f-8a40-9879645f2be6 Sep 23 14:37:30 devstack sudo[94896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:30 devstack sudo[94892]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:30 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-bd4877c8-abcf-4fc0-875b-051ebab91811 tempest-SnapshotsActionsTest-1506064885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.e53ee00c-8198-4716-a897-4d7888674308" returned: 0 in 0.264s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:30 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-bd4877c8-abcf-4fc0-875b-051ebab91811 tempest-SnapshotsActionsTest-1506064885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.687s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:37:30 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-bd4877c8-abcf-4fc0-875b-051ebab91811 tempest-SnapshotsActionsTest-1506064885 None] Create snapshot completed successfully Sep 23 14:37:31 devstack sudo[94897]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:31 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-67e91461-ba07-4849-9f63-518cadaff1fe tempest-GroupSnapshotsTest-1878904240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-eccdb0d9-179f-4f2e-966e-ab00dcd954d6.7f12b452-a025-4eaa-a0dd-6471794ef608" returned: 0 in 0.256s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:31 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-67e91461-ba07-4849-9f63-518cadaff1fe tempest-GroupSnapshotsTest-1878904240 None] Lock "cinder-quobyte-7f12b452-a025-4eaa-a0dd-6471794ef608" released by "_delete_snapshot" :: held 1.581s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:37:31 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-67e91461-ba07-4849-9f63-518cadaff1fe tempest-GroupSnapshotsTest-1878904240 None] Lock "cinder-quobyte-eccdb0d9-179f-4f2e-966e-ab00dcd954d6" released by "delete_snapshot" :: held 1.601s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:37:31 devstack sudo[94896]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:31 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-f9e02df8-511a-4141-9981-271ed0633796 tempest-VolumeSnapshotQuotasNegativeTestJSON-1925218350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8ecf3319-3744-4c7f-8a40-9879645f2be6" returned: 0 in 0.378s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:31 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-f9e02df8-511a-4141-9981-271ed0633796 tempest-VolumeSnapshotQuotasNegativeTestJSON-1925218350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8ecf3319-3744-4c7f-8a40-9879645f2be6.d0aea958-d853-4665-bd99-e90e275e924c {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:31 devstack sudo[94905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8ecf3319-3744-4c7f-8a40-9879645f2be6.d0aea958-d853-4665-bd99-e90e275e924c Sep 23 14:37:31 devstack sudo[94905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:31 devstack cinder-volume[86310]: WARNING cinder.quota [None req-67e91461-ba07-4849-9f63-518cadaff1fe tempest-GroupSnapshotsTest-1878904240 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-773715271 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-773715271, it is now deprecated. Please use the default quota class for default quota. Sep 23 14:37:31 devstack cinder-volume[86310]: WARNING cinder.quota [None req-67e91461-ba07-4849-9f63-518cadaff1fe tempest-GroupSnapshotsTest-1878904240 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-773715271 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-773715271, it is now deprecated. Please use the default quota class for default quota. Sep 23 14:37:31 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-67e91461-ba07-4849-9f63-518cadaff1fe tempest-GroupSnapshotsTest-1878904240 None] Created reservations ['95f90624-ee97-405c-af92-c9ffb3936f52', 'd3a85eeb-9ada-4a65-b430-af5347a99f8e', 'f8bbe208-3ccf-4a12-b5a7-8e83fd0acc26', '3c41793d-0755-4343-91ce-95016a1f879a'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:37:31 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-67e91461-ba07-4849-9f63-518cadaff1fe tempest-GroupSnapshotsTest-1878904240 None] Created reservations ['aa3a1419-af78-4324-b538-65b25c15f7f8', '4445094f-ae79-44af-80ae-8ebeb7a56e88', 'aea7a109-807a-4fc0-a24e-4bf44f9480c7', 'a77c05d4-8086-4227-8c44-f673db3c5576'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:37:31 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-67e91461-ba07-4849-9f63-518cadaff1fe tempest-GroupSnapshotsTest-1878904240 None] group_snapshot 152941c8-abdd-4bd1-ba63-f524575d89cb: deleted successfully Sep 23 14:37:31 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-f881fc70-2435-492a-8a48-9cf5f22ac16d tempest-SnapshotsActionsTest-912270741 None] Acquiring lock "cinder-e53ee00c-8198-4716-a897-4d7888674308-delete_snapshot" by "delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:37:31 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-f881fc70-2435-492a-8a48-9cf5f22ac16d tempest-SnapshotsActionsTest-912270741 None] Lock "cinder-e53ee00c-8198-4716-a897-4d7888674308-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:37:31 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-f881fc70-2435-492a-8a48-9cf5f22ac16d tempest-SnapshotsActionsTest-912270741 None] Acquiring lock "cinder-quobyte-fdca4f83-4751-4786-a502-ff3a27b0a1da" by "delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:37:31 devstack sudo[94905]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:31 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-f9e02df8-511a-4141-9981-271ed0633796 tempest-VolumeSnapshotQuotasNegativeTestJSON-1925218350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8ecf3319-3744-4c7f-8a40-9879645f2be6.d0aea958-d853-4665-bd99-e90e275e924c" returned: 0 in 0.394s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:31 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-f9e02df8-511a-4141-9981-271ed0633796 tempest-VolumeSnapshotQuotasNegativeTestJSON-1925218350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8ecf3319-3744-4c7f-8a40-9879645f2be6.d0aea958-d853-4665-bd99-e90e275e924c {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:31 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-f881fc70-2435-492a-8a48-9cf5f22ac16d tempest-SnapshotsActionsTest-912270741 None] Lock "cinder-quobyte-fdca4f83-4751-4786-a502-ff3a27b0a1da" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:37:31 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-f881fc70-2435-492a-8a48-9cf5f22ac16d tempest-SnapshotsActionsTest-912270741 None] Acquiring lock "cinder-quobyte-e53ee00c-8198-4716-a897-4d7888674308" by "_delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:37:31 devstack sudo[94910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8ecf3319-3744-4c7f-8a40-9879645f2be6.d0aea958-d853-4665-bd99-e90e275e924c Sep 23 14:37:31 devstack sudo[94910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:31 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-f881fc70-2435-492a-8a48-9cf5f22ac16d tempest-SnapshotsActionsTest-912270741 None] Lock "cinder-quobyte-e53ee00c-8198-4716-a897-4d7888674308" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:37:31 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-f881fc70-2435-492a-8a48-9cf5f22ac16d tempest-SnapshotsActionsTest-912270741 None] Deleting offline snapshot e53ee00c-8198-4716-a897-4d7888674308 of volume fdca4f83-4751-4786-a502-ff3a27b0a1da {{(pid=86310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 14:37:31 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-f881fc70-2435-492a-8a48-9cf5f22ac16d tempest-SnapshotsActionsTest-912270741 None] snapshot_file for this snap is: volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.e53ee00c-8198-4716-a897-4d7888674308 {{(pid=86310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 14:37:31 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7b27eb2-e9ea-4aa1-8295-f294694939b3]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:37:31 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-f881fc70-2435-492a-8a48-9cf5f22ac16d tempest-SnapshotsActionsTest-912270741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.e53ee00c-8198-4716-a897-4d7888674308 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:31 devstack sudo[94912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.e53ee00c-8198-4716-a897-4d7888674308 Sep 23 14:37:31 devstack sudo[94912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:31 devstack sudo[94910]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:31 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-f9e02df8-511a-4141-9981-271ed0633796 tempest-VolumeSnapshotQuotasNegativeTestJSON-1925218350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8ecf3319-3744-4c7f-8a40-9879645f2be6.d0aea958-d853-4665-bd99-e90e275e924c" returned: 0 in 0.252s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:31 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-f9e02df8-511a-4141-9981-271ed0633796 tempest-VolumeSnapshotQuotasNegativeTestJSON-1925218350 None] Lock "cinder-quobyte-d0aea958-d853-4665-bd99-e90e275e924c" released by "_delete_snapshot" :: held 1.531s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:37:31 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-f9e02df8-511a-4141-9981-271ed0633796 tempest-VolumeSnapshotQuotasNegativeTestJSON-1925218350 None] Lock "cinder-quobyte-8ecf3319-3744-4c7f-8a40-9879645f2be6" released by "delete_snapshot" :: held 1.559s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:37:31 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-f9e02df8-511a-4141-9981-271ed0633796 tempest-VolumeSnapshotQuotasNegativeTestJSON-1925218350 None] Created reservations ['cbaa0bdb-7483-4187-a1b2-984881cf4b6b', 'e057ca29-c259-46e1-8b02-84911dfd69ca', 'fdb2d21d-af56-40f5-874f-44ee1ffb8bc1', '06d36c80-0cb8-4dfb-b288-ea7a41086b3d'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:37:31 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-f9e02df8-511a-4141-9981-271ed0633796 tempest-VolumeSnapshotQuotasNegativeTestJSON-1925218350 None] Delete snapshot completed successfully. Sep 23 14:37:31 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-f9e02df8-511a-4141-9981-271ed0633796 tempest-VolumeSnapshotQuotasNegativeTestJSON-1925218350 None] Lock "cinder-d0aea958-d853-4665-bd99-e90e275e924c-delete_snapshot" released by "delete_snapshot" :: held 1.726s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:37:31 devstack sudo[94912]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:31 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-f881fc70-2435-492a-8a48-9cf5f22ac16d tempest-SnapshotsActionsTest-912270741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.e53ee00c-8198-4716-a897-4d7888674308" returned: 0 in 0.410s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:31 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-f881fc70-2435-492a-8a48-9cf5f22ac16d tempest-SnapshotsActionsTest-912270741 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fdca4f83-4751-4786-a502-ff3a27b0a1da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 14:37:32 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee31c13c-4dd3-4abd-9f50-0dafd909025d]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:37:32 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-f881fc70-2435-492a-8a48-9cf5f22ac16d tempest-SnapshotsActionsTest-912270741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.92c1f448-97e4-498b-8f82-cff2a39ed421 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:32 devstack sudo[94943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.92c1f448-97e4-498b-8f82-cff2a39ed421 Sep 23 14:37:32 devstack sudo[94943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:32 devstack sudo[94943]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:32 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-e054b96b-bc7f-4765-86f9-227b12ef93f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1925218350 None] Acquiring lock "cinder-8ecf3319-3744-4c7f-8a40-9879645f2be6-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:37:32 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-f881fc70-2435-492a-8a48-9cf5f22ac16d tempest-SnapshotsActionsTest-912270741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.92c1f448-97e4-498b-8f82-cff2a39ed421" returned: 0 in 0.423s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:32 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-f881fc70-2435-492a-8a48-9cf5f22ac16d tempest-SnapshotsActionsTest-912270741 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fdca4f83-4751-4786-a502-ff3a27b0a1da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 14:37:32 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-f881fc70-2435-492a-8a48-9cf5f22ac16d tempest-SnapshotsActionsTest-912270741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.e53ee00c-8198-4716-a897-4d7888674308 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:32 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-e054b96b-bc7f-4765-86f9-227b12ef93f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1925218350 None] Lock "cinder-8ecf3319-3744-4c7f-8a40-9879645f2be6-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:37:32 devstack sudo[94948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.e53ee00c-8198-4716-a897-4d7888674308 Sep 23 14:37:32 devstack sudo[94948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:32 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-e054b96b-bc7f-4765-86f9-227b12ef93f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1925218350 None] Acquiring lock "cinder-quobyte-8ecf3319-3744-4c7f-8a40-9879645f2be6" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:37:32 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-e054b96b-bc7f-4765-86f9-227b12ef93f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1925218350 None] Lock "cinder-quobyte-8ecf3319-3744-4c7f-8a40-9879645f2be6" acquired by "delete_volume" :: waited 0.022s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:37:32 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ce9b54-760c-4c1c-91e3-6d6663505af8]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:37:32 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-e054b96b-bc7f-4765-86f9-227b12ef93f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1925218350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8ecf3319-3744-4c7f-8a40-9879645f2be6 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:32 devstack sudo[94950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8ecf3319-3744-4c7f-8a40-9879645f2be6 Sep 23 14:37:32 devstack sudo[94950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:32 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-b1ae76f3-9e95-4bac-b34a-ae54f04e78b8 tempest-GroupSnapshotsTest-1878904240 None] Acquiring lock "cinder-quobyte-d2659de0-7a93-403b-a04f-62e2404f8b95" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:37:32 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-b1ae76f3-9e95-4bac-b34a-ae54f04e78b8 tempest-GroupSnapshotsTest-1878904240 None] Lock "cinder-quobyte-d2659de0-7a93-403b-a04f-62e2404f8b95" acquired by "delete_volume" :: waited 0.022s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:37:32 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[b91ee960-633a-4751-84d9-dd325e786015]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:37:32 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-b1ae76f3-9e95-4bac-b34a-ae54f04e78b8 tempest-GroupSnapshotsTest-1878904240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d2659de0-7a93-403b-a04f-62e2404f8b95 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:32 devstack sudo[94948]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:32 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-f881fc70-2435-492a-8a48-9cf5f22ac16d tempest-SnapshotsActionsTest-912270741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.e53ee00c-8198-4716-a897-4d7888674308" returned: 0 in 0.493s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:32 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-f881fc70-2435-492a-8a48-9cf5f22ac16d tempest-SnapshotsActionsTest-912270741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.e53ee00c-8198-4716-a897-4d7888674308 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:32 devstack sudo[94958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.e53ee00c-8198-4716-a897-4d7888674308 Sep 23 14:37:32 devstack sudo[94958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:33 devstack sudo[94950]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:33 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-e054b96b-bc7f-4765-86f9-227b12ef93f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1925218350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8ecf3319-3744-4c7f-8a40-9879645f2be6" returned: 0 in 0.424s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:33 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-e054b96b-bc7f-4765-86f9-227b12ef93f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1925218350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8ecf3319-3744-4c7f-8a40-9879645f2be6 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:33 devstack sudo[94961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8ecf3319-3744-4c7f-8a40-9879645f2be6 Sep 23 14:37:33 devstack sudo[94961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:33 devstack sudo[94957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d2659de0-7a93-403b-a04f-62e2404f8b95 Sep 23 14:37:33 devstack sudo[94957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:33 devstack sudo[94958]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:33 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-f881fc70-2435-492a-8a48-9cf5f22ac16d tempest-SnapshotsActionsTest-912270741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.e53ee00c-8198-4716-a897-4d7888674308" returned: 0 in 0.271s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:33 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-f881fc70-2435-492a-8a48-9cf5f22ac16d tempest-SnapshotsActionsTest-912270741 None] Lock "cinder-quobyte-e53ee00c-8198-4716-a897-4d7888674308" released by "_delete_snapshot" :: held 1.717s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:37:33 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-f881fc70-2435-492a-8a48-9cf5f22ac16d tempest-SnapshotsActionsTest-912270741 None] Lock "cinder-quobyte-fdca4f83-4751-4786-a502-ff3a27b0a1da" released by "delete_snapshot" :: held 1.751s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:37:33 devstack sudo[94961]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:33 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-e054b96b-bc7f-4765-86f9-227b12ef93f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1925218350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8ecf3319-3744-4c7f-8a40-9879645f2be6" returned: 0 in 0.295s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:33 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-e054b96b-bc7f-4765-86f9-227b12ef93f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1925218350 None] Lock "cinder-quobyte-8ecf3319-3744-4c7f-8a40-9879645f2be6" released by "delete_volume" :: held 0.807s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:37:33 devstack sudo[94957]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:33 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-f881fc70-2435-492a-8a48-9cf5f22ac16d tempest-SnapshotsActionsTest-912270741 None] Created reservations ['30cb4bee-412e-476e-8d89-e6171494bddb', '0ff812be-aad3-410f-b0d0-6a3f7f0108c6', 'b28df980-bbb2-4964-b53a-8614937d8b15', '002c81c5-9ae7-4b9a-ae2d-ad13875477a3'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:37:33 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-b1ae76f3-9e95-4bac-b34a-ae54f04e78b8 tempest-GroupSnapshotsTest-1878904240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d2659de0-7a93-403b-a04f-62e2404f8b95" returned: 0 in 0.437s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:33 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-b1ae76f3-9e95-4bac-b34a-ae54f04e78b8 tempest-GroupSnapshotsTest-1878904240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d2659de0-7a93-403b-a04f-62e2404f8b95 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:33 devstack sudo[94975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d2659de0-7a93-403b-a04f-62e2404f8b95 Sep 23 14:37:33 devstack sudo[94975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:33 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-e054b96b-bc7f-4765-86f9-227b12ef93f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1925218350 None] Created reservations ['1489aecd-e1d5-4d6d-b9de-8438d824a51e', '0ccd80c7-1a2f-4fbe-bc35-7b5906861845', '1cc00305-50c3-4a2a-8561-4b474acfffe4', 'e34b2289-5368-4848-b913-b7097f613b90'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:37:33 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-f881fc70-2435-492a-8a48-9cf5f22ac16d tempest-SnapshotsActionsTest-912270741 None] Delete snapshot completed successfully. Sep 23 14:37:33 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-f881fc70-2435-492a-8a48-9cf5f22ac16d tempest-SnapshotsActionsTest-912270741 None] Lock "cinder-e53ee00c-8198-4716-a897-4d7888674308-delete_snapshot" released by "delete_snapshot" :: held 1.993s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:37:33 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-e054b96b-bc7f-4765-86f9-227b12ef93f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1925218350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:37:33 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-e054b96b-bc7f-4765-86f9-227b12ef93f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1925218350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:37:33 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-e054b96b-bc7f-4765-86f9-227b12ef93f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1925218350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:37:33 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-e054b96b-bc7f-4765-86f9-227b12ef93f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1925218350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:37:33 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-e054b96b-bc7f-4765-86f9-227b12ef93f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1925218350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:37:33 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-e054b96b-bc7f-4765-86f9-227b12ef93f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1925218350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:33 devstack sudo[94977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:37:33 devstack sudo[94977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:33 devstack sudo[94975]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:33 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-b1ae76f3-9e95-4bac-b34a-ae54f04e78b8 tempest-GroupSnapshotsTest-1878904240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d2659de0-7a93-403b-a04f-62e2404f8b95" returned: 0 in 0.293s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:33 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-b1ae76f3-9e95-4bac-b34a-ae54f04e78b8 tempest-GroupSnapshotsTest-1878904240 None] Lock "cinder-quobyte-d2659de0-7a93-403b-a04f-62e2404f8b95" released by "delete_volume" :: held 0.831s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:37:33 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-b1ae76f3-9e95-4bac-b34a-ae54f04e78b8 tempest-GroupSnapshotsTest-1878904240 None] Acquiring lock "cinder-quobyte-eccdb0d9-179f-4f2e-966e-ab00dcd954d6" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:37:33 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-b1ae76f3-9e95-4bac-b34a-ae54f04e78b8 tempest-GroupSnapshotsTest-1878904240 None] Lock "cinder-quobyte-eccdb0d9-179f-4f2e-966e-ab00dcd954d6" acquired by "delete_volume" :: waited 0.022s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:37:33 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ce5b67b-8412-4249-9ea7-ef5e7890d2a8]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:37:33 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-b1ae76f3-9e95-4bac-b34a-ae54f04e78b8 tempest-GroupSnapshotsTest-1878904240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-eccdb0d9-179f-4f2e-966e-ab00dcd954d6 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:33 devstack sudo[94977]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:33 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-e054b96b-bc7f-4765-86f9-227b12ef93f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1925218350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.384s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:33 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-e054b96b-bc7f-4765-86f9-227b12ef93f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1925218350 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:37:33 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-e054b96b-bc7f-4765-86f9-227b12ef93f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1925218350 None] Deleted volume successfully. Sep 23 14:37:33 devstack sudo[94980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-eccdb0d9-179f-4f2e-966e-ab00dcd954d6 Sep 23 14:37:33 devstack sudo[94980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:33 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-e054b96b-bc7f-4765-86f9-227b12ef93f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1925218350 None] Lock "cinder-8ecf3319-3744-4c7f-8a40-9879645f2be6-delete_volume" released by "delete_volume" :: held 1.471s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:37:34 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-f430c296-61cb-43f9-8642-1177576eeecf tempest-SnapshotsActionsTest-1506064885 None] Acquiring lock "cinder-92c1f448-97e4-498b-8f82-cff2a39ed421-delete_snapshot" by "delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:37:34 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-f430c296-61cb-43f9-8642-1177576eeecf tempest-SnapshotsActionsTest-1506064885 None] Lock "cinder-92c1f448-97e4-498b-8f82-cff2a39ed421-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:37:34 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-f430c296-61cb-43f9-8642-1177576eeecf tempest-SnapshotsActionsTest-1506064885 None] Acquiring lock "cinder-quobyte-fdca4f83-4751-4786-a502-ff3a27b0a1da" by "delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:37:34 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-f430c296-61cb-43f9-8642-1177576eeecf tempest-SnapshotsActionsTest-1506064885 None] Lock "cinder-quobyte-fdca4f83-4751-4786-a502-ff3a27b0a1da" acquired by "delete_snapshot" :: waited 0.042s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:37:34 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-f430c296-61cb-43f9-8642-1177576eeecf tempest-SnapshotsActionsTest-1506064885 None] Acquiring lock "cinder-quobyte-92c1f448-97e4-498b-8f82-cff2a39ed421" by "_delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:37:34 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-f430c296-61cb-43f9-8642-1177576eeecf tempest-SnapshotsActionsTest-1506064885 None] Lock "cinder-quobyte-92c1f448-97e4-498b-8f82-cff2a39ed421" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:37:34 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-f430c296-61cb-43f9-8642-1177576eeecf tempest-SnapshotsActionsTest-1506064885 None] Deleting offline snapshot 92c1f448-97e4-498b-8f82-cff2a39ed421 of volume fdca4f83-4751-4786-a502-ff3a27b0a1da {{(pid=86310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 14:37:34 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-f430c296-61cb-43f9-8642-1177576eeecf tempest-SnapshotsActionsTest-1506064885 None] snapshot_file for this snap is: volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.92c1f448-97e4-498b-8f82-cff2a39ed421 {{(pid=86310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 14:37:34 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bdb31f5-6af9-4f39-b759-646bddfd1d58]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:37:34 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-f430c296-61cb-43f9-8642-1177576eeecf tempest-SnapshotsActionsTest-1506064885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.92c1f448-97e4-498b-8f82-cff2a39ed421 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:34 devstack sudo[94980]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:34 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-b1ae76f3-9e95-4bac-b34a-ae54f04e78b8 tempest-GroupSnapshotsTest-1878904240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-eccdb0d9-179f-4f2e-966e-ab00dcd954d6" returned: 0 in 0.534s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:34 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-b1ae76f3-9e95-4bac-b34a-ae54f04e78b8 tempest-GroupSnapshotsTest-1878904240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-eccdb0d9-179f-4f2e-966e-ab00dcd954d6 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:34 devstack sudo[94987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-eccdb0d9-179f-4f2e-966e-ab00dcd954d6 Sep 23 14:37:34 devstack sudo[94987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:34 devstack sudo[94986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.92c1f448-97e4-498b-8f82-cff2a39ed421 Sep 23 14:37:34 devstack sudo[94986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:34 devstack sudo[94987]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:34 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-b1ae76f3-9e95-4bac-b34a-ae54f04e78b8 tempest-GroupSnapshotsTest-1878904240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-eccdb0d9-179f-4f2e-966e-ab00dcd954d6" returned: 0 in 0.362s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:34 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-b1ae76f3-9e95-4bac-b34a-ae54f04e78b8 tempest-GroupSnapshotsTest-1878904240 None] Lock "cinder-quobyte-eccdb0d9-179f-4f2e-966e-ab00dcd954d6" released by "delete_volume" :: held 0.990s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:37:34 devstack sudo[94986]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:34 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-f430c296-61cb-43f9-8642-1177576eeecf tempest-SnapshotsActionsTest-1506064885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.92c1f448-97e4-498b-8f82-cff2a39ed421" returned: 0 in 0.457s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:34 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-f430c296-61cb-43f9-8642-1177576eeecf tempest-SnapshotsActionsTest-1506064885 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fdca4f83-4751-4786-a502-ff3a27b0a1da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 14:37:34 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7a9018c-28be-4b53-a4e4-53939e7878c4]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:37:34 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-f430c296-61cb-43f9-8642-1177576eeecf tempest-SnapshotsActionsTest-1506064885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:34 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-b1ae76f3-9e95-4bac-b34a-ae54f04e78b8 tempest-GroupSnapshotsTest-1878904240 None] Created reservations ['3bd2c611-1f3f-42ad-a564-9fab62e5a99e'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:37:34 devstack cinder-volume[86310]: WARNING cinder.quota [None req-b1ae76f3-9e95-4bac-b34a-ae54f04e78b8 tempest-GroupSnapshotsTest-1878904240 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-773715271 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-773715271, it is now deprecated. Please use the default quota class for default quota. Sep 23 14:37:34 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-b1ae76f3-9e95-4bac-b34a-ae54f04e78b8 tempest-GroupSnapshotsTest-1878904240 None] Created reservations ['2b0f9280-61ec-4f42-80e6-2c6b3c517aa8', '955cd20e-f03b-404e-a960-32562dd0c713', 'a888691f-d324-471d-8bcc-e03cfe85c8d9', 'aa26e3c3-ace4-4a89-b22c-54963932962d'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:37:34 devstack sudo[94994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da Sep 23 14:37:34 devstack sudo[94994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:35 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-b1ae76f3-9e95-4bac-b34a-ae54f04e78b8 tempest-GroupSnapshotsTest-1878904240 None] Created reservations ['2bcb742f-e161-4c5b-bbc4-31d67e182f5b', 'c4d985f7-5a07-4f7f-849f-43eb189d12b6', 'b0434e5f-b322-4640-a9d7-da98297edd44', '25862b4b-8bb5-4a7b-b9b4-0031e63fe643'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:37:35 devstack sudo[94994]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:35 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-f430c296-61cb-43f9-8642-1177576eeecf tempest-SnapshotsActionsTest-1506064885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da" returned: 0 in 0.455s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:35 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-f430c296-61cb-43f9-8642-1177576eeecf tempest-SnapshotsActionsTest-1506064885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.92c1f448-97e4-498b-8f82-cff2a39ed421 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:35 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-b1ae76f3-9e95-4bac-b34a-ae54f04e78b8 tempest-GroupSnapshotsTest-1878904240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:37:35 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-b1ae76f3-9e95-4bac-b34a-ae54f04e78b8 tempest-GroupSnapshotsTest-1878904240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:37:35 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-b1ae76f3-9e95-4bac-b34a-ae54f04e78b8 tempest-GroupSnapshotsTest-1878904240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:37:35 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-b1ae76f3-9e95-4bac-b34a-ae54f04e78b8 tempest-GroupSnapshotsTest-1878904240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:37:35 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-b1ae76f3-9e95-4bac-b34a-ae54f04e78b8 tempest-GroupSnapshotsTest-1878904240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:37:35 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-b1ae76f3-9e95-4bac-b34a-ae54f04e78b8 tempest-GroupSnapshotsTest-1878904240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:35 devstack sudo[94999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.92c1f448-97e4-498b-8f82-cff2a39ed421 Sep 23 14:37:35 devstack sudo[94999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:35 devstack sudo[95001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:37:35 devstack sudo[95001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:35 devstack sudo[95001]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:35 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-b1ae76f3-9e95-4bac-b34a-ae54f04e78b8 tempest-GroupSnapshotsTest-1878904240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.405s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:35 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-b1ae76f3-9e95-4bac-b34a-ae54f04e78b8 tempest-GroupSnapshotsTest-1878904240 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:37:35 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-b1ae76f3-9e95-4bac-b34a-ae54f04e78b8 tempest-GroupSnapshotsTest-1878904240 None] Delete group completed successfully. Sep 23 14:37:35 devstack sudo[94999]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:35 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-f430c296-61cb-43f9-8642-1177576eeecf tempest-SnapshotsActionsTest-1506064885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.92c1f448-97e4-498b-8f82-cff2a39ed421" returned: 0 in 0.681s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:35 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-f430c296-61cb-43f9-8642-1177576eeecf tempest-SnapshotsActionsTest-1506064885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.92c1f448-97e4-498b-8f82-cff2a39ed421 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:35 devstack sudo[95009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.92c1f448-97e4-498b-8f82-cff2a39ed421 Sep 23 14:37:35 devstack sudo[95009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:36 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-bb057b8f-b44a-421a-a5c2-fec069b25265 tempest-GroupSnapshotsTest-1878904240 None] Group tempest-GroupSnapshotsTest-Group-1668239446: creating Sep 23 14:37:36 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-bb057b8f-b44a-421a-a5c2-fec069b25265 tempest-GroupSnapshotsTest-1878904240 None] Group tempest-GroupSnapshotsTest-Group-1668239446: created successfully Sep 23 14:37:36 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-bb057b8f-b44a-421a-a5c2-fec069b25265 tempest-GroupSnapshotsTest-1878904240 None] Create group completed successfully. Sep 23 14:37:36 devstack sudo[95009]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:36 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-f430c296-61cb-43f9-8642-1177576eeecf tempest-SnapshotsActionsTest-1506064885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da.92c1f448-97e4-498b-8f82-cff2a39ed421" returned: 0 in 0.392s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:36 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-f430c296-61cb-43f9-8642-1177576eeecf tempest-SnapshotsActionsTest-1506064885 None] Lock "cinder-quobyte-92c1f448-97e4-498b-8f82-cff2a39ed421" released by "_delete_snapshot" :: held 2.170s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:37:36 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-f430c296-61cb-43f9-8642-1177576eeecf tempest-SnapshotsActionsTest-1506064885 None] Lock "cinder-quobyte-fdca4f83-4751-4786-a502-ff3a27b0a1da" released by "delete_snapshot" :: held 2.209s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:37:36 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-f430c296-61cb-43f9-8642-1177576eeecf tempest-SnapshotsActionsTest-1506064885 None] Created reservations ['339d8f63-8a2a-4328-b786-abdfcfa7b8a7', 'aa62b41e-f44e-41aa-ba99-f9081a3c7e7f', '3d370bc5-4d83-4862-9c82-d92e5886072a', '98558fe5-42df-478d-8001-0e07024808bb'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:37:36 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-f430c296-61cb-43f9-8642-1177576eeecf tempest-SnapshotsActionsTest-1506064885 None] Delete snapshot completed successfully. Sep 23 14:37:36 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-f430c296-61cb-43f9-8642-1177576eeecf tempest-SnapshotsActionsTest-1506064885 None] Lock "cinder-92c1f448-97e4-498b-8f82-cff2a39ed421-delete_snapshot" released by "delete_snapshot" :: held 2.393s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:37:37 devstack cinder-volume[86310]: INFO cinder.volume.manager [req-27f87775-23a3-4206-9ab7-b0a0b2f6dd90 req-85d924ca-e916-41f6-827e-7f03e05e7010 tempest-AttachVolumeTestJSON-760750814 None] Terminate volume connection completed successfully. Sep 23 14:37:37 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [req-27f87775-23a3-4206-9ab7-b0a0b2f6dd90 req-85d924ca-e916-41f6-827e-7f03e05e7010 tempest-AttachVolumeTestJSON-760750814 None] Deleting attachment 16c40ee1-135f-4e8e-991c-2342f384e025. {{(pid=86310) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 14:37:37 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-fc74a1bd-be8f-4929-86fc-0999cb24fd70 tempest-SnapshotsActionsTest-1506064885 None] Acquiring lock "cinder-fdca4f83-4751-4786-a502-ff3a27b0a1da-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:37:37 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-fc74a1bd-be8f-4929-86fc-0999cb24fd70 tempest-SnapshotsActionsTest-1506064885 None] Lock "cinder-fdca4f83-4751-4786-a502-ff3a27b0a1da-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:37:37 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-fc74a1bd-be8f-4929-86fc-0999cb24fd70 tempest-SnapshotsActionsTest-1506064885 None] Acquiring lock "cinder-quobyte-fdca4f83-4751-4786-a502-ff3a27b0a1da" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:37:37 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-fc74a1bd-be8f-4929-86fc-0999cb24fd70 tempest-SnapshotsActionsTest-1506064885 None] Lock "cinder-quobyte-fdca4f83-4751-4786-a502-ff3a27b0a1da" acquired by "delete_volume" :: waited 0.017s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:37:37 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6db3bee-e5b0-4466-b1b7-39d5b5f574b6]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:37:37 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-fc74a1bd-be8f-4929-86fc-0999cb24fd70 tempest-SnapshotsActionsTest-1506064885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:37 devstack sudo[95018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da Sep 23 14:37:37 devstack sudo[95018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:37 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3e20c10-14c8-4909-ba32-6b4a709803aa tempest-GroupSnapshotsTest-1878904240 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:37:37 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-f3e20c10-14c8-4909-ba32-6b4a709803aa tempest-GroupSnapshotsTest-1878904240 None] Flow 'volume_create_manager' (86081339-dd3d-4b44-913f-99e77ef9aa55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:37:38 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-f3e20c10-14c8-4909-ba32-6b4a709803aa tempest-GroupSnapshotsTest-1878904240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f50f0204-e81a-463e-b0ab-819bdb25a78d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:37:38 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-f3e20c10-14c8-4909-ba32-6b4a709803aa tempest-GroupSnapshotsTest-1878904240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f50f0204-e81a-463e-b0ab-819bdb25a78d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:37:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-97818310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d17d270c-e9ba-44bb-95d1-243f15331bbf,host='devstack@QuobyteHD#QuobyteHD',id=53847842-eb1c-476d-aa59-ec77710f0dbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2999c542f573402d95e56f45bd48a68f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:37:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:37:38Z,use_quota=True,user_id='084cc64e7b844f9992be81b9145ff791',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd17122b-f40a-4fd7-9f5d-c34428d14d70),volume_type_id=bd17122b-f40a-4fd7-9f5d-c34428d14d70)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:37:38 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-f3e20c10-14c8-4909-ba32-6b4a709803aa tempest-GroupSnapshotsTest-1878904240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8881a908-6542-46b0-82d5-be7c1d1abd49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:37:38 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-f3e20c10-14c8-4909-ba32-6b4a709803aa tempest-GroupSnapshotsTest-1878904240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8881a908-6542-46b0-82d5-be7c1d1abd49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:37:38 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-f3e20c10-14c8-4909-ba32-6b4a709803aa tempest-GroupSnapshotsTest-1878904240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (936a1f8e-2ffb-49fd-b461-e3e69973f58e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:37:38 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-f3e20c10-14c8-4909-ba32-6b4a709803aa tempest-GroupSnapshotsTest-1878904240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (936a1f8e-2ffb-49fd-b461-e3e69973f58e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53847842-eb1c-476d-aa59-ec77710f0dbc', 'volume_name': 'volume-53847842-eb1c-476d-aa59-ec77710f0dbc', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:37:38 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-f3e20c10-14c8-4909-ba32-6b4a709803aa tempest-GroupSnapshotsTest-1878904240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b7917b9-5c5a-4c17-9b10-fef154f37549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:37:38 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-f3e20c10-14c8-4909-ba32-6b4a709803aa tempest-GroupSnapshotsTest-1878904240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b7917b9-5c5a-4c17-9b10-fef154f37549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:37:38 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-f3e20c10-14c8-4909-ba32-6b4a709803aa tempest-GroupSnapshotsTest-1878904240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e6f0d25-4d44-40fe-9fb4-13dd6e974207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:37:38 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-f3e20c10-14c8-4909-ba32-6b4a709803aa tempest-GroupSnapshotsTest-1878904240 None] Volume 53847842-eb1c-476d-aa59-ec77710f0dbc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53847842-eb1c-476d-aa59-ec77710f0dbc', 'volume_size': 1} Sep 23 14:37:38 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-f3e20c10-14c8-4909-ba32-6b4a709803aa tempest-GroupSnapshotsTest-1878904240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:37:38 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-f3e20c10-14c8-4909-ba32-6b4a709803aa tempest-GroupSnapshotsTest-1878904240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:37:38 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-f3e20c10-14c8-4909-ba32-6b4a709803aa tempest-GroupSnapshotsTest-1878904240 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d17d270c-e9ba-44bb-95d1-243f15331bbf,created_at=2026-09-23T12:37:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-97818310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d17d270c-e9ba-44bb-95d1-243f15331bbf,host='devstack@QuobyteHD#QuobyteHD',id=53847842-eb1c-476d-aa59-ec77710f0dbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2999c542f573402d95e56f45bd48a68f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:37:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:37:38Z,use_quota=True,user_id='084cc64e7b844f9992be81b9145ff791',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd17122b-f40a-4fd7-9f5d-c34428d14d70),volume_type_id=bd17122b-f40a-4fd7-9f5d-c34428d14d70)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:37:38 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-f3e20c10-14c8-4909-ba32-6b4a709803aa tempest-GroupSnapshotsTest-1878904240 None] Creating volume 53847842-eb1c-476d-aa59-ec77710f0dbc {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:37:38 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-f3e20c10-14c8-4909-ba32-6b4a709803aa tempest-GroupSnapshotsTest-1878904240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:37:38 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-f3e20c10-14c8-4909-ba32-6b4a709803aa tempest-GroupSnapshotsTest-1878904240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:37:38 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-f3e20c10-14c8-4909-ba32-6b4a709803aa tempest-GroupSnapshotsTest-1878904240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:37:38 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-f3e20c10-14c8-4909-ba32-6b4a709803aa tempest-GroupSnapshotsTest-1878904240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:37:38 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-f3e20c10-14c8-4909-ba32-6b4a709803aa tempest-GroupSnapshotsTest-1878904240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:37:38 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-f3e20c10-14c8-4909-ba32-6b4a709803aa tempest-GroupSnapshotsTest-1878904240 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:37:38 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-f3e20c10-14c8-4909-ba32-6b4a709803aa tempest-GroupSnapshotsTest-1878904240 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:37:38 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-f3e20c10-14c8-4909-ba32-6b4a709803aa tempest-GroupSnapshotsTest-1878904240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-53847842-eb1c-476d-aa59-ec77710f0dbc 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:38 devstack sudo[95020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-53847842-eb1c-476d-aa59-ec77710f0dbc 1073741824 Sep 23 14:37:38 devstack sudo[95020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:38 devstack sudo[95018]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:38 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-fc74a1bd-be8f-4929-86fc-0999cb24fd70 tempest-SnapshotsActionsTest-1506064885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da" returned: 0 in 0.553s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:38 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-fc74a1bd-be8f-4929-86fc-0999cb24fd70 tempest-SnapshotsActionsTest-1506064885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:38 devstack sudo[95025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da Sep 23 14:37:38 devstack sudo[95025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:38 devstack sudo[95025]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:38 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-fc74a1bd-be8f-4929-86fc-0999cb24fd70 tempest-SnapshotsActionsTest-1506064885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fdca4f83-4751-4786-a502-ff3a27b0a1da" returned: 0 in 0.347s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:38 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-fc74a1bd-be8f-4929-86fc-0999cb24fd70 tempest-SnapshotsActionsTest-1506064885 None] Lock "cinder-quobyte-fdca4f83-4751-4786-a502-ff3a27b0a1da" released by "delete_volume" :: held 1.001s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:37:38 devstack sudo[95020]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:38 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-f3e20c10-14c8-4909-ba32-6b4a709803aa tempest-GroupSnapshotsTest-1878904240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-53847842-eb1c-476d-aa59-ec77710f0dbc 1073741824" returned: 0 in 0.670s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:38 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-fc74a1bd-be8f-4929-86fc-0999cb24fd70 tempest-SnapshotsActionsTest-1506064885 None] Created reservations ['34359172-6cad-474f-be89-8b78eee18eb5', 'c1246a09-9bd0-40c5-9970-6a2ed59fdd6e', '1ce0f724-b946-47df-afdd-5bf8c2b0a182', 'efb69d3b-1c6a-4f14-9499-bf6836070c59'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:37:38 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-f3e20c10-14c8-4909-ba32-6b4a709803aa tempest-GroupSnapshotsTest-1878904240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-53847842-eb1c-476d-aa59-ec77710f0dbc {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:38 devstack sudo[95036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-53847842-eb1c-476d-aa59-ec77710f0dbc Sep 23 14:37:38 devstack sudo[95036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:38 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-fc74a1bd-be8f-4929-86fc-0999cb24fd70 tempest-SnapshotsActionsTest-1506064885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:37:38 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-fc74a1bd-be8f-4929-86fc-0999cb24fd70 tempest-SnapshotsActionsTest-1506064885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:37:38 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-fc74a1bd-be8f-4929-86fc-0999cb24fd70 tempest-SnapshotsActionsTest-1506064885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:37:38 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-fc74a1bd-be8f-4929-86fc-0999cb24fd70 tempest-SnapshotsActionsTest-1506064885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:37:38 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-fc74a1bd-be8f-4929-86fc-0999cb24fd70 tempest-SnapshotsActionsTest-1506064885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:37:38 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-fc74a1bd-be8f-4929-86fc-0999cb24fd70 tempest-SnapshotsActionsTest-1506064885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:38 devstack sudo[95038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:37:38 devstack sudo[95038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:39 devstack sudo[95036]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:39 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-f3e20c10-14c8-4909-ba32-6b4a709803aa tempest-GroupSnapshotsTest-1878904240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-53847842-eb1c-476d-aa59-ec77710f0dbc" returned: 0 in 0.289s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:39 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-f3e20c10-14c8-4909-ba32-6b4a709803aa tempest-GroupSnapshotsTest-1878904240 None] <== create_volume: return (1009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:37:39 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-f3e20c10-14c8-4909-ba32-6b4a709803aa tempest-GroupSnapshotsTest-1878904240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.012s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:37:39 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-f3e20c10-14c8-4909-ba32-6b4a709803aa tempest-GroupSnapshotsTest-1878904240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e6f0d25-4d44-40fe-9fb4-13dd6e974207) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53847842-eb1c-476d-aa59-ec77710f0dbc', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:37:39 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-f3e20c10-14c8-4909-ba32-6b4a709803aa tempest-GroupSnapshotsTest-1878904240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4e9789c-aad7-419a-871a-23c44ec45296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:37:39 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-f3e20c10-14c8-4909-ba32-6b4a709803aa tempest-GroupSnapshotsTest-1878904240 None] Volume volume-53847842-eb1c-476d-aa59-ec77710f0dbc (53847842-eb1c-476d-aa59-ec77710f0dbc): created successfully Sep 23 14:37:39 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-f3e20c10-14c8-4909-ba32-6b4a709803aa tempest-GroupSnapshotsTest-1878904240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4e9789c-aad7-419a-871a-23c44ec45296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:37:39 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-f3e20c10-14c8-4909-ba32-6b4a709803aa tempest-GroupSnapshotsTest-1878904240 None] Flow 'volume_create_manager' (86081339-dd3d-4b44-913f-99e77ef9aa55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:37:39 devstack sudo[95038]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:39 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-f3e20c10-14c8-4909-ba32-6b4a709803aa tempest-GroupSnapshotsTest-1878904240 None] Created volume successfully. Sep 23 14:37:39 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-fc74a1bd-be8f-4929-86fc-0999cb24fd70 tempest-SnapshotsActionsTest-1506064885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.277s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:39 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-fc74a1bd-be8f-4929-86fc-0999cb24fd70 tempest-SnapshotsActionsTest-1506064885 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:37:39 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-fc74a1bd-be8f-4929-86fc-0999cb24fd70 tempest-SnapshotsActionsTest-1506064885 None] Deleted volume successfully. Sep 23 14:37:39 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-fc74a1bd-be8f-4929-86fc-0999cb24fd70 tempest-SnapshotsActionsTest-1506064885 None] Lock "cinder-fdca4f83-4751-4786-a502-ff3a27b0a1da-delete_volume" released by "delete_volume" :: held 1.567s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:37:40 devstack cinder-volume[86310]: DEBUG dbcounter [-] [86310] Writing DB stats cinder:UPDATE=206,cinder:SELECT=184,cinder:INSERT=52,cinder:DELETE=6 {{(pid=86310) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 14:37:40 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-d9ce1379-9062-4b34-ac73-3f90f99ad2bf tempest-GroupSnapshotsTest-1878904240 None] GroupSnapshot 95ded36c-0487-4ce6-ab36-7b13c8da022a: creating. Sep 23 14:37:40 devstack cinder-volume[86310]: DEBUG dbcounter [-] [86310] Writing DB stats cinder:UPDATE=183,cinder:SELECT=199,cinder:INSERT=44,cinder:DELETE=12 {{(pid=86310) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 14:37:40 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-02e544ba-d8fc-4f46-b9d7-e74283d464e6 tempest-VolumesImageMetadata-2060991037 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:37:40 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-02e544ba-d8fc-4f46-b9d7-e74283d464e6 tempest-VolumesImageMetadata-2060991037 None] Flow 'volume_create_manager' (a40ca49a-da58-461f-a5aa-dbe3bb7ab622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:37:40 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-02e544ba-d8fc-4f46-b9d7-e74283d464e6 tempest-VolumesImageMetadata-2060991037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a73f7bf4-bf29-490f-9d2d-4853ac32d981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:37:40 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-02e544ba-d8fc-4f46-b9d7-e74283d464e6 tempest-VolumesImageMetadata-2060991037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a73f7bf4-bf29-490f-9d2d-4853ac32d981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:37:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1582106481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b6b8415-2459-4c63-9e14-48c9620a6403,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e8076d0c7a140608528a2e0b1f5202e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:37:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:37:41Z,use_quota=True,user_id='17d9411de50c4b008d2faeb88ed543bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:37:40 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-02e544ba-d8fc-4f46-b9d7-e74283d464e6 tempest-VolumesImageMetadata-2060991037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0411c30-2888-4fcf-8b1f-a015a2a358ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:37:40 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-02e544ba-d8fc-4f46-b9d7-e74283d464e6 tempest-VolumesImageMetadata-2060991037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0411c30-2888-4fcf-8b1f-a015a2a358ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:37:40 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-02e544ba-d8fc-4f46-b9d7-e74283d464e6 tempest-VolumesImageMetadata-2060991037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b0ab566-1d08-4fa2-aad4-b1fd79d4c4a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:37:40 devstack cinder-volume[86310]: DEBUG cinder.image.glance [None req-02e544ba-d8fc-4f46-b9d7-e74283d464e6 tempest-VolumesImageMetadata-2060991037 None] Creating Keystone auth plugin from conf {{(pid=86310) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 23 14:37:40 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-d9ce1379-9062-4b34-ac73-3f90f99ad2bf tempest-GroupSnapshotsTest-1878904240 None] Group snapshot 95ded36c-0487-4ce6-ab36-7b13c8da022a: creating. {{(pid=86310) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 23 14:37:40 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-d9ce1379-9062-4b34-ac73-3f90f99ad2bf tempest-GroupSnapshotsTest-1878904240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:37:40 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-d9ce1379-9062-4b34-ac73-3f90f99ad2bf tempest-GroupSnapshotsTest-1878904240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:37:40 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-d9ce1379-9062-4b34-ac73-3f90f99ad2bf tempest-GroupSnapshotsTest-1878904240 None] Creating offline snapshot 56abaf44-23ee-450d-bca4-4c43f5b6d33b of volume 53847842-eb1c-476d-aa59-ec77710f0dbc {{(pid=86310) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 14:37:40 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf92b36b-a51e-4157-b4a7-3cb076990733]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:37:41 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d9ce1379-9062-4b34-ac73-3f90f99ad2bf tempest-GroupSnapshotsTest-1878904240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-53847842-eb1c-476d-aa59-ec77710f0dbc {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:41 devstack sudo[95043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-53847842-eb1c-476d-aa59-ec77710f0dbc Sep 23 14:37:41 devstack sudo[95043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:41 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-02e544ba-d8fc-4f46-b9d7-e74283d464e6 tempest-VolumesImageMetadata-2060991037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b0ab566-1d08-4fa2-aad4-b1fd79d4c4a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9b6b8415-2459-4c63-9e14-48c9620a6403', 'volume_name': 'volume-9b6b8415-2459-4c63-9e14-48c9620a6403', 'volume_size': 1, 'image_id': '0cd395f9-e766-4e32-94b1-775454bf3449', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0cd395f9-e766-4e32-94b1-775454bf3449', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7fa20aad952548c880b3288dd7d64dbc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0cd395f9-e766-4e32-94b1-775454bf3449', 'created_at': datetime.datetime(2026, 9, 23, 12, 25, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 23, 12, 25, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0cd395f9-e766-4e32-94b1-775454bf3449/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:37:41 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-02e544ba-d8fc-4f46-b9d7-e74283d464e6 tempest-VolumesImageMetadata-2060991037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64a07906-8dab-4b1b-b898-6850909f4882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:37:41 devstack sudo[95043]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:41 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-02e544ba-d8fc-4f46-b9d7-e74283d464e6 tempest-VolumesImageMetadata-2060991037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64a07906-8dab-4b1b-b898-6850909f4882) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:37:41 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-02e544ba-d8fc-4f46-b9d7-e74283d464e6 tempest-VolumesImageMetadata-2060991037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b63295b2-b3b3-49c7-81d6-dc1f1dc47a3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:37:41 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-02e544ba-d8fc-4f46-b9d7-e74283d464e6 tempest-VolumesImageMetadata-2060991037 None] Volume 9b6b8415-2459-4c63-9e14-48c9620a6403: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9b6b8415-2459-4c63-9e14-48c9620a6403', 'volume_size': 1, 'image_id': '0cd395f9-e766-4e32-94b1-775454bf3449', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0cd395f9-e766-4e32-94b1-775454bf3449', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7fa20aad952548c880b3288dd7d64dbc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0cd395f9-e766-4e32-94b1-775454bf3449', 'created_at': datetime.datetime(2026, 9, 23, 12, 25, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 23, 12, 25, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0cd395f9-e766-4e32-94b1-775454bf3449/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 23 14:37:41 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-02e544ba-d8fc-4f46-b9d7-e74283d464e6 tempest-VolumesImageMetadata-2060991037 None] Trying to clone 9b6b8415-2459-4c63-9e14-48c9620a6403 from image 0cd395f9-e766-4e32-94b1-775454bf3449 at location (None, [{'url': 'file:///opt/stack/data/glance/images/0cd395f9-e766-4e32-94b1-775454bf3449', 'metadata': {}}]). {{(pid=86310) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 23 14:37:41 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d9ce1379-9062-4b34-ac73-3f90f99ad2bf tempest-GroupSnapshotsTest-1878904240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-53847842-eb1c-476d-aa59-ec77710f0dbc" returned: 0 in 0.815s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:41 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d9ce1379-9062-4b34-ac73-3f90f99ad2bf tempest-GroupSnapshotsTest-1878904240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-53847842-eb1c-476d-aa59-ec77710f0dbc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-53847842-eb1c-476d-aa59-ec77710f0dbc.56abaf44-23ee-450d-bca4-4c43f5b6d33b 1G {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:41 devstack sudo[95071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-53847842-eb1c-476d-aa59-ec77710f0dbc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-53847842-eb1c-476d-aa59-ec77710f0dbc.56abaf44-23ee-450d-bca4-4c43f5b6d33b 1G Sep 23 14:37:41 devstack sudo[95071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:42 devstack cinder-volume[86310]: DEBUG cinder.image.image_utils [None req-02e544ba-d8fc-4f46-b9d7-e74283d464e6 tempest-VolumesImageMetadata-2060991037 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0cd395f9-e766-4e32-94b1-775454bf3449_cyeyrooidevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86310) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 23 14:37:42 devstack cinder-volume[86310]: INFO cinder.image.image_utils [None req-02e544ba-d8fc-4f46-b9d7-e74283d464e6 tempest-VolumesImageMetadata-2060991037 None] Image download 20.69 MB at 20.69 MB/s Sep 23 14:37:42 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef492c26-796a-4d1c-9af6-6a01b74b8641]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:37:42 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-02e544ba-d8fc-4f46-b9d7-e74283d464e6 tempest-VolumesImageMetadata-2060991037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0cd395f9-e766-4e32-94b1-775454bf3449_cyeyrooidevstack@QuobyteHD {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:42 devstack sudo[95071]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:42 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d9ce1379-9062-4b34-ac73-3f90f99ad2bf tempest-GroupSnapshotsTest-1878904240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-53847842-eb1c-476d-aa59-ec77710f0dbc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-53847842-eb1c-476d-aa59-ec77710f0dbc.56abaf44-23ee-450d-bca4-4c43f5b6d33b 1G" returned: 0 in 0.832s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:42 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d9ce1379-9062-4b34-ac73-3f90f99ad2bf tempest-GroupSnapshotsTest-1878904240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53847842-eb1c-476d-aa59-ec77710f0dbc -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-53847842-eb1c-476d-aa59-ec77710f0dbc.56abaf44-23ee-450d-bca4-4c43f5b6d33b {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:42 devstack sudo[95090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0cd395f9-e766-4e32-94b1-775454bf3449_cyeyrooidevstack@QuobyteHD Sep 23 14:37:42 devstack sudo[95090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:42 devstack sudo[95105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53847842-eb1c-476d-aa59-ec77710f0dbc -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-53847842-eb1c-476d-aa59-ec77710f0dbc.56abaf44-23ee-450d-bca4-4c43f5b6d33b Sep 23 14:37:42 devstack sudo[95105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:43 devstack sudo[95090]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:43 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-02e544ba-d8fc-4f46-b9d7-e74283d464e6 tempest-VolumesImageMetadata-2060991037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0cd395f9-e766-4e32-94b1-775454bf3449_cyeyrooidevstack@QuobyteHD" returned: 0 in 0.686s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:43 devstack cinder-volume[86310]: DEBUG cinder.image.image_utils [None req-02e544ba-d8fc-4f46-b9d7-e74283d464e6 tempest-VolumesImageMetadata-2060991037 None] Temporary image 0cd395f9-e766-4e32-94b1-775454bf3449 is fetched for user 17d9411de50c4b008d2faeb88ed543bb. {{(pid=86310) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 23 14:37:43 devstack sudo[95105]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:43 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d9ce1379-9062-4b34-ac73-3f90f99ad2bf tempest-GroupSnapshotsTest-1878904240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53847842-eb1c-476d-aa59-ec77710f0dbc -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-53847842-eb1c-476d-aa59-ec77710f0dbc.56abaf44-23ee-450d-bca4-4c43f5b6d33b" returned: 0 in 0.544s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:43 devstack cinder-volume[86310]: WARNING cinder.volume.drivers.remotefs [None req-d9ce1379-9062-4b34-ac73-3f90f99ad2bf tempest-GroupSnapshotsTest-1878904240 None] /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-53847842-eb1c-476d-aa59-ec77710f0dbc.56abaf44-23ee-450d-bca4-4c43f5b6d33b is being set with open permissions: ugo+rw: NotImplementedError Sep 23 14:37:43 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d9ce1379-9062-4b34-ac73-3f90f99ad2bf tempest-GroupSnapshotsTest-1878904240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-53847842-eb1c-476d-aa59-ec77710f0dbc.56abaf44-23ee-450d-bca4-4c43f5b6d33b {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:43 devstack sudo[95153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-53847842-eb1c-476d-aa59-ec77710f0dbc.56abaf44-23ee-450d-bca4-4c43f5b6d33b Sep 23 14:37:43 devstack sudo[95153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:43 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ebac561-5e53-4a01-81d3-a72deb614386]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:37:43 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-02e544ba-d8fc-4f46-b9d7-e74283d464e6 tempest-VolumesImageMetadata-2060991037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0cd395f9-e766-4e32-94b1-775454bf3449_cyeyrooidevstack@QuobyteHD {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:43 devstack sudo[95158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0cd395f9-e766-4e32-94b1-775454bf3449_cyeyrooidevstack@QuobyteHD Sep 23 14:37:43 devstack sudo[95158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:43 devstack sudo[95153]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:43 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d9ce1379-9062-4b34-ac73-3f90f99ad2bf tempest-GroupSnapshotsTest-1878904240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-53847842-eb1c-476d-aa59-ec77710f0dbc.56abaf44-23ee-450d-bca4-4c43f5b6d33b" returned: 0 in 0.598s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:43 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d9ce1379-9062-4b34-ac73-3f90f99ad2bf tempest-GroupSnapshotsTest-1878904240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-53847842-eb1c-476d-aa59-ec77710f0dbc.info {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:43 devstack sudo[95165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-53847842-eb1c-476d-aa59-ec77710f0dbc.info Sep 23 14:37:43 devstack sudo[95165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:44 devstack sudo[95158]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:44 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-02e544ba-d8fc-4f46-b9d7-e74283d464e6 tempest-VolumesImageMetadata-2060991037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0cd395f9-e766-4e32-94b1-775454bf3449_cyeyrooidevstack@QuobyteHD" returned: 0 in 0.639s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:44 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-02e544ba-d8fc-4f46-b9d7-e74283d464e6 tempest-VolumesImageMetadata-2060991037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:37:44 devstack sudo[95165]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:44 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d9ce1379-9062-4b34-ac73-3f90f99ad2bf tempest-GroupSnapshotsTest-1878904240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-53847842-eb1c-476d-aa59-ec77710f0dbc.info" returned: 0 in 0.314s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:44 devstack cinder-volume[86310]: WARNING cinder.volume.drivers.remotefs [None req-d9ce1379-9062-4b34-ac73-3f90f99ad2bf tempest-GroupSnapshotsTest-1878904240 None] /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-53847842-eb1c-476d-aa59-ec77710f0dbc.info is being set with open permissions: ugo+rw: NotImplementedError Sep 23 14:37:44 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d9ce1379-9062-4b34-ac73-3f90f99ad2bf tempest-GroupSnapshotsTest-1878904240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-53847842-eb1c-476d-aa59-ec77710f0dbc.info {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:44 devstack sudo[95176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-53847842-eb1c-476d-aa59-ec77710f0dbc.info Sep 23 14:37:44 devstack sudo[95176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:44 devstack sudo[95176]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:44 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d9ce1379-9062-4b34-ac73-3f90f99ad2bf tempest-GroupSnapshotsTest-1878904240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-53847842-eb1c-476d-aa59-ec77710f0dbc.info" returned: 0 in 0.368s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:44 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-d9ce1379-9062-4b34-ac73-3f90f99ad2bf tempest-GroupSnapshotsTest-1878904240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.612s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:37:44 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-02e544ba-d8fc-4f46-b9d7-e74283d464e6 tempest-VolumesImageMetadata-2060991037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.557s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:37:44 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-02e544ba-d8fc-4f46-b9d7-e74283d464e6 tempest-VolumesImageMetadata-2060991037 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:37:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1582106481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b6b8415-2459-4c63-9e14-48c9620a6403,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e8076d0c7a140608528a2e0b1f5202e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:37:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:37:41Z,use_quota=True,user_id='17d9411de50c4b008d2faeb88ed543bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:37:44 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-02e544ba-d8fc-4f46-b9d7-e74283d464e6 tempest-VolumesImageMetadata-2060991037 None] Creating volume 9b6b8415-2459-4c63-9e14-48c9620a6403 {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:37:44 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-02e544ba-d8fc-4f46-b9d7-e74283d464e6 tempest-VolumesImageMetadata-2060991037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:37:44 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-02e544ba-d8fc-4f46-b9d7-e74283d464e6 tempest-VolumesImageMetadata-2060991037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:37:44 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-02e544ba-d8fc-4f46-b9d7-e74283d464e6 tempest-VolumesImageMetadata-2060991037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:37:44 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-02e544ba-d8fc-4f46-b9d7-e74283d464e6 tempest-VolumesImageMetadata-2060991037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:37:44 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-02e544ba-d8fc-4f46-b9d7-e74283d464e6 tempest-VolumesImageMetadata-2060991037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:37:44 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-02e544ba-d8fc-4f46-b9d7-e74283d464e6 tempest-VolumesImageMetadata-2060991037 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:37:44 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-02e544ba-d8fc-4f46-b9d7-e74283d464e6 tempest-VolumesImageMetadata-2060991037 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:37:44 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-02e544ba-d8fc-4f46-b9d7-e74283d464e6 tempest-VolumesImageMetadata-2060991037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-9b6b8415-2459-4c63-9e14-48c9620a6403 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:44 devstack sudo[95179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-9b6b8415-2459-4c63-9e14-48c9620a6403 1073741824 Sep 23 14:37:44 devstack sudo[95179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:44 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-d9ce1379-9062-4b34-ac73-3f90f99ad2bf tempest-GroupSnapshotsTest-1878904240 None] group_snapshot 95ded36c-0487-4ce6-ab36-7b13c8da022a: created successfully Sep 23 14:37:45 devstack sudo[95179]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:45 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-02e544ba-d8fc-4f46-b9d7-e74283d464e6 tempest-VolumesImageMetadata-2060991037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-9b6b8415-2459-4c63-9e14-48c9620a6403 1073741824" returned: 0 in 0.651s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:45 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-02e544ba-d8fc-4f46-b9d7-e74283d464e6 tempest-VolumesImageMetadata-2060991037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-9b6b8415-2459-4c63-9e14-48c9620a6403 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:45 devstack sudo[95186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-9b6b8415-2459-4c63-9e14-48c9620a6403 Sep 23 14:37:45 devstack sudo[95186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:45 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-05b33a4c-4609-40a1-8899-f46eb5a5c3a2 tempest-GroupSnapshotsTest-1878904240 None] group_snapshot 95ded36c-0487-4ce6-ab36-7b13c8da022a: deleting Sep 23 14:37:45 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-05b33a4c-4609-40a1-8899-f46eb5a5c3a2 tempest-GroupSnapshotsTest-1878904240 None] group_snapshot 95ded36c-0487-4ce6-ab36-7b13c8da022a: deleting {{(pid=86310) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 23 14:37:45 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-05b33a4c-4609-40a1-8899-f46eb5a5c3a2 tempest-GroupSnapshotsTest-1878904240 None] Acquiring lock "cinder-quobyte-53847842-eb1c-476d-aa59-ec77710f0dbc" by "delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:37:45 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-05b33a4c-4609-40a1-8899-f46eb5a5c3a2 tempest-GroupSnapshotsTest-1878904240 None] Lock "cinder-quobyte-53847842-eb1c-476d-aa59-ec77710f0dbc" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:37:45 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-05b33a4c-4609-40a1-8899-f46eb5a5c3a2 tempest-GroupSnapshotsTest-1878904240 None] Acquiring lock "cinder-quobyte-56abaf44-23ee-450d-bca4-4c43f5b6d33b" by "_delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:37:45 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-05b33a4c-4609-40a1-8899-f46eb5a5c3a2 tempest-GroupSnapshotsTest-1878904240 None] Lock "cinder-quobyte-56abaf44-23ee-450d-bca4-4c43f5b6d33b" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:37:45 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-05b33a4c-4609-40a1-8899-f46eb5a5c3a2 tempest-GroupSnapshotsTest-1878904240 None] Deleting offline snapshot 56abaf44-23ee-450d-bca4-4c43f5b6d33b of volume 53847842-eb1c-476d-aa59-ec77710f0dbc {{(pid=86310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 14:37:45 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-05b33a4c-4609-40a1-8899-f46eb5a5c3a2 tempest-GroupSnapshotsTest-1878904240 None] snapshot_file for this snap is: volume-53847842-eb1c-476d-aa59-ec77710f0dbc.56abaf44-23ee-450d-bca4-4c43f5b6d33b {{(pid=86310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 14:37:45 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d157c14-f3f5-4409-846e-3b9bd6df122c]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:37:45 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-05b33a4c-4609-40a1-8899-f46eb5a5c3a2 tempest-GroupSnapshotsTest-1878904240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-53847842-eb1c-476d-aa59-ec77710f0dbc.56abaf44-23ee-450d-bca4-4c43f5b6d33b {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:45 devstack sudo[95188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-53847842-eb1c-476d-aa59-ec77710f0dbc.56abaf44-23ee-450d-bca4-4c43f5b6d33b Sep 23 14:37:45 devstack sudo[95188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:45 devstack sudo[95186]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:45 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-02e544ba-d8fc-4f46-b9d7-e74283d464e6 tempest-VolumesImageMetadata-2060991037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-9b6b8415-2459-4c63-9e14-48c9620a6403" returned: 0 in 0.537s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:45 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-02e544ba-d8fc-4f46-b9d7-e74283d464e6 tempest-VolumesImageMetadata-2060991037 None] <== create_volume: return (1263ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:37:45 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-02e544ba-d8fc-4f46-b9d7-e74283d464e6 tempest-VolumesImageMetadata-2060991037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.268s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:37:45 devstack cinder-volume[86310]: DEBUG cinder.volume.volume_utils [None req-02e544ba-d8fc-4f46-b9d7-e74283d464e6 tempest-VolumesImageMetadata-2060991037 None] Attempting download of 0cd395f9-e766-4e32-94b1-775454bf3449 ((None, [{'url': 'file:///opt/stack/data/glance/images/0cd395f9-e766-4e32-94b1-775454bf3449', 'metadata': {}}])) to volume 9b6b8415-2459-4c63-9e14-48c9620a6403. {{(pid=86310) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 23 14:37:45 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[39acc84e-00ea-425f-a72e-53d8656b00bd]: (4, 'raw') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:37:45 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-02e544ba-d8fc-4f46-b9d7-e74283d464e6 tempest-VolumesImageMetadata-2060991037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0cd395f9-e766-4e32-94b1-775454bf3449_5a__fv2t {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:46 devstack sudo[95191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0cd395f9-e766-4e32-94b1-775454bf3449_5a__fv2t Sep 23 14:37:46 devstack sudo[95191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:46 devstack sudo[95188]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:46 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-05b33a4c-4609-40a1-8899-f46eb5a5c3a2 tempest-GroupSnapshotsTest-1878904240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-53847842-eb1c-476d-aa59-ec77710f0dbc.56abaf44-23ee-450d-bca4-4c43f5b6d33b" returned: 0 in 0.594s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:46 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-05b33a4c-4609-40a1-8899-f46eb5a5c3a2 tempest-GroupSnapshotsTest-1878904240 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-53847842-eb1c-476d-aa59-ec77710f0dbc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 14:37:46 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa991628-cbef-473d-9747-d5495751310d]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:37:46 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-05b33a4c-4609-40a1-8899-f46eb5a5c3a2 tempest-GroupSnapshotsTest-1878904240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-53847842-eb1c-476d-aa59-ec77710f0dbc {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:46 devstack sudo[95191]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:46 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-02e544ba-d8fc-4f46-b9d7-e74283d464e6 tempest-VolumesImageMetadata-2060991037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0cd395f9-e766-4e32-94b1-775454bf3449_5a__fv2t" returned: 0 in 0.403s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:46 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-02e544ba-d8fc-4f46-b9d7-e74283d464e6 tempest-VolumesImageMetadata-2060991037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0cd395f9-e766-4e32-94b1-775454bf3449_5a__fv2t {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:46 devstack sudo[95196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-53847842-eb1c-476d-aa59-ec77710f0dbc Sep 23 14:37:46 devstack sudo[95196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:46 devstack sudo[95199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0cd395f9-e766-4e32-94b1-775454bf3449_5a__fv2t Sep 23 14:37:46 devstack sudo[95199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:46 devstack sudo[95196]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:46 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-05b33a4c-4609-40a1-8899-f46eb5a5c3a2 tempest-GroupSnapshotsTest-1878904240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-53847842-eb1c-476d-aa59-ec77710f0dbc" returned: 0 in 0.556s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:46 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-05b33a4c-4609-40a1-8899-f46eb5a5c3a2 tempest-GroupSnapshotsTest-1878904240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-53847842-eb1c-476d-aa59-ec77710f0dbc.56abaf44-23ee-450d-bca4-4c43f5b6d33b {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:46 devstack sudo[95199]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:46 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-02e544ba-d8fc-4f46-b9d7-e74283d464e6 tempest-VolumesImageMetadata-2060991037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0cd395f9-e766-4e32-94b1-775454bf3449_5a__fv2t" returned: 1 in 0.419s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:46 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-02e544ba-d8fc-4f46-b9d7-e74283d464e6 tempest-VolumesImageMetadata-2060991037 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0cd395f9-e766-4e32-94b1-775454bf3449_5a__fv2t' failed. Not Retrying. {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 14:37:46 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[837683ff-247c-4168-aa51-77fbcb5b82cd]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:37:46 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-02e544ba-d8fc-4f46-b9d7-e74283d464e6 tempest-VolumesImageMetadata-2060991037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0cd395f9-e766-4e32-94b1-775454bf3449_cyeyrooidevstack@QuobyteHD {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:46 devstack sudo[95207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-53847842-eb1c-476d-aa59-ec77710f0dbc.56abaf44-23ee-450d-bca4-4c43f5b6d33b Sep 23 14:37:46 devstack sudo[95207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:46 devstack sudo[95209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0cd395f9-e766-4e32-94b1-775454bf3449_cyeyrooidevstack@QuobyteHD Sep 23 14:37:46 devstack sudo[95209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:47 devstack sudo[95209]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:47 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-02e544ba-d8fc-4f46-b9d7-e74283d464e6 tempest-VolumesImageMetadata-2060991037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0cd395f9-e766-4e32-94b1-775454bf3449_cyeyrooidevstack@QuobyteHD" returned: 0 in 0.362s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:47 devstack cinder-volume[86310]: DEBUG cinder.image.image_utils [None req-02e544ba-d8fc-4f46-b9d7-e74283d464e6 tempest-VolumesImageMetadata-2060991037 None] 0cd395f9-e766-4e32-94b1-775454bf3449 was qcow2, converting to qcow2 {{(pid=86310) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 23 14:37:47 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-02e544ba-d8fc-4f46-b9d7-e74283d464e6 tempest-VolumesImageMetadata-2060991037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0cd395f9-e766-4e32-94b1-775454bf3449_cyeyrooidevstack@QuobyteHD /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-9b6b8415-2459-4c63-9e14-48c9620a6403 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:47 devstack sudo[95218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0cd395f9-e766-4e32-94b1-775454bf3449_cyeyrooidevstack@QuobyteHD /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-9b6b8415-2459-4c63-9e14-48c9620a6403 Sep 23 14:37:47 devstack sudo[95218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:47 devstack sudo[95207]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:47 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-05b33a4c-4609-40a1-8899-f46eb5a5c3a2 tempest-GroupSnapshotsTest-1878904240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-53847842-eb1c-476d-aa59-ec77710f0dbc.56abaf44-23ee-450d-bca4-4c43f5b6d33b" returned: 0 in 0.556s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:47 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-05b33a4c-4609-40a1-8899-f46eb5a5c3a2 tempest-GroupSnapshotsTest-1878904240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-53847842-eb1c-476d-aa59-ec77710f0dbc.56abaf44-23ee-450d-bca4-4c43f5b6d33b {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:47 devstack sudo[95220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-53847842-eb1c-476d-aa59-ec77710f0dbc.56abaf44-23ee-450d-bca4-4c43f5b6d33b Sep 23 14:37:47 devstack sudo[95220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:47 devstack sudo[95220]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:47 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-05b33a4c-4609-40a1-8899-f46eb5a5c3a2 tempest-GroupSnapshotsTest-1878904240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-53847842-eb1c-476d-aa59-ec77710f0dbc.56abaf44-23ee-450d-bca4-4c43f5b6d33b" returned: 0 in 0.341s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:47 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-05b33a4c-4609-40a1-8899-f46eb5a5c3a2 tempest-GroupSnapshotsTest-1878904240 None] Lock "cinder-quobyte-56abaf44-23ee-450d-bca4-4c43f5b6d33b" released by "_delete_snapshot" :: held 2.237s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:37:47 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-05b33a4c-4609-40a1-8899-f46eb5a5c3a2 tempest-GroupSnapshotsTest-1878904240 None] Lock "cinder-quobyte-53847842-eb1c-476d-aa59-ec77710f0dbc" released by "delete_snapshot" :: held 2.288s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:37:47 devstack cinder-volume[86310]: WARNING cinder.quota [None req-05b33a4c-4609-40a1-8899-f46eb5a5c3a2 tempest-GroupSnapshotsTest-1878904240 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-455396466 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-455396466, it is now deprecated. Please use the default quota class for default quota. Sep 23 14:37:47 devstack cinder-volume[86310]: WARNING cinder.quota [None req-05b33a4c-4609-40a1-8899-f46eb5a5c3a2 tempest-GroupSnapshotsTest-1878904240 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-455396466 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-455396466, it is now deprecated. Please use the default quota class for default quota. Sep 23 14:37:47 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-05b33a4c-4609-40a1-8899-f46eb5a5c3a2 tempest-GroupSnapshotsTest-1878904240 None] Created reservations ['bb48fb92-9b35-4815-b709-9867e5427e27', '9c773c60-961a-40c6-9c04-62ec898352b2', '00005627-3ee9-44a7-b5a2-1921e4e2e221', 'f55fe9fb-a181-4723-8836-734dc562fbc4'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:37:47 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-05b33a4c-4609-40a1-8899-f46eb5a5c3a2 tempest-GroupSnapshotsTest-1878904240 None] group_snapshot 95ded36c-0487-4ce6-ab36-7b13c8da022a: deleted successfully Sep 23 14:37:49 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-722a3dd6-3fb4-44ef-a026-b00737795b45 tempest-VolumeRetypeWithoutMigrationTest-1531553567 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:37:49 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-722a3dd6-3fb4-44ef-a026-b00737795b45 tempest-VolumeRetypeWithoutMigrationTest-1531553567 None] Flow 'volume_create_manager' (5c24031e-2e4b-45a9-b38b-97e0afda9a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:37:49 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-722a3dd6-3fb4-44ef-a026-b00737795b45 tempest-VolumeRetypeWithoutMigrationTest-1531553567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6577878a-0794-498a-8187-fb4f8cd7b81c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:37:49 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-722a3dd6-3fb4-44ef-a026-b00737795b45 tempest-VolumeRetypeWithoutMigrationTest-1531553567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6577878a-0794-498a-8187-fb4f8cd7b81c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:37:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-2077664053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9d6f3ef-c69c-43d9-8aa1-a55178b047d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5313cf1eca143bcae510b802c1b93d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:37:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:37:49Z,use_quota=True,user_id='63831aaaa2564d87a207e69868e1c91c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(eff0b8dd-d1bc-49ae-a861-956698057e7d),volume_type_id=eff0b8dd-d1bc-49ae-a861-956698057e7d)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:37:49 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-722a3dd6-3fb4-44ef-a026-b00737795b45 tempest-VolumeRetypeWithoutMigrationTest-1531553567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a696ee1d-1b2a-406f-8b61-e35bba47cacf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:37:49 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-722a3dd6-3fb4-44ef-a026-b00737795b45 tempest-VolumeRetypeWithoutMigrationTest-1531553567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a696ee1d-1b2a-406f-8b61-e35bba47cacf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:37:49 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-722a3dd6-3fb4-44ef-a026-b00737795b45 tempest-VolumeRetypeWithoutMigrationTest-1531553567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3f38c14-5718-43bc-a497-73f87c26d55f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:37:49 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-722a3dd6-3fb4-44ef-a026-b00737795b45 tempest-VolumeRetypeWithoutMigrationTest-1531553567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3f38c14-5718-43bc-a497-73f87c26d55f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9d6f3ef-c69c-43d9-8aa1-a55178b047d2', 'volume_name': 'volume-a9d6f3ef-c69c-43d9-8aa1-a55178b047d2', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:37:49 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-722a3dd6-3fb4-44ef-a026-b00737795b45 tempest-VolumeRetypeWithoutMigrationTest-1531553567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a5eaba6-82bb-4a94-ba42-22d7080655b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:37:49 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-722a3dd6-3fb4-44ef-a026-b00737795b45 tempest-VolumeRetypeWithoutMigrationTest-1531553567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a5eaba6-82bb-4a94-ba42-22d7080655b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:37:49 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-722a3dd6-3fb4-44ef-a026-b00737795b45 tempest-VolumeRetypeWithoutMigrationTest-1531553567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33b7a5e3-cb8d-412b-a3e0-60ad7e198b29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:37:49 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-722a3dd6-3fb4-44ef-a026-b00737795b45 tempest-VolumeRetypeWithoutMigrationTest-1531553567 None] Volume a9d6f3ef-c69c-43d9-8aa1-a55178b047d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9d6f3ef-c69c-43d9-8aa1-a55178b047d2', 'volume_size': 1} Sep 23 14:37:49 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-722a3dd6-3fb4-44ef-a026-b00737795b45 tempest-VolumeRetypeWithoutMigrationTest-1531553567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:37:49 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-722a3dd6-3fb4-44ef-a026-b00737795b45 tempest-VolumeRetypeWithoutMigrationTest-1531553567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:37:49 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-722a3dd6-3fb4-44ef-a026-b00737795b45 tempest-VolumeRetypeWithoutMigrationTest-1531553567 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:37:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-2077664053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9d6f3ef-c69c-43d9-8aa1-a55178b047d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5313cf1eca143bcae510b802c1b93d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:37:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:37:49Z,use_quota=True,user_id='63831aaaa2564d87a207e69868e1c91c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(eff0b8dd-d1bc-49ae-a861-956698057e7d),volume_type_id=eff0b8dd-d1bc-49ae-a861-956698057e7d)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:37:49 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-722a3dd6-3fb4-44ef-a026-b00737795b45 tempest-VolumeRetypeWithoutMigrationTest-1531553567 None] Creating volume a9d6f3ef-c69c-43d9-8aa1-a55178b047d2 {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:37:49 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-722a3dd6-3fb4-44ef-a026-b00737795b45 tempest-VolumeRetypeWithoutMigrationTest-1531553567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:37:49 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-722a3dd6-3fb4-44ef-a026-b00737795b45 tempest-VolumeRetypeWithoutMigrationTest-1531553567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:37:49 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-722a3dd6-3fb4-44ef-a026-b00737795b45 tempest-VolumeRetypeWithoutMigrationTest-1531553567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:37:49 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-722a3dd6-3fb4-44ef-a026-b00737795b45 tempest-VolumeRetypeWithoutMigrationTest-1531553567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:37:49 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-722a3dd6-3fb4-44ef-a026-b00737795b45 tempest-VolumeRetypeWithoutMigrationTest-1531553567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:37:49 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-722a3dd6-3fb4-44ef-a026-b00737795b45 tempest-VolumeRetypeWithoutMigrationTest-1531553567 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:37:49 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-722a3dd6-3fb4-44ef-a026-b00737795b45 tempest-VolumeRetypeWithoutMigrationTest-1531553567 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:37:49 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-722a3dd6-3fb4-44ef-a026-b00737795b45 tempest-VolumeRetypeWithoutMigrationTest-1531553567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-a9d6f3ef-c69c-43d9-8aa1-a55178b047d2 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:49 devstack sudo[95230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-a9d6f3ef-c69c-43d9-8aa1-a55178b047d2 1073741824 Sep 23 14:37:49 devstack sudo[95230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:49 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-51917c19-5986-4730-862d-3bb4e7da52b5 tempest-GroupSnapshotsTest-1878904240 None] Acquiring lock "cinder-quobyte-53847842-eb1c-476d-aa59-ec77710f0dbc" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:37:49 devstack sudo[95218]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:49 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-51917c19-5986-4730-862d-3bb4e7da52b5 tempest-GroupSnapshotsTest-1878904240 None] Lock "cinder-quobyte-53847842-eb1c-476d-aa59-ec77710f0dbc" acquired by "delete_volume" :: waited 0.023s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:37:49 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-02e544ba-d8fc-4f46-b9d7-e74283d464e6 tempest-VolumesImageMetadata-2060991037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0cd395f9-e766-4e32-94b1-775454bf3449_cyeyrooidevstack@QuobyteHD /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-9b6b8415-2459-4c63-9e14-48c9620a6403" returned: 0 in 2.433s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:49 devstack cinder-volume[86310]: DEBUG cinder.image.image_utils [None req-02e544ba-d8fc-4f46-b9d7-e74283d464e6 tempest-VolumesImageMetadata-2060991037 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0cd395f9-e766-4e32-94b1-775454bf3449_cyeyrooidevstack@QuobyteHD, size 112.00 MB, duration 2.43 sec, destination /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-9b6b8415-2459-4c63-9e14-48c9620a6403 {{(pid=86310) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 14:37:49 devstack cinder-volume[86310]: INFO cinder.image.image_utils [None req-02e544ba-d8fc-4f46-b9d7-e74283d464e6 tempest-VolumesImageMetadata-2060991037 None] Converted 112.00 MB image at 46.01 MB/s Sep 23 14:37:49 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-02e544ba-d8fc-4f46-b9d7-e74283d464e6 tempest-VolumesImageMetadata-2060991037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-9b6b8415-2459-4c63-9e14-48c9620a6403 1G {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:49 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[746d6d8f-77c8-4495-8a3c-4e3c865e8e01]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:37:49 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-51917c19-5986-4730-862d-3bb4e7da52b5 tempest-GroupSnapshotsTest-1878904240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-53847842-eb1c-476d-aa59-ec77710f0dbc {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:49 devstack sudo[95232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-9b6b8415-2459-4c63-9e14-48c9620a6403 1G Sep 23 14:37:49 devstack sudo[95232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:49 devstack sudo[95233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-53847842-eb1c-476d-aa59-ec77710f0dbc Sep 23 14:37:49 devstack sudo[95233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:49 devstack sudo[95230]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:49 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-722a3dd6-3fb4-44ef-a026-b00737795b45 tempest-VolumeRetypeWithoutMigrationTest-1531553567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-a9d6f3ef-c69c-43d9-8aa1-a55178b047d2 1073741824" returned: 0 in 0.522s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:50 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-722a3dd6-3fb4-44ef-a026-b00737795b45 tempest-VolumeRetypeWithoutMigrationTest-1531553567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-a9d6f3ef-c69c-43d9-8aa1-a55178b047d2 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:50 devstack sudo[95242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-a9d6f3ef-c69c-43d9-8aa1-a55178b047d2 Sep 23 14:37:50 devstack sudo[95242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:50 devstack sudo[95232]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:50 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-02e544ba-d8fc-4f46-b9d7-e74283d464e6 tempest-VolumesImageMetadata-2060991037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-9b6b8415-2459-4c63-9e14-48c9620a6403 1G" returned: 0 in 0.480s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:50 devstack cinder-volume[86310]: DEBUG cinder.volume.volume_utils [None req-02e544ba-d8fc-4f46-b9d7-e74283d464e6 tempest-VolumesImageMetadata-2060991037 None] Downloaded image 0cd395f9-e766-4e32-94b1-775454bf3449 ((None, [{'url': 'file:///opt/stack/data/glance/images/0cd395f9-e766-4e32-94b1-775454bf3449', 'metadata': {}}])) to volume 9b6b8415-2459-4c63-9e14-48c9620a6403 successfully. {{(pid=86310) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 23 14:37:50 devstack cinder-volume[86310]: DEBUG cinder.image.image_utils [None req-02e544ba-d8fc-4f46-b9d7-e74283d464e6 tempest-VolumesImageMetadata-2060991037 None] Temporary image 0cd395f9-e766-4e32-94b1-775454bf3449 for user 17d9411de50c4b008d2faeb88ed543bb is deleted. {{(pid=86310) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 23 14:37:50 devstack cinder-volume[86310]: DEBUG cinder.volume.volume_utils [None req-02e544ba-d8fc-4f46-b9d7-e74283d464e6 tempest-VolumesImageMetadata-2060991037 None] Marking volume 9b6b8415-2459-4c63-9e14-48c9620a6403 as bootable. {{(pid=86310) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 23 14:37:50 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-02e544ba-d8fc-4f46-b9d7-e74283d464e6 tempest-VolumesImageMetadata-2060991037 None] Copying metadata from image 0cd395f9-e766-4e32-94b1-775454bf3449 to 9b6b8415-2459-4c63-9e14-48c9620a6403. {{(pid=86310) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 23 14:37:50 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-02e544ba-d8fc-4f46-b9d7-e74283d464e6 tempest-VolumesImageMetadata-2060991037 None] Creating volume glance metadata for volume 9b6b8415-2459-4c63-9e14-48c9620a6403 backed by image 0cd395f9-e766-4e32-94b1-775454bf3449 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0cd395f9-e766-4e32-94b1-775454bf3449', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86310) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 23 14:37:50 devstack sudo[95233]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:50 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-51917c19-5986-4730-862d-3bb4e7da52b5 tempest-GroupSnapshotsTest-1878904240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-53847842-eb1c-476d-aa59-ec77710f0dbc" returned: 0 in 0.512s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:50 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-51917c19-5986-4730-862d-3bb4e7da52b5 tempest-GroupSnapshotsTest-1878904240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-53847842-eb1c-476d-aa59-ec77710f0dbc {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:50 devstack sudo[95249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-53847842-eb1c-476d-aa59-ec77710f0dbc Sep 23 14:37:50 devstack sudo[95249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:50 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-02e544ba-d8fc-4f46-b9d7-e74283d464e6 tempest-VolumesImageMetadata-2060991037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b63295b2-b3b3-49c7-81d6-dc1f1dc47a3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b6b8415-2459-4c63-9e14-48c9620a6403', 'volume_size': 1, 'image_id': '0cd395f9-e766-4e32-94b1-775454bf3449', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0cd395f9-e766-4e32-94b1-775454bf3449', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7fa20aad952548c880b3288dd7d64dbc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0cd395f9-e766-4e32-94b1-775454bf3449', 'created_at': datetime.datetime(2026, 9, 23, 12, 25, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 23, 12, 25, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0cd395f9-e766-4e32-94b1-775454bf3449/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:37:50 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-02e544ba-d8fc-4f46-b9d7-e74283d464e6 tempest-VolumesImageMetadata-2060991037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c006f6c-78c0-47e5-a0af-c09adfc709e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:37:50 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-02e544ba-d8fc-4f46-b9d7-e74283d464e6 tempest-VolumesImageMetadata-2060991037 None] Volume volume-9b6b8415-2459-4c63-9e14-48c9620a6403 (9b6b8415-2459-4c63-9e14-48c9620a6403): created successfully Sep 23 14:37:50 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-02e544ba-d8fc-4f46-b9d7-e74283d464e6 tempest-VolumesImageMetadata-2060991037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c006f6c-78c0-47e5-a0af-c09adfc709e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:37:50 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-02e544ba-d8fc-4f46-b9d7-e74283d464e6 tempest-VolumesImageMetadata-2060991037 None] Flow 'volume_create_manager' (a40ca49a-da58-461f-a5aa-dbe3bb7ab622) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:37:50 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-02e544ba-d8fc-4f46-b9d7-e74283d464e6 tempest-VolumesImageMetadata-2060991037 None] Created volume successfully. Sep 23 14:37:50 devstack sudo[95242]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:50 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-722a3dd6-3fb4-44ef-a026-b00737795b45 tempest-VolumeRetypeWithoutMigrationTest-1531553567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-a9d6f3ef-c69c-43d9-8aa1-a55178b047d2" returned: 0 in 0.360s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:50 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-722a3dd6-3fb4-44ef-a026-b00737795b45 tempest-VolumeRetypeWithoutMigrationTest-1531553567 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:37:50 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-722a3dd6-3fb4-44ef-a026-b00737795b45 tempest-VolumeRetypeWithoutMigrationTest-1531553567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:37:50 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-722a3dd6-3fb4-44ef-a026-b00737795b45 tempest-VolumeRetypeWithoutMigrationTest-1531553567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33b7a5e3-cb8d-412b-a3e0-60ad7e198b29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9d6f3ef-c69c-43d9-8aa1-a55178b047d2', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:37:50 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-722a3dd6-3fb4-44ef-a026-b00737795b45 tempest-VolumeRetypeWithoutMigrationTest-1531553567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e23d873d-6519-4907-9e03-b316670e17df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:37:50 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-722a3dd6-3fb4-44ef-a026-b00737795b45 tempest-VolumeRetypeWithoutMigrationTest-1531553567 None] Volume volume-a9d6f3ef-c69c-43d9-8aa1-a55178b047d2 (a9d6f3ef-c69c-43d9-8aa1-a55178b047d2): created successfully Sep 23 14:37:50 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-722a3dd6-3fb4-44ef-a026-b00737795b45 tempest-VolumeRetypeWithoutMigrationTest-1531553567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e23d873d-6519-4907-9e03-b316670e17df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:37:50 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-722a3dd6-3fb4-44ef-a026-b00737795b45 tempest-VolumeRetypeWithoutMigrationTest-1531553567 None] Flow 'volume_create_manager' (5c24031e-2e4b-45a9-b38b-97e0afda9a64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:37:50 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-722a3dd6-3fb4-44ef-a026-b00737795b45 tempest-VolumeRetypeWithoutMigrationTest-1531553567 None] Created volume successfully. Sep 23 14:37:50 devstack sudo[95249]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:50 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-51917c19-5986-4730-862d-3bb4e7da52b5 tempest-GroupSnapshotsTest-1878904240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-53847842-eb1c-476d-aa59-ec77710f0dbc" returned: 0 in 0.357s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:50 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-51917c19-5986-4730-862d-3bb4e7da52b5 tempest-GroupSnapshotsTest-1878904240 None] Lock "cinder-quobyte-53847842-eb1c-476d-aa59-ec77710f0dbc" released by "delete_volume" :: held 0.961s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:37:50 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-51917c19-5986-4730-862d-3bb4e7da52b5 tempest-GroupSnapshotsTest-1878904240 None] Created reservations ['2a2e893b-eeb4-43f4-ab79-3a1efad87ed3'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:37:50 devstack cinder-volume[86310]: WARNING cinder.quota [None req-51917c19-5986-4730-862d-3bb4e7da52b5 tempest-GroupSnapshotsTest-1878904240 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-455396466 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-455396466, it is now deprecated. Please use the default quota class for default quota. Sep 23 14:37:50 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-51917c19-5986-4730-862d-3bb4e7da52b5 tempest-GroupSnapshotsTest-1878904240 None] Created reservations ['9dba524e-6acb-4b12-9c39-4061d022af4a', '3efd6d18-e3c8-4166-9975-5e8313016692', '5f4a30bc-e85b-4813-b1c4-8b92197e12cc', '778a6725-a11c-4a42-b8cc-b3a28a873f29'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:37:50 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-51917c19-5986-4730-862d-3bb4e7da52b5 tempest-GroupSnapshotsTest-1878904240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:37:50 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-51917c19-5986-4730-862d-3bb4e7da52b5 tempest-GroupSnapshotsTest-1878904240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:37:50 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-51917c19-5986-4730-862d-3bb4e7da52b5 tempest-GroupSnapshotsTest-1878904240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:37:50 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-51917c19-5986-4730-862d-3bb4e7da52b5 tempest-GroupSnapshotsTest-1878904240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:37:50 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-51917c19-5986-4730-862d-3bb4e7da52b5 tempest-GroupSnapshotsTest-1878904240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:37:50 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-51917c19-5986-4730-862d-3bb4e7da52b5 tempest-GroupSnapshotsTest-1878904240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:50 devstack sudo[95253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:37:50 devstack sudo[95253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:51 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-8e762737-69d5-498b-9175-0e78b3cc83ec tempest-VolumesImageMetadata-2060991037 None] Acquiring lock "cinder-9b6b8415-2459-4c63-9e14-48c9620a6403-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:37:51 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-8e762737-69d5-498b-9175-0e78b3cc83ec tempest-VolumesImageMetadata-2060991037 None] Lock "cinder-9b6b8415-2459-4c63-9e14-48c9620a6403-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:37:51 devstack sudo[95253]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:51 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-8e762737-69d5-498b-9175-0e78b3cc83ec tempest-VolumesImageMetadata-2060991037 None] Acquiring lock "cinder-quobyte-9b6b8415-2459-4c63-9e14-48c9620a6403" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:37:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-51917c19-5986-4730-862d-3bb4e7da52b5 tempest-GroupSnapshotsTest-1878904240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.435s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:51 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-51917c19-5986-4730-862d-3bb4e7da52b5 tempest-GroupSnapshotsTest-1878904240 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:37:51 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-51917c19-5986-4730-862d-3bb4e7da52b5 tempest-GroupSnapshotsTest-1878904240 None] Delete group completed successfully. Sep 23 14:37:51 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-8e762737-69d5-498b-9175-0e78b3cc83ec tempest-VolumesImageMetadata-2060991037 None] Lock "cinder-quobyte-9b6b8415-2459-4c63-9e14-48c9620a6403" acquired by "delete_volume" :: waited 0.030s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:37:51 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[3850319c-6473-4b11-aedd-79dd7406b59c]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:37:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8e762737-69d5-498b-9175-0e78b3cc83ec tempest-VolumesImageMetadata-2060991037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-9b6b8415-2459-4c63-9e14-48c9620a6403 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:51 devstack cinder-volume[86310]: DEBUG oslo_service.periodic_task [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86310) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 14:37:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:37:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:37:51 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:37:51 devstack sudo[95256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-9b6b8415-2459-4c63-9e14-48c9620a6403 Sep 23 14:37:51 devstack sudo[95256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:51 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:37:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:37:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:51 devstack sudo[95258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:37:51 devstack sudo[95258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:51 devstack sudo[95258]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.379s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:51 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:37:51 devstack cinder-volume[86310]: DEBUG oslo_service.periodic_task [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Running periodic task VolumeManager._thread_info {{(pid=86310) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 14:37:51 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] thread count: 28 {{(pid=86310) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 14:37:51 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] thread info: [<_MainThread(MainThread, started 128854208852096)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86310) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 14:37:51 devstack sudo[95256]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8e762737-69d5-498b-9175-0e78b3cc83ec tempest-VolumesImageMetadata-2060991037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-9b6b8415-2459-4c63-9e14-48c9620a6403" returned: 0 in 0.572s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8e762737-69d5-498b-9175-0e78b3cc83ec tempest-VolumesImageMetadata-2060991037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-9b6b8415-2459-4c63-9e14-48c9620a6403 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:51 devstack sudo[95265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-9b6b8415-2459-4c63-9e14-48c9620a6403 Sep 23 14:37:51 devstack sudo[95265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:52 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-a77fcf93-644f-41c6-af74-8d22bb038dac tempest-VolumeRetypeWithoutMigrationTest-1531553567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:37:52 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-a77fcf93-644f-41c6-af74-8d22bb038dac tempest-VolumeRetypeWithoutMigrationTest-1531553567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:37:52 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-a77fcf93-644f-41c6-af74-8d22bb038dac tempest-VolumeRetypeWithoutMigrationTest-1531553567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:37:52 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-a77fcf93-644f-41c6-af74-8d22bb038dac tempest-VolumeRetypeWithoutMigrationTest-1531553567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:37:52 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-a77fcf93-644f-41c6-af74-8d22bb038dac tempest-VolumeRetypeWithoutMigrationTest-1531553567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:37:52 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a77fcf93-644f-41c6-af74-8d22bb038dac tempest-VolumeRetypeWithoutMigrationTest-1531553567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:52 devstack sudo[95268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:37:52 devstack sudo[95268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:52 devstack sudo[95265]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:52 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8e762737-69d5-498b-9175-0e78b3cc83ec tempest-VolumesImageMetadata-2060991037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-9b6b8415-2459-4c63-9e14-48c9620a6403" returned: 0 in 0.419s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:52 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-8e762737-69d5-498b-9175-0e78b3cc83ec tempest-VolumesImageMetadata-2060991037 None] Lock "cinder-quobyte-9b6b8415-2459-4c63-9e14-48c9620a6403" released by "delete_volume" :: held 1.052s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:37:52 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-8e762737-69d5-498b-9175-0e78b3cc83ec tempest-VolumesImageMetadata-2060991037 None] Created reservations ['902f8125-ff59-418c-b836-8b837b7e5901', 'e2648f0f-afe8-4618-b397-da4d335cfdd7', 'a7f5ce2b-af17-438b-b741-da208baf5825', '64c18a4d-ec03-4546-8a58-655f056ebc4b'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:37:52 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-8e762737-69d5-498b-9175-0e78b3cc83ec tempest-VolumesImageMetadata-2060991037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:37:52 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-8e762737-69d5-498b-9175-0e78b3cc83ec tempest-VolumesImageMetadata-2060991037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:37:52 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-8e762737-69d5-498b-9175-0e78b3cc83ec tempest-VolumesImageMetadata-2060991037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:37:52 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-8e762737-69d5-498b-9175-0e78b3cc83ec tempest-VolumesImageMetadata-2060991037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:37:52 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-8e762737-69d5-498b-9175-0e78b3cc83ec tempest-VolumesImageMetadata-2060991037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:37:52 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8e762737-69d5-498b-9175-0e78b3cc83ec tempest-VolumesImageMetadata-2060991037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:52 devstack sudo[95272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:37:52 devstack sudo[95272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:52 devstack sudo[95268]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:52 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a77fcf93-644f-41c6-af74-8d22bb038dac tempest-VolumeRetypeWithoutMigrationTest-1531553567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.424s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:52 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-a77fcf93-644f-41c6-af74-8d22bb038dac tempest-VolumeRetypeWithoutMigrationTest-1531553567 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:37:52 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-a77fcf93-644f-41c6-af74-8d22bb038dac tempest-VolumeRetypeWithoutMigrationTest-1531553567 None] Retype volume completed successfully. Sep 23 14:37:52 devstack sudo[95272]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:52 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8e762737-69d5-498b-9175-0e78b3cc83ec tempest-VolumesImageMetadata-2060991037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.304s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:52 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-8e762737-69d5-498b-9175-0e78b3cc83ec tempest-VolumesImageMetadata-2060991037 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:37:52 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-8e762737-69d5-498b-9175-0e78b3cc83ec tempest-VolumesImageMetadata-2060991037 None] Deleted volume successfully. Sep 23 14:37:52 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-8e762737-69d5-498b-9175-0e78b3cc83ec tempest-VolumesImageMetadata-2060991037 None] Lock "cinder-9b6b8415-2459-4c63-9e14-48c9620a6403-delete_volume" released by "delete_volume" :: held 1.625s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:37:53 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-4a2e494d-c7e4-48be-b8f1-c8bce56069b4 tempest-VolumeRetypeWithoutMigrationTest-1531553567 None] Acquiring lock "cinder-a9d6f3ef-c69c-43d9-8aa1-a55178b047d2-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:37:53 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-4a2e494d-c7e4-48be-b8f1-c8bce56069b4 tempest-VolumeRetypeWithoutMigrationTest-1531553567 None] Lock "cinder-a9d6f3ef-c69c-43d9-8aa1-a55178b047d2-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:37:53 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-4a2e494d-c7e4-48be-b8f1-c8bce56069b4 tempest-VolumeRetypeWithoutMigrationTest-1531553567 None] Acquiring lock "cinder-quobyte-a9d6f3ef-c69c-43d9-8aa1-a55178b047d2" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:37:53 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-4a2e494d-c7e4-48be-b8f1-c8bce56069b4 tempest-VolumeRetypeWithoutMigrationTest-1531553567 None] Lock "cinder-quobyte-a9d6f3ef-c69c-43d9-8aa1-a55178b047d2" acquired by "delete_volume" :: waited 0.032s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:37:53 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[f173a069-4288-4dd6-ba75-a37a0b0dd89d]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:37:53 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-4a2e494d-c7e4-48be-b8f1-c8bce56069b4 tempest-VolumeRetypeWithoutMigrationTest-1531553567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-a9d6f3ef-c69c-43d9-8aa1-a55178b047d2 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:53 devstack sudo[95276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-a9d6f3ef-c69c-43d9-8aa1-a55178b047d2 Sep 23 14:37:53 devstack sudo[95276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:53 devstack sudo[95276]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:53 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-4a2e494d-c7e4-48be-b8f1-c8bce56069b4 tempest-VolumeRetypeWithoutMigrationTest-1531553567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-a9d6f3ef-c69c-43d9-8aa1-a55178b047d2" returned: 0 in 0.514s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:53 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-4a2e494d-c7e4-48be-b8f1-c8bce56069b4 tempest-VolumeRetypeWithoutMigrationTest-1531553567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-a9d6f3ef-c69c-43d9-8aa1-a55178b047d2 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:54 devstack sudo[95281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-a9d6f3ef-c69c-43d9-8aa1-a55178b047d2 Sep 23 14:37:54 devstack sudo[95281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:54 devstack sudo[95281]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:54 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-4a2e494d-c7e4-48be-b8f1-c8bce56069b4 tempest-VolumeRetypeWithoutMigrationTest-1531553567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-a9d6f3ef-c69c-43d9-8aa1-a55178b047d2" returned: 0 in 0.319s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:54 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-4a2e494d-c7e4-48be-b8f1-c8bce56069b4 tempest-VolumeRetypeWithoutMigrationTest-1531553567 None] Lock "cinder-quobyte-a9d6f3ef-c69c-43d9-8aa1-a55178b047d2" released by "delete_volume" :: held 0.927s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:37:54 devstack cinder-volume[86310]: WARNING cinder.quota [None req-4a2e494d-c7e4-48be-b8f1-c8bce56069b4 tempest-VolumeRetypeWithoutMigrationTest-1531553567 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 23 14:37:54 devstack cinder-volume[86310]: WARNING cinder.quota [None req-4a2e494d-c7e4-48be-b8f1-c8bce56069b4 tempest-VolumeRetypeWithoutMigrationTest-1531553567 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 23 14:37:54 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-4a2e494d-c7e4-48be-b8f1-c8bce56069b4 tempest-VolumeRetypeWithoutMigrationTest-1531553567 None] Created reservations ['fa3c3665-41a8-4761-b917-94647c11fe68', '4cd6a3c1-6541-4bcd-867a-dc33e44bdf9b', '4a68ecaf-6920-4ec6-bca5-be5a6d4e0e70', '184466c7-0593-480b-8ca8-e501cecb0e79'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:37:54 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-4a2e494d-c7e4-48be-b8f1-c8bce56069b4 tempest-VolumeRetypeWithoutMigrationTest-1531553567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:37:54 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-4a2e494d-c7e4-48be-b8f1-c8bce56069b4 tempest-VolumeRetypeWithoutMigrationTest-1531553567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:37:54 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-4a2e494d-c7e4-48be-b8f1-c8bce56069b4 tempest-VolumeRetypeWithoutMigrationTest-1531553567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:37:54 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-4a2e494d-c7e4-48be-b8f1-c8bce56069b4 tempest-VolumeRetypeWithoutMigrationTest-1531553567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:37:54 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-4a2e494d-c7e4-48be-b8f1-c8bce56069b4 tempest-VolumeRetypeWithoutMigrationTest-1531553567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:37:54 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-4a2e494d-c7e4-48be-b8f1-c8bce56069b4 tempest-VolumeRetypeWithoutMigrationTest-1531553567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:54 devstack sudo[95284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:37:54 devstack sudo[95284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:54 devstack sudo[95284]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:54 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-4a2e494d-c7e4-48be-b8f1-c8bce56069b4 tempest-VolumeRetypeWithoutMigrationTest-1531553567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.332s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:54 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-4a2e494d-c7e4-48be-b8f1-c8bce56069b4 tempest-VolumeRetypeWithoutMigrationTest-1531553567 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:37:54 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-4a2e494d-c7e4-48be-b8f1-c8bce56069b4 tempest-VolumeRetypeWithoutMigrationTest-1531553567 None] Deleted volume successfully. Sep 23 14:37:54 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-4a2e494d-c7e4-48be-b8f1-c8bce56069b4 tempest-VolumeRetypeWithoutMigrationTest-1531553567 None] Lock "cinder-a9d6f3ef-c69c-43d9-8aa1-a55178b047d2-delete_volume" released by "delete_volume" :: held 1.643s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:37:58 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-15008099-1d5b-4113-a41f-e93ba75b75f6 tempest-SnapshotMetadataTestJSON-1697246557 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:37:58 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-15008099-1d5b-4113-a41f-e93ba75b75f6 tempest-SnapshotMetadataTestJSON-1697246557 None] Flow 'volume_create_manager' (319600a4-87cf-46cc-91f8-9063c1a43675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:37:58 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-15008099-1d5b-4113-a41f-e93ba75b75f6 tempest-SnapshotMetadataTestJSON-1697246557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba69afa9-b988-42d6-ae23-872987795cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:37:58 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-15008099-1d5b-4113-a41f-e93ba75b75f6 tempest-SnapshotMetadataTestJSON-1697246557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba69afa9-b988-42d6-ae23-872987795cf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:37:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-696521289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94d1be1a-d173-4e3b-abd0-a1cad34fb61f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4e34e1800eb411ab79f6c06ac7dd2b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:37:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:37:59Z,use_quota=True,user_id='108eb759cd6548a2bccb6a8742e93fa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:37:58 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-15008099-1d5b-4113-a41f-e93ba75b75f6 tempest-SnapshotMetadataTestJSON-1697246557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (215ef540-04f0-4ff5-8f19-5e27f3d0855c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:37:58 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-15008099-1d5b-4113-a41f-e93ba75b75f6 tempest-SnapshotMetadataTestJSON-1697246557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (215ef540-04f0-4ff5-8f19-5e27f3d0855c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:37:58 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-15008099-1d5b-4113-a41f-e93ba75b75f6 tempest-SnapshotMetadataTestJSON-1697246557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6a53a7a-ea57-4259-aae7-ec1bfa7ac870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:37:58 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-15008099-1d5b-4113-a41f-e93ba75b75f6 tempest-SnapshotMetadataTestJSON-1697246557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6a53a7a-ea57-4259-aae7-ec1bfa7ac870) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94d1be1a-d173-4e3b-abd0-a1cad34fb61f', 'volume_name': 'volume-94d1be1a-d173-4e3b-abd0-a1cad34fb61f', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:37:58 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-15008099-1d5b-4113-a41f-e93ba75b75f6 tempest-SnapshotMetadataTestJSON-1697246557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (822aa4bb-8998-4e92-9bf5-58a1cef45c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:37:58 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-15008099-1d5b-4113-a41f-e93ba75b75f6 tempest-SnapshotMetadataTestJSON-1697246557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (822aa4bb-8998-4e92-9bf5-58a1cef45c76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:37:58 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-15008099-1d5b-4113-a41f-e93ba75b75f6 tempest-SnapshotMetadataTestJSON-1697246557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f29b6c7e-4fdf-435f-ad58-a36fa0b50840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:37:58 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-15008099-1d5b-4113-a41f-e93ba75b75f6 tempest-SnapshotMetadataTestJSON-1697246557 None] Volume 94d1be1a-d173-4e3b-abd0-a1cad34fb61f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94d1be1a-d173-4e3b-abd0-a1cad34fb61f', 'volume_size': 1} Sep 23 14:37:58 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-15008099-1d5b-4113-a41f-e93ba75b75f6 tempest-SnapshotMetadataTestJSON-1697246557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:37:58 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-15008099-1d5b-4113-a41f-e93ba75b75f6 tempest-SnapshotMetadataTestJSON-1697246557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:37:58 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-15008099-1d5b-4113-a41f-e93ba75b75f6 tempest-SnapshotMetadataTestJSON-1697246557 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:37:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-696521289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94d1be1a-d173-4e3b-abd0-a1cad34fb61f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4e34e1800eb411ab79f6c06ac7dd2b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:37:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:37:59Z,use_quota=True,user_id='108eb759cd6548a2bccb6a8742e93fa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:37:58 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-15008099-1d5b-4113-a41f-e93ba75b75f6 tempest-SnapshotMetadataTestJSON-1697246557 None] Creating volume 94d1be1a-d173-4e3b-abd0-a1cad34fb61f {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:37:58 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-15008099-1d5b-4113-a41f-e93ba75b75f6 tempest-SnapshotMetadataTestJSON-1697246557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:37:58 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-15008099-1d5b-4113-a41f-e93ba75b75f6 tempest-SnapshotMetadataTestJSON-1697246557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:37:58 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-15008099-1d5b-4113-a41f-e93ba75b75f6 tempest-SnapshotMetadataTestJSON-1697246557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:37:58 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-15008099-1d5b-4113-a41f-e93ba75b75f6 tempest-SnapshotMetadataTestJSON-1697246557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:37:58 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-15008099-1d5b-4113-a41f-e93ba75b75f6 tempest-SnapshotMetadataTestJSON-1697246557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:37:58 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-15008099-1d5b-4113-a41f-e93ba75b75f6 tempest-SnapshotMetadataTestJSON-1697246557 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:37:58 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-15008099-1d5b-4113-a41f-e93ba75b75f6 tempest-SnapshotMetadataTestJSON-1697246557 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:37:58 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-15008099-1d5b-4113-a41f-e93ba75b75f6 tempest-SnapshotMetadataTestJSON-1697246557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-94d1be1a-d173-4e3b-abd0-a1cad34fb61f 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:58 devstack sudo[95290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-94d1be1a-d173-4e3b-abd0-a1cad34fb61f 1073741824 Sep 23 14:37:58 devstack sudo[95290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:59 devstack sudo[95290]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:59 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-15008099-1d5b-4113-a41f-e93ba75b75f6 tempest-SnapshotMetadataTestJSON-1697246557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-94d1be1a-d173-4e3b-abd0-a1cad34fb61f 1073741824" returned: 0 in 0.562s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:59 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-15008099-1d5b-4113-a41f-e93ba75b75f6 tempest-SnapshotMetadataTestJSON-1697246557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-94d1be1a-d173-4e3b-abd0-a1cad34fb61f {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:37:59 devstack sudo[95296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-94d1be1a-d173-4e3b-abd0-a1cad34fb61f Sep 23 14:37:59 devstack sudo[95296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:37:59 devstack sudo[95296]: pam_unix(sudo:session): session closed for user root Sep 23 14:37:59 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-15008099-1d5b-4113-a41f-e93ba75b75f6 tempest-SnapshotMetadataTestJSON-1697246557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-94d1be1a-d173-4e3b-abd0-a1cad34fb61f" returned: 0 in 0.290s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:37:59 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-15008099-1d5b-4113-a41f-e93ba75b75f6 tempest-SnapshotMetadataTestJSON-1697246557 None] <== create_volume: return (905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:37:59 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-15008099-1d5b-4113-a41f-e93ba75b75f6 tempest-SnapshotMetadataTestJSON-1697246557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.908s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:37:59 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-15008099-1d5b-4113-a41f-e93ba75b75f6 tempest-SnapshotMetadataTestJSON-1697246557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f29b6c7e-4fdf-435f-ad58-a36fa0b50840) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94d1be1a-d173-4e3b-abd0-a1cad34fb61f', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:37:59 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-15008099-1d5b-4113-a41f-e93ba75b75f6 tempest-SnapshotMetadataTestJSON-1697246557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c16e10e0-de5a-4c60-8640-0701a41b22e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:37:59 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-15008099-1d5b-4113-a41f-e93ba75b75f6 tempest-SnapshotMetadataTestJSON-1697246557 None] Volume volume-94d1be1a-d173-4e3b-abd0-a1cad34fb61f (94d1be1a-d173-4e3b-abd0-a1cad34fb61f): created successfully Sep 23 14:37:59 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-15008099-1d5b-4113-a41f-e93ba75b75f6 tempest-SnapshotMetadataTestJSON-1697246557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c16e10e0-de5a-4c60-8640-0701a41b22e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:37:59 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-15008099-1d5b-4113-a41f-e93ba75b75f6 tempest-SnapshotMetadataTestJSON-1697246557 None] Flow 'volume_create_manager' (319600a4-87cf-46cc-91f8-9063c1a43675) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:37:59 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-15008099-1d5b-4113-a41f-e93ba75b75f6 tempest-SnapshotMetadataTestJSON-1697246557 None] Created volume successfully. Sep 23 14:38:01 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-3f749bfc-d75c-4327-8266-5a96dd2e8c62 tempest-SnapshotMetadataTestJSON-1697246557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:38:01 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-3f749bfc-d75c-4327-8266-5a96dd2e8c62 tempest-SnapshotMetadataTestJSON-1697246557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:38:01 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-3f749bfc-d75c-4327-8266-5a96dd2e8c62 tempest-SnapshotMetadataTestJSON-1697246557 None] Creating offline snapshot c9c96bcc-f197-45df-b100-1599f1b09d29 of volume 94d1be1a-d173-4e3b-abd0-a1cad34fb61f {{(pid=86310) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 14:38:01 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ddac7a-d533-44af-a99e-21b9ddfda258]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:38:01 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-3f749bfc-d75c-4327-8266-5a96dd2e8c62 tempest-SnapshotMetadataTestJSON-1697246557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-94d1be1a-d173-4e3b-abd0-a1cad34fb61f {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:38:01 devstack sudo[95299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-94d1be1a-d173-4e3b-abd0-a1cad34fb61f Sep 23 14:38:01 devstack sudo[95299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:38:01 devstack sudo[95299]: pam_unix(sudo:session): session closed for user root Sep 23 14:38:01 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-3f749bfc-d75c-4327-8266-5a96dd2e8c62 tempest-SnapshotMetadataTestJSON-1697246557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-94d1be1a-d173-4e3b-abd0-a1cad34fb61f" returned: 0 in 0.415s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:38:01 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-3f749bfc-d75c-4327-8266-5a96dd2e8c62 tempest-SnapshotMetadataTestJSON-1697246557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-94d1be1a-d173-4e3b-abd0-a1cad34fb61f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-94d1be1a-d173-4e3b-abd0-a1cad34fb61f.c9c96bcc-f197-45df-b100-1599f1b09d29 1G {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:38:01 devstack sudo[95304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-94d1be1a-d173-4e3b-abd0-a1cad34fb61f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-94d1be1a-d173-4e3b-abd0-a1cad34fb61f.c9c96bcc-f197-45df-b100-1599f1b09d29 1G Sep 23 14:38:01 devstack sudo[95304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:38:02 devstack sudo[95304]: pam_unix(sudo:session): session closed for user root Sep 23 14:38:02 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-3f749bfc-d75c-4327-8266-5a96dd2e8c62 tempest-SnapshotMetadataTestJSON-1697246557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-94d1be1a-d173-4e3b-abd0-a1cad34fb61f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-94d1be1a-d173-4e3b-abd0-a1cad34fb61f.c9c96bcc-f197-45df-b100-1599f1b09d29 1G" returned: 0 in 0.487s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:38:02 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-3f749bfc-d75c-4327-8266-5a96dd2e8c62 tempest-SnapshotMetadataTestJSON-1697246557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94d1be1a-d173-4e3b-abd0-a1cad34fb61f -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-94d1be1a-d173-4e3b-abd0-a1cad34fb61f.c9c96bcc-f197-45df-b100-1599f1b09d29 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:38:02 devstack sudo[95311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94d1be1a-d173-4e3b-abd0-a1cad34fb61f -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-94d1be1a-d173-4e3b-abd0-a1cad34fb61f.c9c96bcc-f197-45df-b100-1599f1b09d29 Sep 23 14:38:02 devstack sudo[95311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:38:02 devstack sudo[95311]: pam_unix(sudo:session): session closed for user root Sep 23 14:38:02 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-3f749bfc-d75c-4327-8266-5a96dd2e8c62 tempest-SnapshotMetadataTestJSON-1697246557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94d1be1a-d173-4e3b-abd0-a1cad34fb61f -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-94d1be1a-d173-4e3b-abd0-a1cad34fb61f.c9c96bcc-f197-45df-b100-1599f1b09d29" returned: 0 in 0.374s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:38:02 devstack cinder-volume[86310]: WARNING cinder.volume.drivers.remotefs [None req-3f749bfc-d75c-4327-8266-5a96dd2e8c62 tempest-SnapshotMetadataTestJSON-1697246557 None] /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-94d1be1a-d173-4e3b-abd0-a1cad34fb61f.c9c96bcc-f197-45df-b100-1599f1b09d29 is being set with open permissions: ugo+rw Sep 23 14:38:02 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-3f749bfc-d75c-4327-8266-5a96dd2e8c62 tempest-SnapshotMetadataTestJSON-1697246557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-94d1be1a-d173-4e3b-abd0-a1cad34fb61f.c9c96bcc-f197-45df-b100-1599f1b09d29 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:38:02 devstack sudo[95316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-94d1be1a-d173-4e3b-abd0-a1cad34fb61f.c9c96bcc-f197-45df-b100-1599f1b09d29 Sep 23 14:38:02 devstack sudo[95316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:38:02 devstack sudo[95316]: pam_unix(sudo:session): session closed for user root Sep 23 14:38:02 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-3f749bfc-d75c-4327-8266-5a96dd2e8c62 tempest-SnapshotMetadataTestJSON-1697246557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-94d1be1a-d173-4e3b-abd0-a1cad34fb61f.c9c96bcc-f197-45df-b100-1599f1b09d29" returned: 0 in 0.279s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:38:02 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-3f749bfc-d75c-4327-8266-5a96dd2e8c62 tempest-SnapshotMetadataTestJSON-1697246557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-94d1be1a-d173-4e3b-abd0-a1cad34fb61f.info {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:38:02 devstack sudo[95319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-94d1be1a-d173-4e3b-abd0-a1cad34fb61f.info Sep 23 14:38:02 devstack sudo[95319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:38:03 devstack sudo[95319]: pam_unix(sudo:session): session closed for user root Sep 23 14:38:03 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-3f749bfc-d75c-4327-8266-5a96dd2e8c62 tempest-SnapshotMetadataTestJSON-1697246557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-94d1be1a-d173-4e3b-abd0-a1cad34fb61f.info" returned: 0 in 0.305s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:38:03 devstack cinder-volume[86310]: WARNING cinder.volume.drivers.remotefs [None req-3f749bfc-d75c-4327-8266-5a96dd2e8c62 tempest-SnapshotMetadataTestJSON-1697246557 None] /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-94d1be1a-d173-4e3b-abd0-a1cad34fb61f.info is being set with open permissions: ugo+rw Sep 23 14:38:03 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-3f749bfc-d75c-4327-8266-5a96dd2e8c62 tempest-SnapshotMetadataTestJSON-1697246557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-94d1be1a-d173-4e3b-abd0-a1cad34fb61f.info {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:38:03 devstack sudo[95322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-94d1be1a-d173-4e3b-abd0-a1cad34fb61f.info Sep 23 14:38:03 devstack sudo[95322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:38:03 devstack sudo[95322]: pam_unix(sudo:session): session closed for user root Sep 23 14:38:03 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-3f749bfc-d75c-4327-8266-5a96dd2e8c62 tempest-SnapshotMetadataTestJSON-1697246557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-94d1be1a-d173-4e3b-abd0-a1cad34fb61f.info" returned: 0 in 0.271s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:38:03 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-3f749bfc-d75c-4327-8266-5a96dd2e8c62 tempest-SnapshotMetadataTestJSON-1697246557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.244s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:38:03 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-3f749bfc-d75c-4327-8266-5a96dd2e8c62 tempest-SnapshotMetadataTestJSON-1697246557 None] Create snapshot completed successfully Sep 23 14:38:05 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-d9aad0b3-10d3-439e-85ae-790f13f5e5fe tempest-SnapshotMetadataTestJSON-1697246557 None] Acquiring lock "cinder-c9c96bcc-f197-45df-b100-1599f1b09d29-delete_snapshot" by "delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:38:05 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-d9aad0b3-10d3-439e-85ae-790f13f5e5fe tempest-SnapshotMetadataTestJSON-1697246557 None] Lock "cinder-c9c96bcc-f197-45df-b100-1599f1b09d29-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:38:05 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-d9aad0b3-10d3-439e-85ae-790f13f5e5fe tempest-SnapshotMetadataTestJSON-1697246557 None] Acquiring lock "cinder-quobyte-94d1be1a-d173-4e3b-abd0-a1cad34fb61f" by "delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:38:05 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-d9aad0b3-10d3-439e-85ae-790f13f5e5fe tempest-SnapshotMetadataTestJSON-1697246557 None] Lock "cinder-quobyte-94d1be1a-d173-4e3b-abd0-a1cad34fb61f" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:38:05 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-d9aad0b3-10d3-439e-85ae-790f13f5e5fe tempest-SnapshotMetadataTestJSON-1697246557 None] Acquiring lock "cinder-quobyte-c9c96bcc-f197-45df-b100-1599f1b09d29" by "_delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:38:05 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-d9aad0b3-10d3-439e-85ae-790f13f5e5fe tempest-SnapshotMetadataTestJSON-1697246557 None] Lock "cinder-quobyte-c9c96bcc-f197-45df-b100-1599f1b09d29" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:38:05 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-d9aad0b3-10d3-439e-85ae-790f13f5e5fe tempest-SnapshotMetadataTestJSON-1697246557 None] Deleting offline snapshot c9c96bcc-f197-45df-b100-1599f1b09d29 of volume 94d1be1a-d173-4e3b-abd0-a1cad34fb61f {{(pid=86310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 14:38:05 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-d9aad0b3-10d3-439e-85ae-790f13f5e5fe tempest-SnapshotMetadataTestJSON-1697246557 None] snapshot_file for this snap is: volume-94d1be1a-d173-4e3b-abd0-a1cad34fb61f.c9c96bcc-f197-45df-b100-1599f1b09d29 {{(pid=86310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 14:38:05 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[488b0963-7140-46e9-aa7a-4c15ddd1ab3d]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:38:05 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d9aad0b3-10d3-439e-85ae-790f13f5e5fe tempest-SnapshotMetadataTestJSON-1697246557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-94d1be1a-d173-4e3b-abd0-a1cad34fb61f.c9c96bcc-f197-45df-b100-1599f1b09d29 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:38:06 devstack sudo[95325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-94d1be1a-d173-4e3b-abd0-a1cad34fb61f.c9c96bcc-f197-45df-b100-1599f1b09d29 Sep 23 14:38:06 devstack sudo[95325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:38:06 devstack sudo[95325]: pam_unix(sudo:session): session closed for user root Sep 23 14:38:06 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d9aad0b3-10d3-439e-85ae-790f13f5e5fe tempest-SnapshotMetadataTestJSON-1697246557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-94d1be1a-d173-4e3b-abd0-a1cad34fb61f.c9c96bcc-f197-45df-b100-1599f1b09d29" returned: 0 in 0.418s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:38:06 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-d9aad0b3-10d3-439e-85ae-790f13f5e5fe tempest-SnapshotMetadataTestJSON-1697246557 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94d1be1a-d173-4e3b-abd0-a1cad34fb61f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 14:38:06 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[b72083d5-8da3-4e12-a771-9064c68fcfce]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:38:06 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d9aad0b3-10d3-439e-85ae-790f13f5e5fe tempest-SnapshotMetadataTestJSON-1697246557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-94d1be1a-d173-4e3b-abd0-a1cad34fb61f {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:38:06 devstack sudo[95331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-94d1be1a-d173-4e3b-abd0-a1cad34fb61f Sep 23 14:38:06 devstack sudo[95331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:38:06 devstack sudo[95331]: pam_unix(sudo:session): session closed for user root Sep 23 14:38:06 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d9aad0b3-10d3-439e-85ae-790f13f5e5fe tempest-SnapshotMetadataTestJSON-1697246557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-94d1be1a-d173-4e3b-abd0-a1cad34fb61f" returned: 0 in 0.386s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:38:06 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d9aad0b3-10d3-439e-85ae-790f13f5e5fe tempest-SnapshotMetadataTestJSON-1697246557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-94d1be1a-d173-4e3b-abd0-a1cad34fb61f.c9c96bcc-f197-45df-b100-1599f1b09d29 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:38:06 devstack sudo[95336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-94d1be1a-d173-4e3b-abd0-a1cad34fb61f.c9c96bcc-f197-45df-b100-1599f1b09d29 Sep 23 14:38:06 devstack sudo[95336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:38:07 devstack sudo[95336]: pam_unix(sudo:session): session closed for user root Sep 23 14:38:07 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d9aad0b3-10d3-439e-85ae-790f13f5e5fe tempest-SnapshotMetadataTestJSON-1697246557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-94d1be1a-d173-4e3b-abd0-a1cad34fb61f.c9c96bcc-f197-45df-b100-1599f1b09d29" returned: 0 in 0.422s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:38:07 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d9aad0b3-10d3-439e-85ae-790f13f5e5fe tempest-SnapshotMetadataTestJSON-1697246557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-94d1be1a-d173-4e3b-abd0-a1cad34fb61f.c9c96bcc-f197-45df-b100-1599f1b09d29 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:38:07 devstack sudo[95343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-94d1be1a-d173-4e3b-abd0-a1cad34fb61f.c9c96bcc-f197-45df-b100-1599f1b09d29 Sep 23 14:38:07 devstack sudo[95343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:38:07 devstack sudo[95343]: pam_unix(sudo:session): session closed for user root Sep 23 14:38:07 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d9aad0b3-10d3-439e-85ae-790f13f5e5fe tempest-SnapshotMetadataTestJSON-1697246557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-94d1be1a-d173-4e3b-abd0-a1cad34fb61f.c9c96bcc-f197-45df-b100-1599f1b09d29" returned: 0 in 0.351s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:38:07 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-d9aad0b3-10d3-439e-85ae-790f13f5e5fe tempest-SnapshotMetadataTestJSON-1697246557 None] Lock "cinder-quobyte-c9c96bcc-f197-45df-b100-1599f1b09d29" released by "_delete_snapshot" :: held 1.720s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:38:07 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-d9aad0b3-10d3-439e-85ae-790f13f5e5fe tempest-SnapshotMetadataTestJSON-1697246557 None] Lock "cinder-quobyte-94d1be1a-d173-4e3b-abd0-a1cad34fb61f" released by "delete_snapshot" :: held 1.746s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:38:07 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-d9aad0b3-10d3-439e-85ae-790f13f5e5fe tempest-SnapshotMetadataTestJSON-1697246557 None] Created reservations ['36532c43-1a45-48b9-b8bd-999d270fefdb', '370f2b32-930d-4202-9498-4ef77b20d489', '04eadfe6-c60b-4d4b-a92b-88a47d2a5df7', '61f9a156-56fc-4917-bf6d-ab4184290e8a'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:38:07 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-d9aad0b3-10d3-439e-85ae-790f13f5e5fe tempest-SnapshotMetadataTestJSON-1697246557 None] Delete snapshot completed successfully. Sep 23 14:38:07 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-d9aad0b3-10d3-439e-85ae-790f13f5e5fe tempest-SnapshotMetadataTestJSON-1697246557 None] Lock "cinder-c9c96bcc-f197-45df-b100-1599f1b09d29-delete_snapshot" released by "delete_snapshot" :: held 1.999s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:38:08 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-ef29950f-24a4-4996-92f3-2f65df26a727 tempest-SnapshotMetadataTestJSON-1697246557 None] Acquiring lock "cinder-94d1be1a-d173-4e3b-abd0-a1cad34fb61f-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:38:08 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-ef29950f-24a4-4996-92f3-2f65df26a727 tempest-SnapshotMetadataTestJSON-1697246557 None] Lock "cinder-94d1be1a-d173-4e3b-abd0-a1cad34fb61f-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:38:08 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-ef29950f-24a4-4996-92f3-2f65df26a727 tempest-SnapshotMetadataTestJSON-1697246557 None] Acquiring lock "cinder-quobyte-94d1be1a-d173-4e3b-abd0-a1cad34fb61f" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:38:08 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-ef29950f-24a4-4996-92f3-2f65df26a727 tempest-SnapshotMetadataTestJSON-1697246557 None] Lock "cinder-quobyte-94d1be1a-d173-4e3b-abd0-a1cad34fb61f" acquired by "delete_volume" :: waited 0.070s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:38:08 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[04c13dcb-9175-44cf-9fe1-27030e4268f2]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:38:08 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ef29950f-24a4-4996-92f3-2f65df26a727 tempest-SnapshotMetadataTestJSON-1697246557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-94d1be1a-d173-4e3b-abd0-a1cad34fb61f {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:38:08 devstack sudo[95363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-94d1be1a-d173-4e3b-abd0-a1cad34fb61f Sep 23 14:38:08 devstack sudo[95363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:38:09 devstack sudo[95363]: pam_unix(sudo:session): session closed for user root Sep 23 14:38:09 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ef29950f-24a4-4996-92f3-2f65df26a727 tempest-SnapshotMetadataTestJSON-1697246557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-94d1be1a-d173-4e3b-abd0-a1cad34fb61f" returned: 0 in 0.561s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:38:09 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ef29950f-24a4-4996-92f3-2f65df26a727 tempest-SnapshotMetadataTestJSON-1697246557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-94d1be1a-d173-4e3b-abd0-a1cad34fb61f {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:38:09 devstack sudo[95373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-94d1be1a-d173-4e3b-abd0-a1cad34fb61f Sep 23 14:38:09 devstack sudo[95373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:38:09 devstack sudo[95373]: pam_unix(sudo:session): session closed for user root Sep 23 14:38:09 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ef29950f-24a4-4996-92f3-2f65df26a727 tempest-SnapshotMetadataTestJSON-1697246557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-94d1be1a-d173-4e3b-abd0-a1cad34fb61f" returned: 0 in 0.361s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:38:09 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-ef29950f-24a4-4996-92f3-2f65df26a727 tempest-SnapshotMetadataTestJSON-1697246557 None] Lock "cinder-quobyte-94d1be1a-d173-4e3b-abd0-a1cad34fb61f" released by "delete_volume" :: held 1.106s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:38:09 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-ef29950f-24a4-4996-92f3-2f65df26a727 tempest-SnapshotMetadataTestJSON-1697246557 None] Created reservations ['62725fdd-3c9c-40c8-9ba8-524d2104675c', '71300ace-d329-4bda-834e-282ea1cc25ac', 'ad46aa46-d99c-4c9f-a796-096b5363413b', 'd45f1a4e-764e-461b-9ed4-dfe446766f44'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:38:09 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-ef29950f-24a4-4996-92f3-2f65df26a727 tempest-SnapshotMetadataTestJSON-1697246557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:38:09 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-ef29950f-24a4-4996-92f3-2f65df26a727 tempest-SnapshotMetadataTestJSON-1697246557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:38:09 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-ef29950f-24a4-4996-92f3-2f65df26a727 tempest-SnapshotMetadataTestJSON-1697246557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:38:09 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-ef29950f-24a4-4996-92f3-2f65df26a727 tempest-SnapshotMetadataTestJSON-1697246557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:38:09 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-ef29950f-24a4-4996-92f3-2f65df26a727 tempest-SnapshotMetadataTestJSON-1697246557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:38:09 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ef29950f-24a4-4996-92f3-2f65df26a727 tempest-SnapshotMetadataTestJSON-1697246557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:38:09 devstack sudo[95377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:38:09 devstack sudo[95377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:38:09 devstack sudo[95377]: pam_unix(sudo:session): session closed for user root Sep 23 14:38:09 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ef29950f-24a4-4996-92f3-2f65df26a727 tempest-SnapshotMetadataTestJSON-1697246557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.318s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:38:09 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-ef29950f-24a4-4996-92f3-2f65df26a727 tempest-SnapshotMetadataTestJSON-1697246557 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:38:09 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-ef29950f-24a4-4996-92f3-2f65df26a727 tempest-SnapshotMetadataTestJSON-1697246557 None] Deleted volume successfully. Sep 23 14:38:10 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-ef29950f-24a4-4996-92f3-2f65df26a727 tempest-SnapshotMetadataTestJSON-1697246557 None] Lock "cinder-94d1be1a-d173-4e3b-abd0-a1cad34fb61f-delete_volume" released by "delete_volume" :: held 1.853s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:38:16 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-9360b226-44c7-4128-886a-f5b53cc4b512 tempest-GroupsTest-513280878 None] Group tempest-Group1-412620809: creating Sep 23 14:38:16 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-9360b226-44c7-4128-886a-f5b53cc4b512 tempest-GroupsTest-513280878 None] Group tempest-Group1-412620809: created successfully Sep 23 14:38:16 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-9360b226-44c7-4128-886a-f5b53cc4b512 tempest-GroupsTest-513280878 None] Create group completed successfully. Sep 23 14:38:17 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-89c505aa-9b37-4ca8-a882-52790c3c418b tempest-GroupsTest-513280878 None] Group tempest-Group2-906273307: creating Sep 23 14:38:17 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-89c505aa-9b37-4ca8-a882-52790c3c418b tempest-GroupsTest-513280878 None] Group tempest-Group2-906273307: created successfully Sep 23 14:38:17 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-89c505aa-9b37-4ca8-a882-52790c3c418b tempest-GroupsTest-513280878 None] Create group completed successfully. Sep 23 14:38:18 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-78e79b10-410d-4a55-bac9-5de79e54971e tempest-AbsoluteLimitsTests-1201601419 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:38:18 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-78e79b10-410d-4a55-bac9-5de79e54971e tempest-AbsoluteLimitsTests-1201601419 None] Flow 'volume_create_manager' (b23d39bc-1d5c-4a55-b9b5-f83bb4e36b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:38:18 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-78e79b10-410d-4a55-bac9-5de79e54971e tempest-AbsoluteLimitsTests-1201601419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d0583a2-b2fa-49e7-bade-6a0599732a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:38:18 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-78e79b10-410d-4a55-bac9-5de79e54971e tempest-AbsoluteLimitsTests-1201601419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d0583a2-b2fa-49e7-bade-6a0599732a5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:38:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-193900797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c6ccee2-5b1c-47eb-9bab-56e9623dbdce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a1ba5bc82ac411e90dddfcca2e26848',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:38:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:38:18Z,use_quota=True,user_id='c8ab8b5dabce4f608c413105ca2640b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:38:18 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-78e79b10-410d-4a55-bac9-5de79e54971e tempest-AbsoluteLimitsTests-1201601419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e9b1667-5739-4996-9a7d-efec7c337a35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:38:18 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-78e79b10-410d-4a55-bac9-5de79e54971e tempest-AbsoluteLimitsTests-1201601419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e9b1667-5739-4996-9a7d-efec7c337a35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:38:18 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-78e79b10-410d-4a55-bac9-5de79e54971e tempest-AbsoluteLimitsTests-1201601419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee9c0565-e75c-4869-ad00-d6204d51deca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:38:18 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-78e79b10-410d-4a55-bac9-5de79e54971e tempest-AbsoluteLimitsTests-1201601419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee9c0565-e75c-4869-ad00-d6204d51deca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c6ccee2-5b1c-47eb-9bab-56e9623dbdce', 'volume_name': 'volume-3c6ccee2-5b1c-47eb-9bab-56e9623dbdce', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:38:18 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-78e79b10-410d-4a55-bac9-5de79e54971e tempest-AbsoluteLimitsTests-1201601419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4177853c-cafb-450b-a94e-1e413af86963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:38:18 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-78e79b10-410d-4a55-bac9-5de79e54971e tempest-AbsoluteLimitsTests-1201601419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4177853c-cafb-450b-a94e-1e413af86963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:38:18 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-78e79b10-410d-4a55-bac9-5de79e54971e tempest-AbsoluteLimitsTests-1201601419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef9907d0-4d7a-4b80-86dd-33f826874f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:38:18 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-78e79b10-410d-4a55-bac9-5de79e54971e tempest-AbsoluteLimitsTests-1201601419 None] Volume 3c6ccee2-5b1c-47eb-9bab-56e9623dbdce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c6ccee2-5b1c-47eb-9bab-56e9623dbdce', 'volume_size': 1} Sep 23 14:38:18 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-78e79b10-410d-4a55-bac9-5de79e54971e tempest-AbsoluteLimitsTests-1201601419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:38:18 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-78e79b10-410d-4a55-bac9-5de79e54971e tempest-AbsoluteLimitsTests-1201601419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:38:18 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-78e79b10-410d-4a55-bac9-5de79e54971e tempest-AbsoluteLimitsTests-1201601419 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:38:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-193900797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c6ccee2-5b1c-47eb-9bab-56e9623dbdce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a1ba5bc82ac411e90dddfcca2e26848',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:38:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:38:18Z,use_quota=True,user_id='c8ab8b5dabce4f608c413105ca2640b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:38:18 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-78e79b10-410d-4a55-bac9-5de79e54971e tempest-AbsoluteLimitsTests-1201601419 None] Creating volume 3c6ccee2-5b1c-47eb-9bab-56e9623dbdce {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:38:18 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-78e79b10-410d-4a55-bac9-5de79e54971e tempest-AbsoluteLimitsTests-1201601419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:38:18 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-78e79b10-410d-4a55-bac9-5de79e54971e tempest-AbsoluteLimitsTests-1201601419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:38:18 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-78e79b10-410d-4a55-bac9-5de79e54971e tempest-AbsoluteLimitsTests-1201601419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:38:18 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-78e79b10-410d-4a55-bac9-5de79e54971e tempest-AbsoluteLimitsTests-1201601419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:38:18 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-78e79b10-410d-4a55-bac9-5de79e54971e tempest-AbsoluteLimitsTests-1201601419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:38:18 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-78e79b10-410d-4a55-bac9-5de79e54971e tempest-AbsoluteLimitsTests-1201601419 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:38:18 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-78e79b10-410d-4a55-bac9-5de79e54971e tempest-AbsoluteLimitsTests-1201601419 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:38:18 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-78e79b10-410d-4a55-bac9-5de79e54971e tempest-AbsoluteLimitsTests-1201601419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-3c6ccee2-5b1c-47eb-9bab-56e9623dbdce 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:38:18 devstack sudo[95424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-3c6ccee2-5b1c-47eb-9bab-56e9623dbdce 1073741824 Sep 23 14:38:18 devstack sudo[95424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:38:18 devstack sudo[95424]: pam_unix(sudo:session): session closed for user root Sep 23 14:38:18 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-78e79b10-410d-4a55-bac9-5de79e54971e tempest-AbsoluteLimitsTests-1201601419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-3c6ccee2-5b1c-47eb-9bab-56e9623dbdce 1073741824" returned: 0 in 0.642s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:38:18 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-78e79b10-410d-4a55-bac9-5de79e54971e tempest-AbsoluteLimitsTests-1201601419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-3c6ccee2-5b1c-47eb-9bab-56e9623dbdce {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:38:18 devstack sudo[95431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-3c6ccee2-5b1c-47eb-9bab-56e9623dbdce Sep 23 14:38:18 devstack sudo[95431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:38:19 devstack sudo[95431]: pam_unix(sudo:session): session closed for user root Sep 23 14:38:19 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-78e79b10-410d-4a55-bac9-5de79e54971e tempest-AbsoluteLimitsTests-1201601419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-3c6ccee2-5b1c-47eb-9bab-56e9623dbdce" returned: 0 in 0.608s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:38:19 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-78e79b10-410d-4a55-bac9-5de79e54971e tempest-AbsoluteLimitsTests-1201601419 None] <== create_volume: return (1342ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:38:19 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-78e79b10-410d-4a55-bac9-5de79e54971e tempest-AbsoluteLimitsTests-1201601419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.348s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:38:19 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-78e79b10-410d-4a55-bac9-5de79e54971e tempest-AbsoluteLimitsTests-1201601419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef9907d0-4d7a-4b80-86dd-33f826874f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c6ccee2-5b1c-47eb-9bab-56e9623dbdce', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:38:19 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-78e79b10-410d-4a55-bac9-5de79e54971e tempest-AbsoluteLimitsTests-1201601419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5643a8d9-d221-4da5-b4aa-2238c92d82f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:38:19 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-78e79b10-410d-4a55-bac9-5de79e54971e tempest-AbsoluteLimitsTests-1201601419 None] Volume volume-3c6ccee2-5b1c-47eb-9bab-56e9623dbdce (3c6ccee2-5b1c-47eb-9bab-56e9623dbdce): created successfully Sep 23 14:38:19 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-78e79b10-410d-4a55-bac9-5de79e54971e tempest-AbsoluteLimitsTests-1201601419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5643a8d9-d221-4da5-b4aa-2238c92d82f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:38:19 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-78e79b10-410d-4a55-bac9-5de79e54971e tempest-AbsoluteLimitsTests-1201601419 None] Flow 'volume_create_manager' (b23d39bc-1d5c-4a55-b9b5-f83bb4e36b02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:38:19 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-78e79b10-410d-4a55-bac9-5de79e54971e tempest-AbsoluteLimitsTests-1201601419 None] Created volume successfully. Sep 23 14:38:19 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-9965fc49-1d27-4ae3-9681-0ce52d32c830 tempest-GroupsTest-513280878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:38:19 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-9965fc49-1d27-4ae3-9681-0ce52d32c830 tempest-GroupsTest-513280878 None] Flow 'volume_create_manager' (ac429e35-364f-4529-be7b-663bf5c5c688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:38:19 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-9965fc49-1d27-4ae3-9681-0ce52d32c830 tempest-GroupsTest-513280878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42b2610a-5db8-447e-9950-d38db2c1bf0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:38:19 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-9965fc49-1d27-4ae3-9681-0ce52d32c830 tempest-GroupsTest-513280878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42b2610a-5db8-447e-9950-d38db2c1bf0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:38:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2052076910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=01d83cb6-528f-46a6-a213-f37605cb4f05,host='devstack@QuobyteHD#QuobyteHD',id=e29c9c73-1487-4283-bcfe-262949784b41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b10b3505b916486daf8831aa906c7be2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:38:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:38:20Z,use_quota=True,user_id='3130d2fbf9324ceaa7f0ca550570b0c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cbf86e0-fa95-44bf-b560-f92bbbd299a7),volume_type_id=0cbf86e0-fa95-44bf-b560-f92bbbd299a7)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:38:19 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-9965fc49-1d27-4ae3-9681-0ce52d32c830 tempest-GroupsTest-513280878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c0885a2-f01f-4043-aec3-65219297a094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:38:19 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-9965fc49-1d27-4ae3-9681-0ce52d32c830 tempest-GroupsTest-513280878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c0885a2-f01f-4043-aec3-65219297a094) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:38:19 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-9965fc49-1d27-4ae3-9681-0ce52d32c830 tempest-GroupsTest-513280878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (724790d7-739a-4e6a-bca3-549d7f54d680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:38:19 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-9965fc49-1d27-4ae3-9681-0ce52d32c830 tempest-GroupsTest-513280878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (724790d7-739a-4e6a-bca3-549d7f54d680) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e29c9c73-1487-4283-bcfe-262949784b41', 'volume_name': 'volume-e29c9c73-1487-4283-bcfe-262949784b41', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:38:19 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-9965fc49-1d27-4ae3-9681-0ce52d32c830 tempest-GroupsTest-513280878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ddee846-c404-4cb7-a717-802eeb714bd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:38:19 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-9965fc49-1d27-4ae3-9681-0ce52d32c830 tempest-GroupsTest-513280878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ddee846-c404-4cb7-a717-802eeb714bd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:38:19 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-9965fc49-1d27-4ae3-9681-0ce52d32c830 tempest-GroupsTest-513280878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (158902f7-5108-40c5-b6a5-9592cdf3b550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:38:19 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-9965fc49-1d27-4ae3-9681-0ce52d32c830 tempest-GroupsTest-513280878 None] Volume e29c9c73-1487-4283-bcfe-262949784b41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e29c9c73-1487-4283-bcfe-262949784b41', 'volume_size': 1} Sep 23 14:38:19 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-9965fc49-1d27-4ae3-9681-0ce52d32c830 tempest-GroupsTest-513280878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:38:19 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-9965fc49-1d27-4ae3-9681-0ce52d32c830 tempest-GroupsTest-513280878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:38:19 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-9965fc49-1d27-4ae3-9681-0ce52d32c830 tempest-GroupsTest-513280878 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=01d83cb6-528f-46a6-a213-f37605cb4f05,created_at=2026-09-23T12:38:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2052076910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=01d83cb6-528f-46a6-a213-f37605cb4f05,host='devstack@QuobyteHD#QuobyteHD',id=e29c9c73-1487-4283-bcfe-262949784b41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b10b3505b916486daf8831aa906c7be2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:38:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:38:20Z,use_quota=True,user_id='3130d2fbf9324ceaa7f0ca550570b0c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cbf86e0-fa95-44bf-b560-f92bbbd299a7),volume_type_id=0cbf86e0-fa95-44bf-b560-f92bbbd299a7)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:38:19 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-9965fc49-1d27-4ae3-9681-0ce52d32c830 tempest-GroupsTest-513280878 None] Creating volume e29c9c73-1487-4283-bcfe-262949784b41 {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:38:19 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-9965fc49-1d27-4ae3-9681-0ce52d32c830 tempest-GroupsTest-513280878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:38:19 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-9965fc49-1d27-4ae3-9681-0ce52d32c830 tempest-GroupsTest-513280878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:38:19 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-9965fc49-1d27-4ae3-9681-0ce52d32c830 tempest-GroupsTest-513280878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:38:19 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-9965fc49-1d27-4ae3-9681-0ce52d32c830 tempest-GroupsTest-513280878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:38:19 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-9965fc49-1d27-4ae3-9681-0ce52d32c830 tempest-GroupsTest-513280878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:38:19 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-9965fc49-1d27-4ae3-9681-0ce52d32c830 tempest-GroupsTest-513280878 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:38:19 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-9965fc49-1d27-4ae3-9681-0ce52d32c830 tempest-GroupsTest-513280878 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:38:19 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-9965fc49-1d27-4ae3-9681-0ce52d32c830 tempest-GroupsTest-513280878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e29c9c73-1487-4283-bcfe-262949784b41 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:38:19 devstack sudo[95451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e29c9c73-1487-4283-bcfe-262949784b41 1073741824 Sep 23 14:38:19 devstack sudo[95451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:38:20 devstack sudo[95451]: pam_unix(sudo:session): session closed for user root Sep 23 14:38:20 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-9965fc49-1d27-4ae3-9681-0ce52d32c830 tempest-GroupsTest-513280878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e29c9c73-1487-4283-bcfe-262949784b41 1073741824" returned: 0 in 0.552s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:38:20 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-9965fc49-1d27-4ae3-9681-0ce52d32c830 tempest-GroupsTest-513280878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e29c9c73-1487-4283-bcfe-262949784b41 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:38:20 devstack sudo[95457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e29c9c73-1487-4283-bcfe-262949784b41 Sep 23 14:38:20 devstack sudo[95457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:38:20 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-4ed08222-1648-47ab-8f93-1ad82a264e37 tempest-AbsoluteLimitsTests-1201601419 None] Acquiring lock "cinder-3c6ccee2-5b1c-47eb-9bab-56e9623dbdce-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:38:20 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-4ed08222-1648-47ab-8f93-1ad82a264e37 tempest-AbsoluteLimitsTests-1201601419 None] Lock "cinder-3c6ccee2-5b1c-47eb-9bab-56e9623dbdce-delete_volume" acquired by "delete_volume" :: waited 0.118s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:38:20 devstack sudo[95457]: pam_unix(sudo:session): session closed for user root Sep 23 14:38:20 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-9965fc49-1d27-4ae3-9681-0ce52d32c830 tempest-GroupsTest-513280878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e29c9c73-1487-4283-bcfe-262949784b41" returned: 0 in 0.292s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:38:20 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-9965fc49-1d27-4ae3-9681-0ce52d32c830 tempest-GroupsTest-513280878 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:38:20 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-9965fc49-1d27-4ae3-9681-0ce52d32c830 tempest-GroupsTest-513280878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:38:20 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-4ed08222-1648-47ab-8f93-1ad82a264e37 tempest-AbsoluteLimitsTests-1201601419 None] Acquiring lock "cinder-quobyte-3c6ccee2-5b1c-47eb-9bab-56e9623dbdce" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:38:20 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-9965fc49-1d27-4ae3-9681-0ce52d32c830 tempest-GroupsTest-513280878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (158902f7-5108-40c5-b6a5-9592cdf3b550) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e29c9c73-1487-4283-bcfe-262949784b41', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:38:20 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-9965fc49-1d27-4ae3-9681-0ce52d32c830 tempest-GroupsTest-513280878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ee2ff6b-2d3c-4923-980e-1dc2a664d1cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:38:20 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-4ed08222-1648-47ab-8f93-1ad82a264e37 tempest-AbsoluteLimitsTests-1201601419 None] Lock "cinder-quobyte-3c6ccee2-5b1c-47eb-9bab-56e9623dbdce" acquired by "delete_volume" :: waited 0.052s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:38:20 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-9965fc49-1d27-4ae3-9681-0ce52d32c830 tempest-GroupsTest-513280878 None] Volume volume-e29c9c73-1487-4283-bcfe-262949784b41 (e29c9c73-1487-4283-bcfe-262949784b41): created successfully Sep 23 14:38:20 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-9965fc49-1d27-4ae3-9681-0ce52d32c830 tempest-GroupsTest-513280878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ee2ff6b-2d3c-4923-980e-1dc2a664d1cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:38:20 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-9965fc49-1d27-4ae3-9681-0ce52d32c830 tempest-GroupsTest-513280878 None] Flow 'volume_create_manager' (ac429e35-364f-4529-be7b-663bf5c5c688) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:38:20 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[6acabf7b-6aab-4637-815a-58000b35db6e]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:38:20 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-4ed08222-1648-47ab-8f93-1ad82a264e37 tempest-AbsoluteLimitsTests-1201601419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-3c6ccee2-5b1c-47eb-9bab-56e9623dbdce {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:38:20 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-9965fc49-1d27-4ae3-9681-0ce52d32c830 tempest-GroupsTest-513280878 None] Created volume successfully. Sep 23 14:38:21 devstack sudo[95460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-3c6ccee2-5b1c-47eb-9bab-56e9623dbdce Sep 23 14:38:21 devstack sudo[95460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:38:21 devstack sudo[95460]: pam_unix(sudo:session): session closed for user root Sep 23 14:38:21 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-4ed08222-1648-47ab-8f93-1ad82a264e37 tempest-AbsoluteLimitsTests-1201601419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-3c6ccee2-5b1c-47eb-9bab-56e9623dbdce" returned: 0 in 0.476s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:38:21 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-4ed08222-1648-47ab-8f93-1ad82a264e37 tempest-AbsoluteLimitsTests-1201601419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-3c6ccee2-5b1c-47eb-9bab-56e9623dbdce {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:38:21 devstack sudo[95465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-3c6ccee2-5b1c-47eb-9bab-56e9623dbdce Sep 23 14:38:21 devstack sudo[95465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:38:21 devstack sudo[95465]: pam_unix(sudo:session): session closed for user root Sep 23 14:38:21 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-4ed08222-1648-47ab-8f93-1ad82a264e37 tempest-AbsoluteLimitsTests-1201601419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-3c6ccee2-5b1c-47eb-9bab-56e9623dbdce" returned: 0 in 0.310s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:38:21 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-4ed08222-1648-47ab-8f93-1ad82a264e37 tempest-AbsoluteLimitsTests-1201601419 None] Lock "cinder-quobyte-3c6ccee2-5b1c-47eb-9bab-56e9623dbdce" released by "delete_volume" :: held 0.848s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:38:21 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-4ed08222-1648-47ab-8f93-1ad82a264e37 tempest-AbsoluteLimitsTests-1201601419 None] Created reservations ['c7d239eb-e2b4-40fc-aaf5-ec9d11af947c', 'e935b402-59f1-411a-a9d6-421929829637', '3fad2697-a067-470d-9483-deb8b4f895f4', 'ed948eaa-0b14-4771-9aac-c578d9878ea0'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:38:21 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-4ed08222-1648-47ab-8f93-1ad82a264e37 tempest-AbsoluteLimitsTests-1201601419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:38:21 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-4ed08222-1648-47ab-8f93-1ad82a264e37 tempest-AbsoluteLimitsTests-1201601419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:38:21 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-4ed08222-1648-47ab-8f93-1ad82a264e37 tempest-AbsoluteLimitsTests-1201601419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:38:21 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-4ed08222-1648-47ab-8f93-1ad82a264e37 tempest-AbsoluteLimitsTests-1201601419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:38:21 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-4ed08222-1648-47ab-8f93-1ad82a264e37 tempest-AbsoluteLimitsTests-1201601419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:38:21 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-4ed08222-1648-47ab-8f93-1ad82a264e37 tempest-AbsoluteLimitsTests-1201601419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:38:21 devstack sudo[95469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:38:21 devstack sudo[95469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:38:22 devstack sudo[95469]: pam_unix(sudo:session): session closed for user root Sep 23 14:38:22 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-4ed08222-1648-47ab-8f93-1ad82a264e37 tempest-AbsoluteLimitsTests-1201601419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.331s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:38:22 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-4ed08222-1648-47ab-8f93-1ad82a264e37 tempest-AbsoluteLimitsTests-1201601419 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:38:22 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-4ed08222-1648-47ab-8f93-1ad82a264e37 tempest-AbsoluteLimitsTests-1201601419 None] Deleted volume successfully. Sep 23 14:38:22 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-4ed08222-1648-47ab-8f93-1ad82a264e37 tempest-AbsoluteLimitsTests-1201601419 None] Lock "cinder-3c6ccee2-5b1c-47eb-9bab-56e9623dbdce-delete_volume" released by "delete_volume" :: held 1.531s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:38:23 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-01c7d438-3e3a-40dc-b744-71bb5cd2e89d tempest-GroupsTest-513280878 None] Acquiring lock "cinder-quobyte-e29c9c73-1487-4283-bcfe-262949784b41" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:38:23 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-01c7d438-3e3a-40dc-b744-71bb5cd2e89d tempest-GroupsTest-513280878 None] Lock "cinder-quobyte-e29c9c73-1487-4283-bcfe-262949784b41" acquired by "delete_volume" :: waited 0.040s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:38:23 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[a74af01e-b888-47c9-9a8f-7945dfeb7445]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:38:23 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-01c7d438-3e3a-40dc-b744-71bb5cd2e89d tempest-GroupsTest-513280878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e29c9c73-1487-4283-bcfe-262949784b41 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:38:23 devstack sudo[95538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e29c9c73-1487-4283-bcfe-262949784b41 Sep 23 14:38:23 devstack sudo[95538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:38:23 devstack sudo[95538]: pam_unix(sudo:session): session closed for user root Sep 23 14:38:23 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-01c7d438-3e3a-40dc-b744-71bb5cd2e89d tempest-GroupsTest-513280878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e29c9c73-1487-4283-bcfe-262949784b41" returned: 0 in 0.513s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:38:23 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-01c7d438-3e3a-40dc-b744-71bb5cd2e89d tempest-GroupsTest-513280878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e29c9c73-1487-4283-bcfe-262949784b41 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:38:23 devstack sudo[95545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e29c9c73-1487-4283-bcfe-262949784b41 Sep 23 14:38:23 devstack sudo[95545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:38:24 devstack sudo[95545]: pam_unix(sudo:session): session closed for user root Sep 23 14:38:24 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-01c7d438-3e3a-40dc-b744-71bb5cd2e89d tempest-GroupsTest-513280878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e29c9c73-1487-4283-bcfe-262949784b41" returned: 0 in 0.325s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:38:24 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-01c7d438-3e3a-40dc-b744-71bb5cd2e89d tempest-GroupsTest-513280878 None] Lock "cinder-quobyte-e29c9c73-1487-4283-bcfe-262949784b41" released by "delete_volume" :: held 0.951s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:38:24 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-01c7d438-3e3a-40dc-b744-71bb5cd2e89d tempest-GroupsTest-513280878 None] Created reservations ['2c19e203-2c2f-4c75-999e-c334a21473c7'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:38:24 devstack cinder-volume[86310]: WARNING cinder.quota [None req-01c7d438-3e3a-40dc-b744-71bb5cd2e89d tempest-GroupsTest-513280878 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-310590304 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-310590304, it is now deprecated. Please use the default quota class for default quota. Sep 23 14:38:24 devstack cinder-volume[86310]: WARNING cinder.quota [None req-01c7d438-3e3a-40dc-b744-71bb5cd2e89d tempest-GroupsTest-513280878 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-310590304 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-310590304, it is now deprecated. Please use the default quota class for default quota. Sep 23 14:38:24 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-01c7d438-3e3a-40dc-b744-71bb5cd2e89d tempest-GroupsTest-513280878 None] Created reservations ['0d932f8f-d41a-47a7-994e-4db7df376eea', '1ff3f652-5606-427c-8e20-25a7fc734ea4', '2138dfee-6b01-4401-954c-1cb66f076695', '713b9695-7046-438a-9a5e-0930e287af79'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:38:24 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-01c7d438-3e3a-40dc-b744-71bb5cd2e89d tempest-GroupsTest-513280878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:38:24 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-01c7d438-3e3a-40dc-b744-71bb5cd2e89d tempest-GroupsTest-513280878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:38:24 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-01c7d438-3e3a-40dc-b744-71bb5cd2e89d tempest-GroupsTest-513280878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:38:24 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-01c7d438-3e3a-40dc-b744-71bb5cd2e89d tempest-GroupsTest-513280878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:38:24 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-01c7d438-3e3a-40dc-b744-71bb5cd2e89d tempest-GroupsTest-513280878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:38:24 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-01c7d438-3e3a-40dc-b744-71bb5cd2e89d tempest-GroupsTest-513280878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:38:24 devstack sudo[95549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:38:24 devstack sudo[95549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:38:25 devstack sudo[95549]: pam_unix(sudo:session): session closed for user root Sep 23 14:38:25 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-01c7d438-3e3a-40dc-b744-71bb5cd2e89d tempest-GroupsTest-513280878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.361s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:38:25 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-01c7d438-3e3a-40dc-b744-71bb5cd2e89d tempest-GroupsTest-513280878 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:38:25 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-01c7d438-3e3a-40dc-b744-71bb5cd2e89d tempest-GroupsTest-513280878 None] Delete group completed successfully. Sep 23 14:38:26 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-db2ce2fe-5e0a-44ad-9986-afb2cbe92d6f tempest-GroupsTest-513280878 None] Created reservations ['c3b2c6ca-b7c8-4a77-b576-45c379900692'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:38:26 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-db2ce2fe-5e0a-44ad-9986-afb2cbe92d6f tempest-GroupsTest-513280878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:38:26 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-db2ce2fe-5e0a-44ad-9986-afb2cbe92d6f tempest-GroupsTest-513280878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:38:26 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-db2ce2fe-5e0a-44ad-9986-afb2cbe92d6f tempest-GroupsTest-513280878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:38:26 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-db2ce2fe-5e0a-44ad-9986-afb2cbe92d6f tempest-GroupsTest-513280878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:38:26 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-db2ce2fe-5e0a-44ad-9986-afb2cbe92d6f tempest-GroupsTest-513280878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:38:26 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-db2ce2fe-5e0a-44ad-9986-afb2cbe92d6f tempest-GroupsTest-513280878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:38:26 devstack sudo[95552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:38:26 devstack sudo[95552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:38:26 devstack sudo[95552]: pam_unix(sudo:session): session closed for user root Sep 23 14:38:26 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-db2ce2fe-5e0a-44ad-9986-afb2cbe92d6f tempest-GroupsTest-513280878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.424s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:38:26 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-db2ce2fe-5e0a-44ad-9986-afb2cbe92d6f tempest-GroupsTest-513280878 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:38:26 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-db2ce2fe-5e0a-44ad-9986-afb2cbe92d6f tempest-GroupsTest-513280878 None] Delete group completed successfully. Sep 23 14:38:28 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-669d73a8-7d97-4ca5-b7e5-d6d5001fe3be tempest-GroupsTest-513280878 None] Group tempest-GroupsTest-Group-1674807184: creating Sep 23 14:38:28 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-669d73a8-7d97-4ca5-b7e5-d6d5001fe3be tempest-GroupsTest-513280878 None] Group tempest-GroupsTest-Group-1674807184: created successfully Sep 23 14:38:28 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-669d73a8-7d97-4ca5-b7e5-d6d5001fe3be tempest-GroupsTest-513280878 None] Create group completed successfully. Sep 23 14:38:30 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-388d70c4-e356-4902-8cae-a695c1846b3d tempest-GroupsTest-513280878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:38:30 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-388d70c4-e356-4902-8cae-a695c1846b3d tempest-GroupsTest-513280878 None] Flow 'volume_create_manager' (ee798e3a-7577-4547-a477-de3bf1d25ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:38:30 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-388d70c4-e356-4902-8cae-a695c1846b3d tempest-GroupsTest-513280878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18fd213d-2667-4aa3-986a-fc72ba0c251c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:38:30 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-388d70c4-e356-4902-8cae-a695c1846b3d tempest-GroupsTest-513280878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18fd213d-2667-4aa3-986a-fc72ba0c251c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:38:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-695680710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=76652462-ae3a-4e94-a18e-7b690cb6ad6c,host='devstack@QuobyteHD#QuobyteHD',id=63372592-2288-4298-9ad9-034b05108588,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b10b3505b916486daf8831aa906c7be2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:38:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:38:30Z,use_quota=True,user_id='3130d2fbf9324ceaa7f0ca550570b0c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24489338-cf2c-4cf5-92ef-9cae6add9fd2),volume_type_id=24489338-cf2c-4cf5-92ef-9cae6add9fd2)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:38:30 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-388d70c4-e356-4902-8cae-a695c1846b3d tempest-GroupsTest-513280878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (463770b7-e49e-44e8-82a3-333acf8101a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:38:30 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-388d70c4-e356-4902-8cae-a695c1846b3d tempest-GroupsTest-513280878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (463770b7-e49e-44e8-82a3-333acf8101a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:38:30 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-388d70c4-e356-4902-8cae-a695c1846b3d tempest-GroupsTest-513280878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb1f954f-e6f1-4d90-a34a-678ba9071b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:38:30 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-388d70c4-e356-4902-8cae-a695c1846b3d tempest-GroupsTest-513280878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb1f954f-e6f1-4d90-a34a-678ba9071b64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63372592-2288-4298-9ad9-034b05108588', 'volume_name': 'volume-63372592-2288-4298-9ad9-034b05108588', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:38:30 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-388d70c4-e356-4902-8cae-a695c1846b3d tempest-GroupsTest-513280878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bc39eb8-fb14-4723-b16b-c5eb44c08aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:38:30 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-388d70c4-e356-4902-8cae-a695c1846b3d tempest-GroupsTest-513280878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bc39eb8-fb14-4723-b16b-c5eb44c08aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:38:30 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-388d70c4-e356-4902-8cae-a695c1846b3d tempest-GroupsTest-513280878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85b808e4-87cf-4608-8078-732af7052d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:38:30 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-388d70c4-e356-4902-8cae-a695c1846b3d tempest-GroupsTest-513280878 None] Volume 63372592-2288-4298-9ad9-034b05108588: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63372592-2288-4298-9ad9-034b05108588', 'volume_size': 1} Sep 23 14:38:30 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-388d70c4-e356-4902-8cae-a695c1846b3d tempest-GroupsTest-513280878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:38:30 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-388d70c4-e356-4902-8cae-a695c1846b3d tempest-GroupsTest-513280878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:38:30 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-388d70c4-e356-4902-8cae-a695c1846b3d tempest-GroupsTest-513280878 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=76652462-ae3a-4e94-a18e-7b690cb6ad6c,created_at=2026-09-23T12:38:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-695680710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=76652462-ae3a-4e94-a18e-7b690cb6ad6c,host='devstack@QuobyteHD#QuobyteHD',id=63372592-2288-4298-9ad9-034b05108588,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b10b3505b916486daf8831aa906c7be2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:38:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:38:30Z,use_quota=True,user_id='3130d2fbf9324ceaa7f0ca550570b0c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24489338-cf2c-4cf5-92ef-9cae6add9fd2),volume_type_id=24489338-cf2c-4cf5-92ef-9cae6add9fd2)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:38:30 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-388d70c4-e356-4902-8cae-a695c1846b3d tempest-GroupsTest-513280878 None] Creating volume 63372592-2288-4298-9ad9-034b05108588 {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:38:30 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-388d70c4-e356-4902-8cae-a695c1846b3d tempest-GroupsTest-513280878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:38:30 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-388d70c4-e356-4902-8cae-a695c1846b3d tempest-GroupsTest-513280878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:38:30 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-388d70c4-e356-4902-8cae-a695c1846b3d tempest-GroupsTest-513280878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:38:30 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-388d70c4-e356-4902-8cae-a695c1846b3d tempest-GroupsTest-513280878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:38:30 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-388d70c4-e356-4902-8cae-a695c1846b3d tempest-GroupsTest-513280878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:38:30 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-388d70c4-e356-4902-8cae-a695c1846b3d tempest-GroupsTest-513280878 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:38:30 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-388d70c4-e356-4902-8cae-a695c1846b3d tempest-GroupsTest-513280878 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:38:30 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-388d70c4-e356-4902-8cae-a695c1846b3d tempest-GroupsTest-513280878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-63372592-2288-4298-9ad9-034b05108588 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:38:30 devstack sudo[95567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-63372592-2288-4298-9ad9-034b05108588 1073741824 Sep 23 14:38:30 devstack sudo[95567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:38:30 devstack sudo[95567]: pam_unix(sudo:session): session closed for user root Sep 23 14:38:30 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-388d70c4-e356-4902-8cae-a695c1846b3d tempest-GroupsTest-513280878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-63372592-2288-4298-9ad9-034b05108588 1073741824" returned: 0 in 0.620s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:38:30 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-388d70c4-e356-4902-8cae-a695c1846b3d tempest-GroupsTest-513280878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-63372592-2288-4298-9ad9-034b05108588 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:38:31 devstack sudo[95573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-63372592-2288-4298-9ad9-034b05108588 Sep 23 14:38:31 devstack sudo[95573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:38:31 devstack sudo[95573]: pam_unix(sudo:session): session closed for user root Sep 23 14:38:31 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-388d70c4-e356-4902-8cae-a695c1846b3d tempest-GroupsTest-513280878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-63372592-2288-4298-9ad9-034b05108588" returned: 0 in 0.405s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:38:31 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-388d70c4-e356-4902-8cae-a695c1846b3d tempest-GroupsTest-513280878 None] <== create_volume: return (1108ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:38:31 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-388d70c4-e356-4902-8cae-a695c1846b3d tempest-GroupsTest-513280878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.113s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:38:31 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-388d70c4-e356-4902-8cae-a695c1846b3d tempest-GroupsTest-513280878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85b808e4-87cf-4608-8078-732af7052d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63372592-2288-4298-9ad9-034b05108588', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:38:31 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-388d70c4-e356-4902-8cae-a695c1846b3d tempest-GroupsTest-513280878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84979fc0-1513-4002-83dd-32b99f8a3e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:38:31 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-388d70c4-e356-4902-8cae-a695c1846b3d tempest-GroupsTest-513280878 None] Volume volume-63372592-2288-4298-9ad9-034b05108588 (63372592-2288-4298-9ad9-034b05108588): created successfully Sep 23 14:38:31 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-388d70c4-e356-4902-8cae-a695c1846b3d tempest-GroupsTest-513280878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84979fc0-1513-4002-83dd-32b99f8a3e87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:38:31 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-388d70c4-e356-4902-8cae-a695c1846b3d tempest-GroupsTest-513280878 None] Flow 'volume_create_manager' (ee798e3a-7577-4547-a477-de3bf1d25ead) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:38:31 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-388d70c4-e356-4902-8cae-a695c1846b3d tempest-GroupsTest-513280878 None] Created volume successfully. Sep 23 14:38:32 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ec2c7b3-1017-441a-9d3d-1ad81e6abc64 tempest-GroupsTest-513280878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:38:32 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-0ec2c7b3-1017-441a-9d3d-1ad81e6abc64 tempest-GroupsTest-513280878 None] Flow 'volume_create_manager' (9d5accf0-0d6b-4d84-82f7-5085e838bab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:38:32 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-0ec2c7b3-1017-441a-9d3d-1ad81e6abc64 tempest-GroupsTest-513280878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bcd8d95-717a-46ac-90ec-7b6e27609939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:38:32 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-0ec2c7b3-1017-441a-9d3d-1ad81e6abc64 tempest-GroupsTest-513280878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bcd8d95-717a-46ac-90ec-7b6e27609939) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:38:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1055418381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=76652462-ae3a-4e94-a18e-7b690cb6ad6c,host='devstack@QuobyteHD#QuobyteHD',id=28be1055-9a34-4e48-8e22-9e6deca04c1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b10b3505b916486daf8831aa906c7be2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:38:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:38:33Z,use_quota=True,user_id='3130d2fbf9324ceaa7f0ca550570b0c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24489338-cf2c-4cf5-92ef-9cae6add9fd2),volume_type_id=24489338-cf2c-4cf5-92ef-9cae6add9fd2)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:38:32 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-0ec2c7b3-1017-441a-9d3d-1ad81e6abc64 tempest-GroupsTest-513280878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f41cdd3c-9af9-4e8f-8389-9cc2c3e0f553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:38:32 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-0ec2c7b3-1017-441a-9d3d-1ad81e6abc64 tempest-GroupsTest-513280878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f41cdd3c-9af9-4e8f-8389-9cc2c3e0f553) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:38:32 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-0ec2c7b3-1017-441a-9d3d-1ad81e6abc64 tempest-GroupsTest-513280878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (785f6975-e4fe-48fd-bf8e-0800cd36846e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:38:32 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-0ec2c7b3-1017-441a-9d3d-1ad81e6abc64 tempest-GroupsTest-513280878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (785f6975-e4fe-48fd-bf8e-0800cd36846e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28be1055-9a34-4e48-8e22-9e6deca04c1d', 'volume_name': 'volume-28be1055-9a34-4e48-8e22-9e6deca04c1d', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:38:32 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-0ec2c7b3-1017-441a-9d3d-1ad81e6abc64 tempest-GroupsTest-513280878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b141fada-a0e3-4acf-ac3e-fd22ea9087a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:38:32 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-0ec2c7b3-1017-441a-9d3d-1ad81e6abc64 tempest-GroupsTest-513280878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b141fada-a0e3-4acf-ac3e-fd22ea9087a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:38:32 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-0ec2c7b3-1017-441a-9d3d-1ad81e6abc64 tempest-GroupsTest-513280878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24ffb3b0-c9d4-4c36-bef6-be996f57dbaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:38:32 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-0ec2c7b3-1017-441a-9d3d-1ad81e6abc64 tempest-GroupsTest-513280878 None] Volume 28be1055-9a34-4e48-8e22-9e6deca04c1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28be1055-9a34-4e48-8e22-9e6deca04c1d', 'volume_size': 1} Sep 23 14:38:32 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-0ec2c7b3-1017-441a-9d3d-1ad81e6abc64 tempest-GroupsTest-513280878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:38:32 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-0ec2c7b3-1017-441a-9d3d-1ad81e6abc64 tempest-GroupsTest-513280878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:38:32 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-0ec2c7b3-1017-441a-9d3d-1ad81e6abc64 tempest-GroupsTest-513280878 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=76652462-ae3a-4e94-a18e-7b690cb6ad6c,created_at=2026-09-23T12:38:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1055418381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=76652462-ae3a-4e94-a18e-7b690cb6ad6c,host='devstack@QuobyteHD#QuobyteHD',id=28be1055-9a34-4e48-8e22-9e6deca04c1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b10b3505b916486daf8831aa906c7be2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:38:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:38:33Z,use_quota=True,user_id='3130d2fbf9324ceaa7f0ca550570b0c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24489338-cf2c-4cf5-92ef-9cae6add9fd2),volume_type_id=24489338-cf2c-4cf5-92ef-9cae6add9fd2)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:38:32 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-0ec2c7b3-1017-441a-9d3d-1ad81e6abc64 tempest-GroupsTest-513280878 None] Creating volume 28be1055-9a34-4e48-8e22-9e6deca04c1d {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:38:32 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-0ec2c7b3-1017-441a-9d3d-1ad81e6abc64 tempest-GroupsTest-513280878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:38:32 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-0ec2c7b3-1017-441a-9d3d-1ad81e6abc64 tempest-GroupsTest-513280878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:38:32 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-0ec2c7b3-1017-441a-9d3d-1ad81e6abc64 tempest-GroupsTest-513280878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:38:32 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-0ec2c7b3-1017-441a-9d3d-1ad81e6abc64 tempest-GroupsTest-513280878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:38:32 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-0ec2c7b3-1017-441a-9d3d-1ad81e6abc64 tempest-GroupsTest-513280878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:38:32 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-0ec2c7b3-1017-441a-9d3d-1ad81e6abc64 tempest-GroupsTest-513280878 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:38:32 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-0ec2c7b3-1017-441a-9d3d-1ad81e6abc64 tempest-GroupsTest-513280878 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:38:32 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-0ec2c7b3-1017-441a-9d3d-1ad81e6abc64 tempest-GroupsTest-513280878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-28be1055-9a34-4e48-8e22-9e6deca04c1d 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:38:32 devstack sudo[95577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-28be1055-9a34-4e48-8e22-9e6deca04c1d 1073741824 Sep 23 14:38:32 devstack sudo[95577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:38:33 devstack sudo[95577]: pam_unix(sudo:session): session closed for user root Sep 23 14:38:33 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-0ec2c7b3-1017-441a-9d3d-1ad81e6abc64 tempest-GroupsTest-513280878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-28be1055-9a34-4e48-8e22-9e6deca04c1d 1073741824" returned: 0 in 0.717s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:38:33 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-0ec2c7b3-1017-441a-9d3d-1ad81e6abc64 tempest-GroupsTest-513280878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-28be1055-9a34-4e48-8e22-9e6deca04c1d {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:38:33 devstack sudo[95592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-28be1055-9a34-4e48-8e22-9e6deca04c1d Sep 23 14:38:33 devstack sudo[95592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:38:34 devstack sudo[95592]: pam_unix(sudo:session): session closed for user root Sep 23 14:38:34 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-0ec2c7b3-1017-441a-9d3d-1ad81e6abc64 tempest-GroupsTest-513280878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-28be1055-9a34-4e48-8e22-9e6deca04c1d" returned: 0 in 0.413s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:38:34 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-0ec2c7b3-1017-441a-9d3d-1ad81e6abc64 tempest-GroupsTest-513280878 None] <== create_volume: return (1209ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:38:34 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-0ec2c7b3-1017-441a-9d3d-1ad81e6abc64 tempest-GroupsTest-513280878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.211s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:38:34 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-0ec2c7b3-1017-441a-9d3d-1ad81e6abc64 tempest-GroupsTest-513280878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24ffb3b0-c9d4-4c36-bef6-be996f57dbaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28be1055-9a34-4e48-8e22-9e6deca04c1d', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:38:34 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-0ec2c7b3-1017-441a-9d3d-1ad81e6abc64 tempest-GroupsTest-513280878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60be5d5d-9d4f-4fe1-9f58-7bd9cb7ed61b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:38:34 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-0ec2c7b3-1017-441a-9d3d-1ad81e6abc64 tempest-GroupsTest-513280878 None] Volume volume-28be1055-9a34-4e48-8e22-9e6deca04c1d (28be1055-9a34-4e48-8e22-9e6deca04c1d): created successfully Sep 23 14:38:34 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-0ec2c7b3-1017-441a-9d3d-1ad81e6abc64 tempest-GroupsTest-513280878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60be5d5d-9d4f-4fe1-9f58-7bd9cb7ed61b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:38:34 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-0ec2c7b3-1017-441a-9d3d-1ad81e6abc64 tempest-GroupsTest-513280878 None] Flow 'volume_create_manager' (9d5accf0-0d6b-4d84-82f7-5085e838bab2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:38:34 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-0ec2c7b3-1017-441a-9d3d-1ad81e6abc64 tempest-GroupsTest-513280878 None] Created volume successfully. Sep 23 14:38:35 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-6f441840-59a3-43d0-8ba4-ffc1f527faca tempest-GroupsTest-513280878 None] Update group completed successfully. Sep 23 14:38:37 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-e56478da-a55b-4ec9-92dd-c8398b91abb0 tempest-GroupsTest-513280878 None] Update group completed successfully. Sep 23 14:38:38 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-737edecb-1240-42ef-b6ff-d534391e38c1 tempest-GroupsTest-513280878 None] Acquiring lock "cinder-quobyte-28be1055-9a34-4e48-8e22-9e6deca04c1d" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:38:38 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-737edecb-1240-42ef-b6ff-d534391e38c1 tempest-GroupsTest-513280878 None] Lock "cinder-quobyte-28be1055-9a34-4e48-8e22-9e6deca04c1d" acquired by "delete_volume" :: waited 0.022s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:38:38 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[44dd44c1-628f-43e0-b12d-d6a7405ac146]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:38:38 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-737edecb-1240-42ef-b6ff-d534391e38c1 tempest-GroupsTest-513280878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-28be1055-9a34-4e48-8e22-9e6deca04c1d {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:38:39 devstack sudo[95613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-28be1055-9a34-4e48-8e22-9e6deca04c1d Sep 23 14:38:39 devstack sudo[95613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:38:39 devstack sudo[95613]: pam_unix(sudo:session): session closed for user root Sep 23 14:38:39 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-737edecb-1240-42ef-b6ff-d534391e38c1 tempest-GroupsTest-513280878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-28be1055-9a34-4e48-8e22-9e6deca04c1d" returned: 0 in 0.406s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:38:39 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-737edecb-1240-42ef-b6ff-d534391e38c1 tempest-GroupsTest-513280878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-28be1055-9a34-4e48-8e22-9e6deca04c1d {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:38:39 devstack sudo[95618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-28be1055-9a34-4e48-8e22-9e6deca04c1d Sep 23 14:38:39 devstack sudo[95618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:38:39 devstack sudo[95618]: pam_unix(sudo:session): session closed for user root Sep 23 14:38:39 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-737edecb-1240-42ef-b6ff-d534391e38c1 tempest-GroupsTest-513280878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-28be1055-9a34-4e48-8e22-9e6deca04c1d" returned: 0 in 0.391s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:38:39 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-737edecb-1240-42ef-b6ff-d534391e38c1 tempest-GroupsTest-513280878 None] Lock "cinder-quobyte-28be1055-9a34-4e48-8e22-9e6deca04c1d" released by "delete_volume" :: held 0.865s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:38:39 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-737edecb-1240-42ef-b6ff-d534391e38c1 tempest-GroupsTest-513280878 None] Acquiring lock "cinder-quobyte-63372592-2288-4298-9ad9-034b05108588" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:38:39 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-737edecb-1240-42ef-b6ff-d534391e38c1 tempest-GroupsTest-513280878 None] Lock "cinder-quobyte-63372592-2288-4298-9ad9-034b05108588" acquired by "delete_volume" :: waited 0.024s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:38:39 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[0934e7fb-2bf8-4ea8-bbd0-5ea65c2c76b8]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:38:39 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-737edecb-1240-42ef-b6ff-d534391e38c1 tempest-GroupsTest-513280878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-63372592-2288-4298-9ad9-034b05108588 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:38:39 devstack sudo[95621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-63372592-2288-4298-9ad9-034b05108588 Sep 23 14:38:39 devstack sudo[95621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:38:40 devstack sudo[95621]: pam_unix(sudo:session): session closed for user root Sep 23 14:38:40 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-737edecb-1240-42ef-b6ff-d534391e38c1 tempest-GroupsTest-513280878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-63372592-2288-4298-9ad9-034b05108588" returned: 0 in 0.460s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:38:40 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-737edecb-1240-42ef-b6ff-d534391e38c1 tempest-GroupsTest-513280878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-63372592-2288-4298-9ad9-034b05108588 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:38:40 devstack sudo[95626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-63372592-2288-4298-9ad9-034b05108588 Sep 23 14:38:40 devstack sudo[95626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:38:40 devstack sudo[95626]: pam_unix(sudo:session): session closed for user root Sep 23 14:38:40 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-737edecb-1240-42ef-b6ff-d534391e38c1 tempest-GroupsTest-513280878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-63372592-2288-4298-9ad9-034b05108588" returned: 0 in 0.366s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:38:40 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-737edecb-1240-42ef-b6ff-d534391e38c1 tempest-GroupsTest-513280878 None] Lock "cinder-quobyte-63372592-2288-4298-9ad9-034b05108588" released by "delete_volume" :: held 0.884s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:38:40 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-737edecb-1240-42ef-b6ff-d534391e38c1 tempest-GroupsTest-513280878 None] Created reservations ['9d066d40-5050-4e73-b185-71c92c291baf'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:38:40 devstack cinder-volume[86310]: WARNING cinder.quota [None req-737edecb-1240-42ef-b6ff-d534391e38c1 tempest-GroupsTest-513280878 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1857116932 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1857116932, it is now deprecated. Please use the default quota class for default quota. Sep 23 14:38:40 devstack cinder-volume[86310]: WARNING cinder.quota [None req-737edecb-1240-42ef-b6ff-d534391e38c1 tempest-GroupsTest-513280878 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1857116932 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1857116932, it is now deprecated. Please use the default quota class for default quota. Sep 23 14:38:40 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-737edecb-1240-42ef-b6ff-d534391e38c1 tempest-GroupsTest-513280878 None] Created reservations ['45856fea-115f-453b-a2d4-78730f292f8c', '994d6db9-72ae-4a72-9316-0e586d690f13', '5f903fff-a481-42bc-9423-0aaa50da1f1b', '455f6ce1-d271-42c9-955a-3df000ad2854'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:38:40 devstack cinder-volume[86310]: DEBUG dbcounter [-] [86310] Writing DB stats cinder:SELECT=112,cinder:INSERT=37,cinder:UPDATE=107,cinder:DELETE=4 {{(pid=86310) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 14:38:40 devstack cinder-volume[86310]: DEBUG dbcounter [-] [86310] Writing DB stats cinder:SELECT=106,cinder:UPDATE=117,cinder:INSERT=25,cinder:DELETE=8 {{(pid=86310) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 14:38:41 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-737edecb-1240-42ef-b6ff-d534391e38c1 tempest-GroupsTest-513280878 None] Created reservations ['f15d48f4-34a8-4873-b386-f94ae4004f64', '3044a967-7709-4dbd-b2c6-4447383a69ea', 'a27747be-efff-45bf-8b00-18b190e26611', '8f61164d-ace8-4f79-8a31-a0280fa3a2f1'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:38:41 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-737edecb-1240-42ef-b6ff-d534391e38c1 tempest-GroupsTest-513280878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:38:41 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-737edecb-1240-42ef-b6ff-d534391e38c1 tempest-GroupsTest-513280878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:38:41 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-737edecb-1240-42ef-b6ff-d534391e38c1 tempest-GroupsTest-513280878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:38:41 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-737edecb-1240-42ef-b6ff-d534391e38c1 tempest-GroupsTest-513280878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:38:41 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-737edecb-1240-42ef-b6ff-d534391e38c1 tempest-GroupsTest-513280878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:38:41 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-737edecb-1240-42ef-b6ff-d534391e38c1 tempest-GroupsTest-513280878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:38:41 devstack sudo[95629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:38:41 devstack sudo[95629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:38:41 devstack sudo[95629]: pam_unix(sudo:session): session closed for user root Sep 23 14:38:41 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-737edecb-1240-42ef-b6ff-d534391e38c1 tempest-GroupsTest-513280878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.323s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:38:41 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-737edecb-1240-42ef-b6ff-d534391e38c1 tempest-GroupsTest-513280878 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:38:41 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-737edecb-1240-42ef-b6ff-d534391e38c1 tempest-GroupsTest-513280878 None] Delete group completed successfully. Sep 23 14:38:51 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7016b23-14da-4878-8ba0-8915a55a0767 tempest-AttachVolumeTestJSON-760750814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:38:51 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-e7016b23-14da-4878-8ba0-8915a55a0767 tempest-AttachVolumeTestJSON-760750814 None] Flow 'volume_create_manager' (967910cf-3a08-476f-9497-fdf011477496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:38:51 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-e7016b23-14da-4878-8ba0-8915a55a0767 tempest-AttachVolumeTestJSON-760750814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aced1bf7-abba-414a-b611-2ebb6fae277e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:38:51 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-e7016b23-14da-4878-8ba0-8915a55a0767 tempest-AttachVolumeTestJSON-760750814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aced1bf7-abba-414a-b611-2ebb6fae277e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:38:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-14888098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f636362-e6ea-471d-866f-dac50aefb9d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='296c240cb76d4b8883f8994e35b4ce87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:38:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:38:51Z,use_quota=True,user_id='dd9cafb3b16d490d97bb60aee7723a4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:38:51 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-e7016b23-14da-4878-8ba0-8915a55a0767 tempest-AttachVolumeTestJSON-760750814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75656c6c-789a-4229-90ac-4fe9e1455555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:38:51 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-e7016b23-14da-4878-8ba0-8915a55a0767 tempest-AttachVolumeTestJSON-760750814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75656c6c-789a-4229-90ac-4fe9e1455555) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:38:51 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-e7016b23-14da-4878-8ba0-8915a55a0767 tempest-AttachVolumeTestJSON-760750814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0323f47f-418d-4eca-bb28-a1297a844815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:38:51 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-e7016b23-14da-4878-8ba0-8915a55a0767 tempest-AttachVolumeTestJSON-760750814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0323f47f-418d-4eca-bb28-a1297a844815) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f636362-e6ea-471d-866f-dac50aefb9d5', 'volume_name': 'volume-1f636362-e6ea-471d-866f-dac50aefb9d5', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:38:51 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-e7016b23-14da-4878-8ba0-8915a55a0767 tempest-AttachVolumeTestJSON-760750814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ef23806-9efb-437e-a10c-4f6f85fa5831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:38:51 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-e7016b23-14da-4878-8ba0-8915a55a0767 tempest-AttachVolumeTestJSON-760750814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ef23806-9efb-437e-a10c-4f6f85fa5831) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:38:51 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-e7016b23-14da-4878-8ba0-8915a55a0767 tempest-AttachVolumeTestJSON-760750814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aae5d3ad-a7f9-49b1-9bbf-646706c44d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:38:51 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-e7016b23-14da-4878-8ba0-8915a55a0767 tempest-AttachVolumeTestJSON-760750814 None] Volume 1f636362-e6ea-471d-866f-dac50aefb9d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f636362-e6ea-471d-866f-dac50aefb9d5', 'volume_size': 1} Sep 23 14:38:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-e7016b23-14da-4878-8ba0-8915a55a0767 tempest-AttachVolumeTestJSON-760750814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:38:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-e7016b23-14da-4878-8ba0-8915a55a0767 tempest-AttachVolumeTestJSON-760750814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:38:51 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-e7016b23-14da-4878-8ba0-8915a55a0767 tempest-AttachVolumeTestJSON-760750814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:38:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-14888098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f636362-e6ea-471d-866f-dac50aefb9d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='296c240cb76d4b8883f8994e35b4ce87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:38:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:38:51Z,use_quota=True,user_id='dd9cafb3b16d490d97bb60aee7723a4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:38:51 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-e7016b23-14da-4878-8ba0-8915a55a0767 tempest-AttachVolumeTestJSON-760750814 None] Creating volume 1f636362-e6ea-471d-866f-dac50aefb9d5 {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:38:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-e7016b23-14da-4878-8ba0-8915a55a0767 tempest-AttachVolumeTestJSON-760750814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:38:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-e7016b23-14da-4878-8ba0-8915a55a0767 tempest-AttachVolumeTestJSON-760750814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:38:51 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-e7016b23-14da-4878-8ba0-8915a55a0767 tempest-AttachVolumeTestJSON-760750814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:38:51 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-e7016b23-14da-4878-8ba0-8915a55a0767 tempest-AttachVolumeTestJSON-760750814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:38:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-e7016b23-14da-4878-8ba0-8915a55a0767 tempest-AttachVolumeTestJSON-760750814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:38:51 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-e7016b23-14da-4878-8ba0-8915a55a0767 tempest-AttachVolumeTestJSON-760750814 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:38:51 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-e7016b23-14da-4878-8ba0-8915a55a0767 tempest-AttachVolumeTestJSON-760750814 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:38:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-e7016b23-14da-4878-8ba0-8915a55a0767 tempest-AttachVolumeTestJSON-760750814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-1f636362-e6ea-471d-866f-dac50aefb9d5 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:38:51 devstack sudo[95651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-1f636362-e6ea-471d-866f-dac50aefb9d5 1073741824 Sep 23 14:38:51 devstack sudo[95651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:38:51 devstack cinder-volume[86310]: DEBUG oslo_service.periodic_task [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86310) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 14:38:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:38:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:38:51 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:38:51 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:38:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:38:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:38:51 devstack sudo[95656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:38:51 devstack sudo[95656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:38:51 devstack sudo[95656]: pam_unix(sudo:session): session closed for user root Sep 23 14:38:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.548s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:38:51 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:38:51 devstack cinder-volume[86310]: DEBUG oslo_service.periodic_task [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Running periodic task VolumeManager._thread_info {{(pid=86310) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 14:38:51 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] thread count: 28 {{(pid=86310) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 14:38:51 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] thread info: [<_MainThread(MainThread, started 128854208852096)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86310) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 14:38:52 devstack sudo[95651]: pam_unix(sudo:session): session closed for user root Sep 23 14:38:52 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-e7016b23-14da-4878-8ba0-8915a55a0767 tempest-AttachVolumeTestJSON-760750814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-1f636362-e6ea-471d-866f-dac50aefb9d5 1073741824" returned: 0 in 0.761s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:38:52 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-e7016b23-14da-4878-8ba0-8915a55a0767 tempest-AttachVolumeTestJSON-760750814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-1f636362-e6ea-471d-866f-dac50aefb9d5 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:38:52 devstack sudo[95666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-1f636362-e6ea-471d-866f-dac50aefb9d5 Sep 23 14:38:52 devstack sudo[95666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:38:52 devstack sudo[95666]: pam_unix(sudo:session): session closed for user root Sep 23 14:38:52 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-9304356f-d448-4105-8165-08c8c7eded6b tempest-VolumesActionsTest-1930790160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:38:52 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-9304356f-d448-4105-8165-08c8c7eded6b tempest-VolumesActionsTest-1930790160 None] Flow 'volume_create_manager' (3f70a56b-eee6-490c-82ba-6b02b0753212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:38:52 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-9304356f-d448-4105-8165-08c8c7eded6b tempest-VolumesActionsTest-1930790160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bb366af-a1cd-4fdc-a7ad-35e6a8a56704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:38:52 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-e7016b23-14da-4878-8ba0-8915a55a0767 tempest-AttachVolumeTestJSON-760750814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-1f636362-e6ea-471d-866f-dac50aefb9d5" returned: 0 in 0.415s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:38:52 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-e7016b23-14da-4878-8ba0-8915a55a0767 tempest-AttachVolumeTestJSON-760750814 None] <== create_volume: return (1263ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:38:52 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-e7016b23-14da-4878-8ba0-8915a55a0767 tempest-AttachVolumeTestJSON-760750814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.266s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:38:52 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-9304356f-d448-4105-8165-08c8c7eded6b tempest-VolumesActionsTest-1930790160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bb366af-a1cd-4fdc-a7ad-35e6a8a56704) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:38:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-831588979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91658ecc-b212-4cec-ab79-495726afbe66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2188f69d8d7415b8106ff08ee2de563',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:38:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:38:52Z,use_quota=True,user_id='cbdce58f537d4cd6a7e16fceced4e30c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:38:52 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-9304356f-d448-4105-8165-08c8c7eded6b tempest-VolumesActionsTest-1930790160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a48efbfe-18c1-417f-9b5c-97db610cbdde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:38:52 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-9304356f-d448-4105-8165-08c8c7eded6b tempest-VolumesActionsTest-1930790160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a48efbfe-18c1-417f-9b5c-97db610cbdde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:38:52 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-9304356f-d448-4105-8165-08c8c7eded6b tempest-VolumesActionsTest-1930790160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fe72691-549a-4d22-a583-4d5a8ecb36b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:38:52 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-9304356f-d448-4105-8165-08c8c7eded6b tempest-VolumesActionsTest-1930790160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fe72691-549a-4d22-a583-4d5a8ecb36b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91658ecc-b212-4cec-ab79-495726afbe66', 'volume_name': 'volume-91658ecc-b212-4cec-ab79-495726afbe66', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:38:52 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-9304356f-d448-4105-8165-08c8c7eded6b tempest-VolumesActionsTest-1930790160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4243769e-5f69-4020-a507-1532473be2ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:38:52 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-9304356f-d448-4105-8165-08c8c7eded6b tempest-VolumesActionsTest-1930790160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4243769e-5f69-4020-a507-1532473be2ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:38:52 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-9304356f-d448-4105-8165-08c8c7eded6b tempest-VolumesActionsTest-1930790160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a80985a0-d19c-4a8f-b8af-16c2338f7618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:38:52 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-9304356f-d448-4105-8165-08c8c7eded6b tempest-VolumesActionsTest-1930790160 None] Volume 91658ecc-b212-4cec-ab79-495726afbe66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91658ecc-b212-4cec-ab79-495726afbe66', 'volume_size': 1} Sep 23 14:38:52 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-9304356f-d448-4105-8165-08c8c7eded6b tempest-VolumesActionsTest-1930790160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:38:52 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-9304356f-d448-4105-8165-08c8c7eded6b tempest-VolumesActionsTest-1930790160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:38:52 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-9304356f-d448-4105-8165-08c8c7eded6b tempest-VolumesActionsTest-1930790160 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:38:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-831588979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91658ecc-b212-4cec-ab79-495726afbe66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2188f69d8d7415b8106ff08ee2de563',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:38:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:38:52Z,use_quota=True,user_id='cbdce58f537d4cd6a7e16fceced4e30c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:38:52 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-9304356f-d448-4105-8165-08c8c7eded6b tempest-VolumesActionsTest-1930790160 None] Creating volume 91658ecc-b212-4cec-ab79-495726afbe66 {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:38:52 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-9304356f-d448-4105-8165-08c8c7eded6b tempest-VolumesActionsTest-1930790160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:38:52 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-9304356f-d448-4105-8165-08c8c7eded6b tempest-VolumesActionsTest-1930790160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:38:52 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-9304356f-d448-4105-8165-08c8c7eded6b tempest-VolumesActionsTest-1930790160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:38:52 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-9304356f-d448-4105-8165-08c8c7eded6b tempest-VolumesActionsTest-1930790160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:38:52 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-9304356f-d448-4105-8165-08c8c7eded6b tempest-VolumesActionsTest-1930790160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:38:52 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-9304356f-d448-4105-8165-08c8c7eded6b tempest-VolumesActionsTest-1930790160 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:38:52 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-9304356f-d448-4105-8165-08c8c7eded6b tempest-VolumesActionsTest-1930790160 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:38:52 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-9304356f-d448-4105-8165-08c8c7eded6b tempest-VolumesActionsTest-1930790160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-91658ecc-b212-4cec-ab79-495726afbe66 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:38:52 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-e7016b23-14da-4878-8ba0-8915a55a0767 tempest-AttachVolumeTestJSON-760750814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aae5d3ad-a7f9-49b1-9bbf-646706c44d9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f636362-e6ea-471d-866f-dac50aefb9d5', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:38:52 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-e7016b23-14da-4878-8ba0-8915a55a0767 tempest-AttachVolumeTestJSON-760750814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d38b3f6-8dfd-4d9e-935f-3431029edba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:38:52 devstack sudo[95669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-91658ecc-b212-4cec-ab79-495726afbe66 1073741824 Sep 23 14:38:52 devstack sudo[95669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:38:52 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-e7016b23-14da-4878-8ba0-8915a55a0767 tempest-AttachVolumeTestJSON-760750814 None] Volume volume-1f636362-e6ea-471d-866f-dac50aefb9d5 (1f636362-e6ea-471d-866f-dac50aefb9d5): created successfully Sep 23 14:38:52 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-e7016b23-14da-4878-8ba0-8915a55a0767 tempest-AttachVolumeTestJSON-760750814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d38b3f6-8dfd-4d9e-935f-3431029edba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:38:52 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-e7016b23-14da-4878-8ba0-8915a55a0767 tempest-AttachVolumeTestJSON-760750814 None] Flow 'volume_create_manager' (967910cf-3a08-476f-9497-fdf011477496) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:38:52 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-e7016b23-14da-4878-8ba0-8915a55a0767 tempest-AttachVolumeTestJSON-760750814 None] Created volume successfully. Sep 23 14:38:53 devstack sudo[95669]: pam_unix(sudo:session): session closed for user root Sep 23 14:38:53 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-9304356f-d448-4105-8165-08c8c7eded6b tempest-VolumesActionsTest-1930790160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-91658ecc-b212-4cec-ab79-495726afbe66 1073741824" returned: 0 in 0.597s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:38:53 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-9304356f-d448-4105-8165-08c8c7eded6b tempest-VolumesActionsTest-1930790160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-91658ecc-b212-4cec-ab79-495726afbe66 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:38:53 devstack sudo[95675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-91658ecc-b212-4cec-ab79-495726afbe66 Sep 23 14:38:53 devstack sudo[95675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:38:53 devstack sudo[95675]: pam_unix(sudo:session): session closed for user root Sep 23 14:38:53 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-9304356f-d448-4105-8165-08c8c7eded6b tempest-VolumesActionsTest-1930790160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-91658ecc-b212-4cec-ab79-495726afbe66" returned: 0 in 0.416s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:38:53 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-9304356f-d448-4105-8165-08c8c7eded6b tempest-VolumesActionsTest-1930790160 None] <== create_volume: return (1074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:38:53 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-9304356f-d448-4105-8165-08c8c7eded6b tempest-VolumesActionsTest-1930790160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.080s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:38:53 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-9304356f-d448-4105-8165-08c8c7eded6b tempest-VolumesActionsTest-1930790160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a80985a0-d19c-4a8f-b8af-16c2338f7618) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91658ecc-b212-4cec-ab79-495726afbe66', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:38:53 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-9304356f-d448-4105-8165-08c8c7eded6b tempest-VolumesActionsTest-1930790160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fccedc1b-9411-4431-86b9-4dce560357b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:38:53 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-9304356f-d448-4105-8165-08c8c7eded6b tempest-VolumesActionsTest-1930790160 None] Volume volume-91658ecc-b212-4cec-ab79-495726afbe66 (91658ecc-b212-4cec-ab79-495726afbe66): created successfully Sep 23 14:38:53 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-9304356f-d448-4105-8165-08c8c7eded6b tempest-VolumesActionsTest-1930790160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fccedc1b-9411-4431-86b9-4dce560357b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:38:53 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-9304356f-d448-4105-8165-08c8c7eded6b tempest-VolumesActionsTest-1930790160 None] Flow 'volume_create_manager' (3f70a56b-eee6-490c-82ba-6b02b0753212) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:38:53 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-9304356f-d448-4105-8165-08c8c7eded6b tempest-VolumesActionsTest-1930790160 None] Created volume successfully. Sep 23 14:38:54 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [req-bf937e92-3b8a-4dd8-83cb-d445d4d3954a req-137373ef-eb65-48f4-82ec-4b825e9aec5d tempest-AttachVolumeTestJSON-760750814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:38:54 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [req-bf937e92-3b8a-4dd8-83cb-d445d4d3954a req-137373ef-eb65-48f4-82ec-4b825e9aec5d tempest-AttachVolumeTestJSON-760750814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:38:54 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [req-bf937e92-3b8a-4dd8-83cb-d445d4d3954a req-137373ef-eb65-48f4-82ec-4b825e9aec5d tempest-AttachVolumeTestJSON-760750814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.036s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:38:54 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [req-bf937e92-3b8a-4dd8-83cb-d445d4d3954a req-137373ef-eb65-48f4-82ec-4b825e9aec5d tempest-AttachVolumeTestJSON-760750814 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362', 'name': 'volume-1f636362-e6ea-471d-866f-dac50aefb9d5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '68c4a609-b93c-4e21-9f8a-6870ed37ce8d', 'enforce_multipath': True} {{(pid=86310) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 14:38:54 devstack cinder-volume[86310]: INFO cinder.volume.manager [req-bf937e92-3b8a-4dd8-83cb-d445d4d3954a req-137373ef-eb65-48f4-82ec-4b825e9aec5d tempest-AttachVolumeTestJSON-760750814 None] attachment_update completed successfully. Sep 23 14:38:57 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f7e3c26-ea14-4fc9-acf9-66bdcdb14385 tempest-AttachVolumeTestJSON-760750814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:38:57 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-7f7e3c26-ea14-4fc9-acf9-66bdcdb14385 tempest-AttachVolumeTestJSON-760750814 None] Flow 'volume_create_manager' (4c4ecfae-2a27-4fa2-8319-b8fa6f80e43b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:38:57 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-7f7e3c26-ea14-4fc9-acf9-66bdcdb14385 tempest-AttachVolumeTestJSON-760750814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4de20999-2cd1-4c66-94e6-c3f998c59230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:38:57 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-7f7e3c26-ea14-4fc9-acf9-66bdcdb14385 tempest-AttachVolumeTestJSON-760750814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4de20999-2cd1-4c66-94e6-c3f998c59230) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:38:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1966126841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=744f00f6-61de-48a4-94bb-c022ff7a6ebc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='296c240cb76d4b8883f8994e35b4ce87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:38:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:38:57Z,use_quota=True,user_id='dd9cafb3b16d490d97bb60aee7723a4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:38:57 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-7f7e3c26-ea14-4fc9-acf9-66bdcdb14385 tempest-AttachVolumeTestJSON-760750814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c7ad840-4bc0-4a50-96c7-a6ab78af0198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:38:57 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-7f7e3c26-ea14-4fc9-acf9-66bdcdb14385 tempest-AttachVolumeTestJSON-760750814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c7ad840-4bc0-4a50-96c7-a6ab78af0198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:38:57 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-7f7e3c26-ea14-4fc9-acf9-66bdcdb14385 tempest-AttachVolumeTestJSON-760750814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d9a8fad-8a40-4268-8c17-40f7531f1245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:38:57 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-7f7e3c26-ea14-4fc9-acf9-66bdcdb14385 tempest-AttachVolumeTestJSON-760750814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d9a8fad-8a40-4268-8c17-40f7531f1245) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '744f00f6-61de-48a4-94bb-c022ff7a6ebc', 'volume_name': 'volume-744f00f6-61de-48a4-94bb-c022ff7a6ebc', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:38:57 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-7f7e3c26-ea14-4fc9-acf9-66bdcdb14385 tempest-AttachVolumeTestJSON-760750814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ce03ea3-ed54-45bb-ad06-2d8b3a938cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:38:57 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-7f7e3c26-ea14-4fc9-acf9-66bdcdb14385 tempest-AttachVolumeTestJSON-760750814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ce03ea3-ed54-45bb-ad06-2d8b3a938cd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:38:57 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-7f7e3c26-ea14-4fc9-acf9-66bdcdb14385 tempest-AttachVolumeTestJSON-760750814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dbe590f-7d85-4a51-aac3-860e3a8354d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:38:57 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-7f7e3c26-ea14-4fc9-acf9-66bdcdb14385 tempest-AttachVolumeTestJSON-760750814 None] Volume 744f00f6-61de-48a4-94bb-c022ff7a6ebc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-744f00f6-61de-48a4-94bb-c022ff7a6ebc', 'volume_size': 1} Sep 23 14:38:57 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-7f7e3c26-ea14-4fc9-acf9-66bdcdb14385 tempest-AttachVolumeTestJSON-760750814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:38:57 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-7f7e3c26-ea14-4fc9-acf9-66bdcdb14385 tempest-AttachVolumeTestJSON-760750814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:38:57 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-7f7e3c26-ea14-4fc9-acf9-66bdcdb14385 tempest-AttachVolumeTestJSON-760750814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:38:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1966126841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=744f00f6-61de-48a4-94bb-c022ff7a6ebc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='296c240cb76d4b8883f8994e35b4ce87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:38:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:38:57Z,use_quota=True,user_id='dd9cafb3b16d490d97bb60aee7723a4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:38:57 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-7f7e3c26-ea14-4fc9-acf9-66bdcdb14385 tempest-AttachVolumeTestJSON-760750814 None] Creating volume 744f00f6-61de-48a4-94bb-c022ff7a6ebc {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:38:57 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-7f7e3c26-ea14-4fc9-acf9-66bdcdb14385 tempest-AttachVolumeTestJSON-760750814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:38:57 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-7f7e3c26-ea14-4fc9-acf9-66bdcdb14385 tempest-AttachVolumeTestJSON-760750814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:38:57 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-7f7e3c26-ea14-4fc9-acf9-66bdcdb14385 tempest-AttachVolumeTestJSON-760750814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:38:57 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-7f7e3c26-ea14-4fc9-acf9-66bdcdb14385 tempest-AttachVolumeTestJSON-760750814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:38:57 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-7f7e3c26-ea14-4fc9-acf9-66bdcdb14385 tempest-AttachVolumeTestJSON-760750814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:38:57 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-7f7e3c26-ea14-4fc9-acf9-66bdcdb14385 tempest-AttachVolumeTestJSON-760750814 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:38:57 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-7f7e3c26-ea14-4fc9-acf9-66bdcdb14385 tempest-AttachVolumeTestJSON-760750814 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:38:57 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-7f7e3c26-ea14-4fc9-acf9-66bdcdb14385 tempest-AttachVolumeTestJSON-760750814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-744f00f6-61de-48a4-94bb-c022ff7a6ebc 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:38:57 devstack sudo[96173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-744f00f6-61de-48a4-94bb-c022ff7a6ebc 1073741824 Sep 23 14:38:57 devstack sudo[96173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:38:58 devstack sudo[96173]: pam_unix(sudo:session): session closed for user root Sep 23 14:38:58 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-7f7e3c26-ea14-4fc9-acf9-66bdcdb14385 tempest-AttachVolumeTestJSON-760750814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-744f00f6-61de-48a4-94bb-c022ff7a6ebc 1073741824" returned: 0 in 0.872s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:38:58 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-7f7e3c26-ea14-4fc9-acf9-66bdcdb14385 tempest-AttachVolumeTestJSON-760750814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-744f00f6-61de-48a4-94bb-c022ff7a6ebc {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:38:58 devstack sudo[96179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-744f00f6-61de-48a4-94bb-c022ff7a6ebc Sep 23 14:38:58 devstack sudo[96179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:38:59 devstack sudo[96179]: pam_unix(sudo:session): session closed for user root Sep 23 14:38:59 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-7f7e3c26-ea14-4fc9-acf9-66bdcdb14385 tempest-AttachVolumeTestJSON-760750814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-744f00f6-61de-48a4-94bb-c022ff7a6ebc" returned: 0 in 0.584s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:38:59 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-7f7e3c26-ea14-4fc9-acf9-66bdcdb14385 tempest-AttachVolumeTestJSON-760750814 None] <== create_volume: return (1562ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:38:59 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-7f7e3c26-ea14-4fc9-acf9-66bdcdb14385 tempest-AttachVolumeTestJSON-760750814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.568s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:38:59 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-7f7e3c26-ea14-4fc9-acf9-66bdcdb14385 tempest-AttachVolumeTestJSON-760750814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dbe590f-7d85-4a51-aac3-860e3a8354d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-744f00f6-61de-48a4-94bb-c022ff7a6ebc', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:38:59 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-7f7e3c26-ea14-4fc9-acf9-66bdcdb14385 tempest-AttachVolumeTestJSON-760750814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92cf2913-4596-48c3-873e-0ce58733373f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:38:59 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-7f7e3c26-ea14-4fc9-acf9-66bdcdb14385 tempest-AttachVolumeTestJSON-760750814 None] Volume volume-744f00f6-61de-48a4-94bb-c022ff7a6ebc (744f00f6-61de-48a4-94bb-c022ff7a6ebc): created successfully Sep 23 14:38:59 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-7f7e3c26-ea14-4fc9-acf9-66bdcdb14385 tempest-AttachVolumeTestJSON-760750814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92cf2913-4596-48c3-873e-0ce58733373f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:38:59 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-7f7e3c26-ea14-4fc9-acf9-66bdcdb14385 tempest-AttachVolumeTestJSON-760750814 None] Flow 'volume_create_manager' (4c4ecfae-2a27-4fa2-8319-b8fa6f80e43b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:38:59 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-7f7e3c26-ea14-4fc9-acf9-66bdcdb14385 tempest-AttachVolumeTestJSON-760750814 None] Created volume successfully. Sep 23 14:38:59 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-67c29e12-6956-4b71-9716-b28913366d5c tempest-VolumesActionsTest-190168521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:38:59 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-67c29e12-6956-4b71-9716-b28913366d5c tempest-VolumesActionsTest-190168521 None] Flow 'volume_create_manager' (21fa278b-0492-4f7b-9f77-2ad918ecf219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:38:59 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-67c29e12-6956-4b71-9716-b28913366d5c tempest-VolumesActionsTest-190168521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27c45f27-ecab-4114-8682-904574f65859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:39:00 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-67c29e12-6956-4b71-9716-b28913366d5c tempest-VolumesActionsTest-190168521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27c45f27-ecab-4114-8682-904574f65859) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:38:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-326174175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c588efb9-1826-4a59-94db-50519c6a496d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4885c86c91f4245bdc43ff368fc3b8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:39:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:39:00Z,use_quota=True,user_id='fa72e470c3174d72aad0add017605822',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:39:00 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-67c29e12-6956-4b71-9716-b28913366d5c tempest-VolumesActionsTest-190168521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (742a310d-7f7c-40a0-8d94-296d0ba3913e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:39:00 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-67c29e12-6956-4b71-9716-b28913366d5c tempest-VolumesActionsTest-190168521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (742a310d-7f7c-40a0-8d94-296d0ba3913e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:39:00 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-67c29e12-6956-4b71-9716-b28913366d5c tempest-VolumesActionsTest-190168521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93c4177b-659e-48a9-9d84-b0a7aa8ff77e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:39:00 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-67c29e12-6956-4b71-9716-b28913366d5c tempest-VolumesActionsTest-190168521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93c4177b-659e-48a9-9d84-b0a7aa8ff77e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c588efb9-1826-4a59-94db-50519c6a496d', 'volume_name': 'volume-c588efb9-1826-4a59-94db-50519c6a496d', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:39:00 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-67c29e12-6956-4b71-9716-b28913366d5c tempest-VolumesActionsTest-190168521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53670a57-cffd-4be2-b28f-fb20ea7045e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:39:00 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-67c29e12-6956-4b71-9716-b28913366d5c tempest-VolumesActionsTest-190168521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53670a57-cffd-4be2-b28f-fb20ea7045e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:39:00 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-67c29e12-6956-4b71-9716-b28913366d5c tempest-VolumesActionsTest-190168521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb84ae23-f7ce-4dac-b3b2-767534afb827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:39:00 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-67c29e12-6956-4b71-9716-b28913366d5c tempest-VolumesActionsTest-190168521 None] Volume c588efb9-1826-4a59-94db-50519c6a496d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c588efb9-1826-4a59-94db-50519c6a496d', 'volume_size': 1} Sep 23 14:39:00 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-67c29e12-6956-4b71-9716-b28913366d5c tempest-VolumesActionsTest-190168521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:39:00 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-67c29e12-6956-4b71-9716-b28913366d5c tempest-VolumesActionsTest-190168521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:39:00 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-67c29e12-6956-4b71-9716-b28913366d5c tempest-VolumesActionsTest-190168521 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:38:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-326174175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c588efb9-1826-4a59-94db-50519c6a496d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4885c86c91f4245bdc43ff368fc3b8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:39:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:39:00Z,use_quota=True,user_id='fa72e470c3174d72aad0add017605822',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:39:00 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-67c29e12-6956-4b71-9716-b28913366d5c tempest-VolumesActionsTest-190168521 None] Creating volume c588efb9-1826-4a59-94db-50519c6a496d {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:39:00 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-67c29e12-6956-4b71-9716-b28913366d5c tempest-VolumesActionsTest-190168521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:39:00 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-67c29e12-6956-4b71-9716-b28913366d5c tempest-VolumesActionsTest-190168521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:39:00 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-67c29e12-6956-4b71-9716-b28913366d5c tempest-VolumesActionsTest-190168521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:39:00 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-67c29e12-6956-4b71-9716-b28913366d5c tempest-VolumesActionsTest-190168521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:39:00 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-67c29e12-6956-4b71-9716-b28913366d5c tempest-VolumesActionsTest-190168521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:39:00 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-67c29e12-6956-4b71-9716-b28913366d5c tempest-VolumesActionsTest-190168521 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:39:00 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-67c29e12-6956-4b71-9716-b28913366d5c tempest-VolumesActionsTest-190168521 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:39:00 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-67c29e12-6956-4b71-9716-b28913366d5c tempest-VolumesActionsTest-190168521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-c588efb9-1826-4a59-94db-50519c6a496d 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:39:00 devstack sudo[96192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-c588efb9-1826-4a59-94db-50519c6a496d 1073741824 Sep 23 14:39:00 devstack sudo[96192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:39:01 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [req-7cc20a08-6bda-467d-8caa-0d0c6dc262a6 req-83e6ef6f-0540-4088-9aa1-67dc1912865f tempest-AttachVolumeTestJSON-760750814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:39:01 devstack sudo[96192]: pam_unix(sudo:session): session closed for user root Sep 23 14:39:01 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-67c29e12-6956-4b71-9716-b28913366d5c tempest-VolumesActionsTest-190168521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-c588efb9-1826-4a59-94db-50519c6a496d 1073741824" returned: 0 in 1.227s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:39:01 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-67c29e12-6956-4b71-9716-b28913366d5c tempest-VolumesActionsTest-190168521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-c588efb9-1826-4a59-94db-50519c6a496d {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:39:01 devstack sudo[96215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-c588efb9-1826-4a59-94db-50519c6a496d Sep 23 14:39:01 devstack sudo[96215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:39:01 devstack sudo[96215]: pam_unix(sudo:session): session closed for user root Sep 23 14:39:01 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-67c29e12-6956-4b71-9716-b28913366d5c tempest-VolumesActionsTest-190168521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-c588efb9-1826-4a59-94db-50519c6a496d" returned: 0 in 0.382s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:39:01 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-67c29e12-6956-4b71-9716-b28913366d5c tempest-VolumesActionsTest-190168521 None] <== create_volume: return (1682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:39:01 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-67c29e12-6956-4b71-9716-b28913366d5c tempest-VolumesActionsTest-190168521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.685s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:39:01 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [req-7cc20a08-6bda-467d-8caa-0d0c6dc262a6 req-83e6ef6f-0540-4088-9aa1-67dc1912865f tempest-AttachVolumeTestJSON-760750814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.583s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:39:01 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-67c29e12-6956-4b71-9716-b28913366d5c tempest-VolumesActionsTest-190168521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb84ae23-f7ce-4dac-b3b2-767534afb827) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c588efb9-1826-4a59-94db-50519c6a496d', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:39:01 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-67c29e12-6956-4b71-9716-b28913366d5c tempest-VolumesActionsTest-190168521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e14fa725-8a80-4531-8130-4abc2e424672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:39:01 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [req-7cc20a08-6bda-467d-8caa-0d0c6dc262a6 req-83e6ef6f-0540-4088-9aa1-67dc1912865f tempest-AttachVolumeTestJSON-760750814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.089s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:39:01 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-67c29e12-6956-4b71-9716-b28913366d5c tempest-VolumesActionsTest-190168521 None] Volume volume-c588efb9-1826-4a59-94db-50519c6a496d (c588efb9-1826-4a59-94db-50519c6a496d): created successfully Sep 23 14:39:01 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-67c29e12-6956-4b71-9716-b28913366d5c tempest-VolumesActionsTest-190168521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e14fa725-8a80-4531-8130-4abc2e424672) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:39:01 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-67c29e12-6956-4b71-9716-b28913366d5c tempest-VolumesActionsTest-190168521 None] Flow 'volume_create_manager' (21fa278b-0492-4f7b-9f77-2ad918ecf219) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:39:01 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-67c29e12-6956-4b71-9716-b28913366d5c tempest-VolumesActionsTest-190168521 None] Created volume successfully. Sep 23 14:39:01 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [req-7cc20a08-6bda-467d-8caa-0d0c6dc262a6 req-83e6ef6f-0540-4088-9aa1-67dc1912865f tempest-AttachVolumeTestJSON-760750814 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362', 'name': 'volume-744f00f6-61de-48a4-94bb-c022ff7a6ebc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3ec60935-41ad-43b0-81f8-02b3db41bacb', 'enforce_multipath': True} {{(pid=86310) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 14:39:02 devstack cinder-volume[86310]: INFO cinder.volume.manager [req-7cc20a08-6bda-467d-8caa-0d0c6dc262a6 req-83e6ef6f-0540-4088-9aa1-67dc1912865f tempest-AttachVolumeTestJSON-760750814 None] attachment_update completed successfully. Sep 23 14:39:03 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-9625b791-9000-4dc0-ab5d-98f2a52ea2e0 tempest-VolumesActionsTest-190168521 None] Acquiring lock "cinder-c588efb9-1826-4a59-94db-50519c6a496d" by "attach_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:39:03 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-9625b791-9000-4dc0-ab5d-98f2a52ea2e0 tempest-VolumesActionsTest-190168521 None] Lock "cinder-c588efb9-1826-4a59-94db-50519c6a496d" acquired by "attach_volume" :: waited 0.032s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:39:03 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-9625b791-9000-4dc0-ab5d-98f2a52ea2e0 tempest-VolumesActionsTest-190168521 None] Attaching volume c588efb9-1826-4a59-94db-50519c6a496d to instance 4f956f16-6631-49c9-8296-06bba5434f46 at mountpoint /dev/vdb on host None. Sep 23 14:39:03 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-9625b791-9000-4dc0-ab5d-98f2a52ea2e0 tempest-VolumesActionsTest-190168521 None] Attach volume completed successfully. Sep 23 14:39:03 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-9625b791-9000-4dc0-ab5d-98f2a52ea2e0 tempest-VolumesActionsTest-190168521 None] Lock "cinder-c588efb9-1826-4a59-94db-50519c6a496d" released by "attach_volume" :: held 0.194s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:39:05 devstack cinder-volume[86310]: INFO cinder.volume.manager [req-a221fc64-ca19-4599-892e-b418841762a4 req-e68a46fc-7a3a-45bb-80b6-9a22fdd86ded tempest-AttachVolumeTestJSON-760750814 None] Terminate volume connection completed successfully. Sep 23 14:39:05 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [req-a221fc64-ca19-4599-892e-b418841762a4 req-e68a46fc-7a3a-45bb-80b6-9a22fdd86ded tempest-AttachVolumeTestJSON-760750814 None] Deleting attachment 68c4a609-b93c-4e21-9f8a-6870ed37ce8d. {{(pid=86310) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 14:39:05 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-75600b35-be4d-4d30-8daf-d1f299ad88f8 tempest-VolumesActionsTest-987278039 None] Terminate volume connection completed successfully. Sep 23 14:39:05 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-75600b35-be4d-4d30-8daf-d1f299ad88f8 tempest-VolumesActionsTest-987278039 None] Acquiring lock "cinder-c588efb9-1826-4a59-94db-50519c6a496d-detach_volume" by "detach_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:39:05 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-75600b35-be4d-4d30-8daf-d1f299ad88f8 tempest-VolumesActionsTest-987278039 None] Lock "cinder-c588efb9-1826-4a59-94db-50519c6a496d-detach_volume" acquired by "detach_volume" :: waited 0.065s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:39:05 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-75600b35-be4d-4d30-8daf-d1f299ad88f8 tempest-VolumesActionsTest-987278039 None] Detaching volume c588efb9-1826-4a59-94db-50519c6a496d from instance 4f956f16-6631-49c9-8296-06bba5434f46. Sep 23 14:39:06 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-75600b35-be4d-4d30-8daf-d1f299ad88f8 tempest-VolumesActionsTest-987278039 None] Detach volume completed successfully. Sep 23 14:39:06 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-75600b35-be4d-4d30-8daf-d1f299ad88f8 tempest-VolumesActionsTest-987278039 None] Lock "cinder-c588efb9-1826-4a59-94db-50519c6a496d-detach_volume" released by "detach_volume" :: held 0.279s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:39:06 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-94d09df3-0821-4bb3-bca3-5fefa308106d tempest-VolumesActionsTest-190168521 None] Acquiring lock "cinder-c588efb9-1826-4a59-94db-50519c6a496d-detach_volume" by "detach_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:39:06 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-94d09df3-0821-4bb3-bca3-5fefa308106d tempest-VolumesActionsTest-190168521 None] Lock "cinder-c588efb9-1826-4a59-94db-50519c6a496d-detach_volume" acquired by "detach_volume" :: waited 0.086s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:39:06 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-94d09df3-0821-4bb3-bca3-5fefa308106d tempest-VolumesActionsTest-190168521 None] Volume detach called, but volume not attached. Sep 23 14:39:06 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-94d09df3-0821-4bb3-bca3-5fefa308106d tempest-VolumesActionsTest-190168521 None] Lock "cinder-c588efb9-1826-4a59-94db-50519c6a496d-detach_volume" released by "detach_volume" :: held 0.079s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:39:07 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-2ad9f9e0-d6c1-4c7f-8be9-ee1ffc00e6c0 tempest-VolumesActionsTest-190168521 None] Acquiring lock "cinder-c588efb9-1826-4a59-94db-50519c6a496d-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:39:07 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-2ad9f9e0-d6c1-4c7f-8be9-ee1ffc00e6c0 tempest-VolumesActionsTest-190168521 None] Lock "cinder-c588efb9-1826-4a59-94db-50519c6a496d-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:39:07 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-2ad9f9e0-d6c1-4c7f-8be9-ee1ffc00e6c0 tempest-VolumesActionsTest-190168521 None] Acquiring lock "cinder-quobyte-c588efb9-1826-4a59-94db-50519c6a496d" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:39:07 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-2ad9f9e0-d6c1-4c7f-8be9-ee1ffc00e6c0 tempest-VolumesActionsTest-190168521 None] Lock "cinder-quobyte-c588efb9-1826-4a59-94db-50519c6a496d" acquired by "delete_volume" :: waited 0.049s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:39:07 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[92cdb3dd-e61f-444d-a1d5-ff198d80ba31]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:39:07 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-2ad9f9e0-d6c1-4c7f-8be9-ee1ffc00e6c0 tempest-VolumesActionsTest-190168521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-c588efb9-1826-4a59-94db-50519c6a496d {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:39:07 devstack cinder-volume[86310]: INFO cinder.volume.manager [req-e72cb4e7-d6b3-4263-9bb1-5b42959d3ca4 req-80e73f16-3fa1-4211-a5a9-195b97e41380 tempest-AttachVolumeTestJSON-760750814 None] Terminate volume connection completed successfully. Sep 23 14:39:07 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [req-e72cb4e7-d6b3-4263-9bb1-5b42959d3ca4 req-80e73f16-3fa1-4211-a5a9-195b97e41380 tempest-AttachVolumeTestJSON-760750814 None] Deleting attachment 3ec60935-41ad-43b0-81f8-02b3db41bacb. {{(pid=86310) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 14:39:07 devstack sudo[96297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-c588efb9-1826-4a59-94db-50519c6a496d Sep 23 14:39:07 devstack sudo[96297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:39:08 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-9ae3f183-8ff8-4433-8396-ece2099bcaf2 tempest-VolumesActionsTest-1930790160 None] Acquiring lock "cinder-91658ecc-b212-4cec-ab79-495726afbe66" by "attach_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:39:08 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-9ae3f183-8ff8-4433-8396-ece2099bcaf2 tempest-VolumesActionsTest-1930790160 None] Lock "cinder-91658ecc-b212-4cec-ab79-495726afbe66" acquired by "attach_volume" :: waited 0.053s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:39:08 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-9ae3f183-8ff8-4433-8396-ece2099bcaf2 tempest-VolumesActionsTest-1930790160 None] Attaching volume 91658ecc-b212-4cec-ab79-495726afbe66 to instance ca20a77a-770e-487d-b430-c6f516104070 at mountpoint /dev/vdb on host None. Sep 23 14:39:08 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-9ae3f183-8ff8-4433-8396-ece2099bcaf2 tempest-VolumesActionsTest-1930790160 None] Attach volume completed successfully. Sep 23 14:39:08 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-9ae3f183-8ff8-4433-8396-ece2099bcaf2 tempest-VolumesActionsTest-1930790160 None] Lock "cinder-91658ecc-b212-4cec-ab79-495726afbe66" released by "attach_volume" :: held 0.168s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:39:08 devstack sudo[96297]: pam_unix(sudo:session): session closed for user root Sep 23 14:39:08 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-2ad9f9e0-d6c1-4c7f-8be9-ee1ffc00e6c0 tempest-VolumesActionsTest-190168521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-c588efb9-1826-4a59-94db-50519c6a496d" returned: 0 in 1.411s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:39:09 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-2ad9f9e0-d6c1-4c7f-8be9-ee1ffc00e6c0 tempest-VolumesActionsTest-190168521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-c588efb9-1826-4a59-94db-50519c6a496d {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:39:09 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-de1612b1-6c67-45e3-a9dc-f3782b532a81 tempest-VolumesActionsTest-1930790160 None] Acquiring lock "cinder-91658ecc-b212-4cec-ab79-495726afbe66-detach_volume" by "detach_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:39:09 devstack sudo[96329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-c588efb9-1826-4a59-94db-50519c6a496d Sep 23 14:39:09 devstack sudo[96329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:39:09 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-de1612b1-6c67-45e3-a9dc-f3782b532a81 tempest-VolumesActionsTest-1930790160 None] Lock "cinder-91658ecc-b212-4cec-ab79-495726afbe66-detach_volume" acquired by "detach_volume" :: waited 0.042s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:39:09 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-de1612b1-6c67-45e3-a9dc-f3782b532a81 tempest-VolumesActionsTest-1930790160 None] Detaching volume 91658ecc-b212-4cec-ab79-495726afbe66 from instance ca20a77a-770e-487d-b430-c6f516104070. Sep 23 14:39:09 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-de1612b1-6c67-45e3-a9dc-f3782b532a81 tempest-VolumesActionsTest-1930790160 None] Detach volume completed successfully. Sep 23 14:39:09 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-de1612b1-6c67-45e3-a9dc-f3782b532a81 tempest-VolumesActionsTest-1930790160 None] Lock "cinder-91658ecc-b212-4cec-ab79-495726afbe66-detach_volume" released by "detach_volume" :: held 0.078s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:39:09 devstack sudo[96329]: pam_unix(sudo:session): session closed for user root Sep 23 14:39:10 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-2ad9f9e0-d6c1-4c7f-8be9-ee1ffc00e6c0 tempest-VolumesActionsTest-190168521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-c588efb9-1826-4a59-94db-50519c6a496d" returned: 0 in 1.004s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:39:10 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-2ad9f9e0-d6c1-4c7f-8be9-ee1ffc00e6c0 tempest-VolumesActionsTest-190168521 None] Lock "cinder-quobyte-c588efb9-1826-4a59-94db-50519c6a496d" released by "delete_volume" :: held 2.540s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:39:10 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-2ad9f9e0-d6c1-4c7f-8be9-ee1ffc00e6c0 tempest-VolumesActionsTest-190168521 None] Created reservations ['d9c77b10-b93c-40ca-9f4d-4aac7cbb8da9', '9b681f5b-129b-47a9-a1f3-0733c0d5b4ea', 'd36baaca-f51e-465f-9f2d-eb47af9b6121', '2b9bbd37-9812-4aca-9192-f1712d06c0a3'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:39:10 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-2ad9f9e0-d6c1-4c7f-8be9-ee1ffc00e6c0 tempest-VolumesActionsTest-190168521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:39:10 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-2ad9f9e0-d6c1-4c7f-8be9-ee1ffc00e6c0 tempest-VolumesActionsTest-190168521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:39:10 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-2ad9f9e0-d6c1-4c7f-8be9-ee1ffc00e6c0 tempest-VolumesActionsTest-190168521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:39:10 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-2ad9f9e0-d6c1-4c7f-8be9-ee1ffc00e6c0 tempest-VolumesActionsTest-190168521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:39:10 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-2ad9f9e0-d6c1-4c7f-8be9-ee1ffc00e6c0 tempest-VolumesActionsTest-190168521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.075s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:39:10 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-2ad9f9e0-d6c1-4c7f-8be9-ee1ffc00e6c0 tempest-VolumesActionsTest-190168521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:39:10 devstack sudo[96351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:39:10 devstack sudo[96351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:39:11 devstack sudo[96351]: pam_unix(sudo:session): session closed for user root Sep 23 14:39:11 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-2ad9f9e0-d6c1-4c7f-8be9-ee1ffc00e6c0 tempest-VolumesActionsTest-190168521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.889s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:39:11 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-2ad9f9e0-d6c1-4c7f-8be9-ee1ffc00e6c0 tempest-VolumesActionsTest-190168521 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:39:11 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-2ad9f9e0-d6c1-4c7f-8be9-ee1ffc00e6c0 tempest-VolumesActionsTest-190168521 None] Deleted volume successfully. Sep 23 14:39:11 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-2ad9f9e0-d6c1-4c7f-8be9-ee1ffc00e6c0 tempest-VolumesActionsTest-190168521 None] Lock "cinder-c588efb9-1826-4a59-94db-50519c6a496d-delete_volume" released by "delete_volume" :: held 4.153s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:39:16 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0b6c8df-ba7f-4798-86bf-32223af95b80 tempest-VolumesActionsTest-190168521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:39:16 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-f0b6c8df-ba7f-4798-86bf-32223af95b80 tempest-VolumesActionsTest-190168521 None] Flow 'volume_create_manager' (ef40081a-9de7-4d92-a544-558f8f95de18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:39:16 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-f0b6c8df-ba7f-4798-86bf-32223af95b80 tempest-VolumesActionsTest-190168521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edaa2afd-4b89-4154-b8b0-9812eb9a5423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:39:16 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-f0b6c8df-ba7f-4798-86bf-32223af95b80 tempest-VolumesActionsTest-190168521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edaa2afd-4b89-4154-b8b0-9812eb9a5423) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:39:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1609559594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1247d7cc-c0c0-4dd7-8014-432707bca70c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4885c86c91f4245bdc43ff368fc3b8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:39:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:39:16Z,use_quota=True,user_id='fa72e470c3174d72aad0add017605822',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:39:16 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-f0b6c8df-ba7f-4798-86bf-32223af95b80 tempest-VolumesActionsTest-190168521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8db21e8-b608-4b89-a065-6d58df75f75d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:39:16 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-f0b6c8df-ba7f-4798-86bf-32223af95b80 tempest-VolumesActionsTest-190168521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8db21e8-b608-4b89-a065-6d58df75f75d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:39:16 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-f0b6c8df-ba7f-4798-86bf-32223af95b80 tempest-VolumesActionsTest-190168521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8c74c77-f28c-41c4-8ca8-7618ff446dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:39:16 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-f0b6c8df-ba7f-4798-86bf-32223af95b80 tempest-VolumesActionsTest-190168521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8c74c77-f28c-41c4-8ca8-7618ff446dd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1247d7cc-c0c0-4dd7-8014-432707bca70c', 'volume_name': 'volume-1247d7cc-c0c0-4dd7-8014-432707bca70c', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:39:16 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-f0b6c8df-ba7f-4798-86bf-32223af95b80 tempest-VolumesActionsTest-190168521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69681c1a-635f-4336-958a-65fc1672800c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:39:16 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-f0b6c8df-ba7f-4798-86bf-32223af95b80 tempest-VolumesActionsTest-190168521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69681c1a-635f-4336-958a-65fc1672800c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:39:16 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-f0b6c8df-ba7f-4798-86bf-32223af95b80 tempest-VolumesActionsTest-190168521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4a3056b-d23e-41f1-b413-a8ab1dafce44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:39:16 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-f0b6c8df-ba7f-4798-86bf-32223af95b80 tempest-VolumesActionsTest-190168521 None] Volume 1247d7cc-c0c0-4dd7-8014-432707bca70c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1247d7cc-c0c0-4dd7-8014-432707bca70c', 'volume_size': 1} Sep 23 14:39:16 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-f0b6c8df-ba7f-4798-86bf-32223af95b80 tempest-VolumesActionsTest-190168521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:39:16 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-f0b6c8df-ba7f-4798-86bf-32223af95b80 tempest-VolumesActionsTest-190168521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:39:16 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-f0b6c8df-ba7f-4798-86bf-32223af95b80 tempest-VolumesActionsTest-190168521 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:39:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1609559594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1247d7cc-c0c0-4dd7-8014-432707bca70c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4885c86c91f4245bdc43ff368fc3b8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:39:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:39:16Z,use_quota=True,user_id='fa72e470c3174d72aad0add017605822',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:39:16 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-f0b6c8df-ba7f-4798-86bf-32223af95b80 tempest-VolumesActionsTest-190168521 None] Creating volume 1247d7cc-c0c0-4dd7-8014-432707bca70c {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:39:16 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-f0b6c8df-ba7f-4798-86bf-32223af95b80 tempest-VolumesActionsTest-190168521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:39:16 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-f0b6c8df-ba7f-4798-86bf-32223af95b80 tempest-VolumesActionsTest-190168521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:39:16 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-f0b6c8df-ba7f-4798-86bf-32223af95b80 tempest-VolumesActionsTest-190168521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:39:16 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-f0b6c8df-ba7f-4798-86bf-32223af95b80 tempest-VolumesActionsTest-190168521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:39:16 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-f0b6c8df-ba7f-4798-86bf-32223af95b80 tempest-VolumesActionsTest-190168521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:39:16 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-f0b6c8df-ba7f-4798-86bf-32223af95b80 tempest-VolumesActionsTest-190168521 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:39:16 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-f0b6c8df-ba7f-4798-86bf-32223af95b80 tempest-VolumesActionsTest-190168521 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:39:16 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-f0b6c8df-ba7f-4798-86bf-32223af95b80 tempest-VolumesActionsTest-190168521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-1247d7cc-c0c0-4dd7-8014-432707bca70c 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:39:16 devstack sudo[96405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-1247d7cc-c0c0-4dd7-8014-432707bca70c 1073741824 Sep 23 14:39:16 devstack sudo[96405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:39:16 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-39a56368-2a10-4ebb-93f8-ebc336f24f7b tempest-AttachVolumeTestJSON-760750814 None] Acquiring lock "cinder-744f00f6-61de-48a4-94bb-c022ff7a6ebc-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:39:16 devstack sudo[96405]: pam_unix(sudo:session): session closed for user root Sep 23 14:39:16 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-f0b6c8df-ba7f-4798-86bf-32223af95b80 tempest-VolumesActionsTest-190168521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-1247d7cc-c0c0-4dd7-8014-432707bca70c 1073741824" returned: 0 in 0.677s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:39:16 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-39a56368-2a10-4ebb-93f8-ebc336f24f7b tempest-AttachVolumeTestJSON-760750814 None] Lock "cinder-744f00f6-61de-48a4-94bb-c022ff7a6ebc-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:39:16 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-f0b6c8df-ba7f-4798-86bf-32223af95b80 tempest-VolumesActionsTest-190168521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-1247d7cc-c0c0-4dd7-8014-432707bca70c {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:39:16 devstack sudo[96411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-1247d7cc-c0c0-4dd7-8014-432707bca70c Sep 23 14:39:16 devstack sudo[96411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:39:16 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-39a56368-2a10-4ebb-93f8-ebc336f24f7b tempest-AttachVolumeTestJSON-760750814 None] Acquiring lock "cinder-quobyte-744f00f6-61de-48a4-94bb-c022ff7a6ebc" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:39:16 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-39a56368-2a10-4ebb-93f8-ebc336f24f7b tempest-AttachVolumeTestJSON-760750814 None] Lock "cinder-quobyte-744f00f6-61de-48a4-94bb-c022ff7a6ebc" acquired by "delete_volume" :: waited 0.020s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:39:16 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[50b20e6a-e483-476d-ace2-d387d2caa4a7]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:39:16 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-39a56368-2a10-4ebb-93f8-ebc336f24f7b tempest-AttachVolumeTestJSON-760750814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-744f00f6-61de-48a4-94bb-c022ff7a6ebc {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:39:17 devstack sudo[96413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-744f00f6-61de-48a4-94bb-c022ff7a6ebc Sep 23 14:39:17 devstack sudo[96413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:39:17 devstack sudo[96411]: pam_unix(sudo:session): session closed for user root Sep 23 14:39:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-f0b6c8df-ba7f-4798-86bf-32223af95b80 tempest-VolumesActionsTest-190168521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-1247d7cc-c0c0-4dd7-8014-432707bca70c" returned: 0 in 0.337s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:39:17 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-f0b6c8df-ba7f-4798-86bf-32223af95b80 tempest-VolumesActionsTest-190168521 None] <== create_volume: return (1090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:39:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-f0b6c8df-ba7f-4798-86bf-32223af95b80 tempest-VolumesActionsTest-190168521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.092s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:39:17 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-f0b6c8df-ba7f-4798-86bf-32223af95b80 tempest-VolumesActionsTest-190168521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4a3056b-d23e-41f1-b413-a8ab1dafce44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1247d7cc-c0c0-4dd7-8014-432707bca70c', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:39:17 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-f0b6c8df-ba7f-4798-86bf-32223af95b80 tempest-VolumesActionsTest-190168521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2764ceef-6430-4cc8-b619-030a23e281ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:39:17 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-f0b6c8df-ba7f-4798-86bf-32223af95b80 tempest-VolumesActionsTest-190168521 None] Volume volume-1247d7cc-c0c0-4dd7-8014-432707bca70c (1247d7cc-c0c0-4dd7-8014-432707bca70c): created successfully Sep 23 14:39:17 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-f0b6c8df-ba7f-4798-86bf-32223af95b80 tempest-VolumesActionsTest-190168521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2764ceef-6430-4cc8-b619-030a23e281ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:39:17 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-f0b6c8df-ba7f-4798-86bf-32223af95b80 tempest-VolumesActionsTest-190168521 None] Flow 'volume_create_manager' (ef40081a-9de7-4d92-a544-558f8f95de18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:39:17 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-f0b6c8df-ba7f-4798-86bf-32223af95b80 tempest-VolumesActionsTest-190168521 None] Created volume successfully. Sep 23 14:39:17 devstack sudo[96413]: pam_unix(sudo:session): session closed for user root Sep 23 14:39:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-39a56368-2a10-4ebb-93f8-ebc336f24f7b tempest-AttachVolumeTestJSON-760750814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-744f00f6-61de-48a4-94bb-c022ff7a6ebc" returned: 0 in 0.526s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:39:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-39a56368-2a10-4ebb-93f8-ebc336f24f7b tempest-AttachVolumeTestJSON-760750814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-744f00f6-61de-48a4-94bb-c022ff7a6ebc {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:39:17 devstack sudo[96448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-744f00f6-61de-48a4-94bb-c022ff7a6ebc Sep 23 14:39:17 devstack sudo[96448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:39:17 devstack sudo[96448]: pam_unix(sudo:session): session closed for user root Sep 23 14:39:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-39a56368-2a10-4ebb-93f8-ebc336f24f7b tempest-AttachVolumeTestJSON-760750814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-744f00f6-61de-48a4-94bb-c022ff7a6ebc" returned: 0 in 0.375s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:39:17 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-39a56368-2a10-4ebb-93f8-ebc336f24f7b tempest-AttachVolumeTestJSON-760750814 None] Lock "cinder-quobyte-744f00f6-61de-48a4-94bb-c022ff7a6ebc" released by "delete_volume" :: held 0.979s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:39:18 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-39a56368-2a10-4ebb-93f8-ebc336f24f7b tempest-AttachVolumeTestJSON-760750814 None] Created reservations ['81f1ac2a-c757-4063-b2ca-8c12ffe6af98', '422808ec-40e6-4181-82c3-fc18e94f5f11', 'b1a73786-798f-4fbb-acf5-5237a867be96', '4ce921f3-4a69-4be0-a1b4-c4b28af716f1'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:39:18 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-39a56368-2a10-4ebb-93f8-ebc336f24f7b tempest-AttachVolumeTestJSON-760750814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:39:18 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-39a56368-2a10-4ebb-93f8-ebc336f24f7b tempest-AttachVolumeTestJSON-760750814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:39:18 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-39a56368-2a10-4ebb-93f8-ebc336f24f7b tempest-AttachVolumeTestJSON-760750814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:39:18 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-39a56368-2a10-4ebb-93f8-ebc336f24f7b tempest-AttachVolumeTestJSON-760750814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:39:18 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-39a56368-2a10-4ebb-93f8-ebc336f24f7b tempest-AttachVolumeTestJSON-760750814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:39:18 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-39a56368-2a10-4ebb-93f8-ebc336f24f7b tempest-AttachVolumeTestJSON-760750814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:39:18 devstack sudo[96465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:39:18 devstack sudo[96465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:39:18 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-70a1f39c-a30d-4787-80e4-ede3e05630c1 tempest-VolumesActionsTest-987278039 None] Acquiring lock "cinder-1247d7cc-c0c0-4dd7-8014-432707bca70c-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:39:18 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-70a1f39c-a30d-4787-80e4-ede3e05630c1 tempest-VolumesActionsTest-987278039 None] Lock "cinder-1247d7cc-c0c0-4dd7-8014-432707bca70c-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:39:18 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-70a1f39c-a30d-4787-80e4-ede3e05630c1 tempest-VolumesActionsTest-987278039 None] Acquiring lock "cinder-quobyte-1247d7cc-c0c0-4dd7-8014-432707bca70c" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:39:18 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-70a1f39c-a30d-4787-80e4-ede3e05630c1 tempest-VolumesActionsTest-987278039 None] Lock "cinder-quobyte-1247d7cc-c0c0-4dd7-8014-432707bca70c" acquired by "delete_volume" :: waited 0.031s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:39:18 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5f372ab-a0b8-40a8-b99d-69ba72208984]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:39:18 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-70a1f39c-a30d-4787-80e4-ede3e05630c1 tempest-VolumesActionsTest-987278039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-1247d7cc-c0c0-4dd7-8014-432707bca70c {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:39:18 devstack sudo[96465]: pam_unix(sudo:session): session closed for user root Sep 23 14:39:18 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-39a56368-2a10-4ebb-93f8-ebc336f24f7b tempest-AttachVolumeTestJSON-760750814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.543s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:39:18 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-39a56368-2a10-4ebb-93f8-ebc336f24f7b tempest-AttachVolumeTestJSON-760750814 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:39:18 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-39a56368-2a10-4ebb-93f8-ebc336f24f7b tempest-AttachVolumeTestJSON-760750814 None] Deleted volume successfully. Sep 23 14:39:18 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-39a56368-2a10-4ebb-93f8-ebc336f24f7b tempest-AttachVolumeTestJSON-760750814 None] Lock "cinder-744f00f6-61de-48a4-94bb-c022ff7a6ebc-delete_volume" released by "delete_volume" :: held 2.008s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:39:18 devstack sudo[96478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-1247d7cc-c0c0-4dd7-8014-432707bca70c Sep 23 14:39:18 devstack sudo[96478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:39:19 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-f6a1d81d-8fe7-4095-ba02-51a166364b9f tempest-AttachVolumeTestJSON-760750814 None] Acquiring lock "cinder-1f636362-e6ea-471d-866f-dac50aefb9d5-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:39:19 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-f6a1d81d-8fe7-4095-ba02-51a166364b9f tempest-AttachVolumeTestJSON-760750814 None] Lock "cinder-1f636362-e6ea-471d-866f-dac50aefb9d5-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:39:19 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-f6a1d81d-8fe7-4095-ba02-51a166364b9f tempest-AttachVolumeTestJSON-760750814 None] Acquiring lock "cinder-quobyte-1f636362-e6ea-471d-866f-dac50aefb9d5" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:39:19 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-f6a1d81d-8fe7-4095-ba02-51a166364b9f tempest-AttachVolumeTestJSON-760750814 None] Lock "cinder-quobyte-1f636362-e6ea-471d-866f-dac50aefb9d5" acquired by "delete_volume" :: waited 0.016s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:39:19 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[e975d28d-01bc-4d36-8acb-9c08019ee5a3]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:39:19 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-f6a1d81d-8fe7-4095-ba02-51a166364b9f tempest-AttachVolumeTestJSON-760750814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-1f636362-e6ea-471d-866f-dac50aefb9d5 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:39:19 devstack sudo[96478]: pam_unix(sudo:session): session closed for user root Sep 23 14:39:19 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-70a1f39c-a30d-4787-80e4-ede3e05630c1 tempest-VolumesActionsTest-987278039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-1247d7cc-c0c0-4dd7-8014-432707bca70c" returned: 0 in 0.540s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:39:19 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-70a1f39c-a30d-4787-80e4-ede3e05630c1 tempest-VolumesActionsTest-987278039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-1247d7cc-c0c0-4dd7-8014-432707bca70c {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:39:19 devstack sudo[96486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-1247d7cc-c0c0-4dd7-8014-432707bca70c Sep 23 14:39:19 devstack sudo[96486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:39:19 devstack sudo[96485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-1f636362-e6ea-471d-866f-dac50aefb9d5 Sep 23 14:39:19 devstack sudo[96485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:39:19 devstack sudo[96486]: pam_unix(sudo:session): session closed for user root Sep 23 14:39:19 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-70a1f39c-a30d-4787-80e4-ede3e05630c1 tempest-VolumesActionsTest-987278039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-1247d7cc-c0c0-4dd7-8014-432707bca70c" returned: 0 in 0.307s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:39:19 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-70a1f39c-a30d-4787-80e4-ede3e05630c1 tempest-VolumesActionsTest-987278039 None] Lock "cinder-quobyte-1247d7cc-c0c0-4dd7-8014-432707bca70c" released by "delete_volume" :: held 0.917s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:39:19 devstack sudo[96485]: pam_unix(sudo:session): session closed for user root Sep 23 14:39:19 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-70a1f39c-a30d-4787-80e4-ede3e05630c1 tempest-VolumesActionsTest-987278039 None] Created reservations ['8877769c-7b9c-49b1-af87-174e61e089ea', '58dfd4d0-0c74-4711-b67e-9ea0284ca2f9', 'e8c2c9f1-83fe-4435-9749-922febf8c397', 'aedf141e-1105-4ef0-a684-468a29f2b14a'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:39:19 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-f6a1d81d-8fe7-4095-ba02-51a166364b9f tempest-AttachVolumeTestJSON-760750814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-1f636362-e6ea-471d-866f-dac50aefb9d5" returned: 0 in 0.476s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:39:19 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-f6a1d81d-8fe7-4095-ba02-51a166364b9f tempest-AttachVolumeTestJSON-760750814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-1f636362-e6ea-471d-866f-dac50aefb9d5 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:39:19 devstack sudo[96493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-1f636362-e6ea-471d-866f-dac50aefb9d5 Sep 23 14:39:19 devstack sudo[96493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:39:19 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-70a1f39c-a30d-4787-80e4-ede3e05630c1 tempest-VolumesActionsTest-987278039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:39:19 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-70a1f39c-a30d-4787-80e4-ede3e05630c1 tempest-VolumesActionsTest-987278039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:39:19 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-70a1f39c-a30d-4787-80e4-ede3e05630c1 tempest-VolumesActionsTest-987278039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:39:19 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-70a1f39c-a30d-4787-80e4-ede3e05630c1 tempest-VolumesActionsTest-987278039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:39:19 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-70a1f39c-a30d-4787-80e4-ede3e05630c1 tempest-VolumesActionsTest-987278039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:39:19 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-70a1f39c-a30d-4787-80e4-ede3e05630c1 tempest-VolumesActionsTest-987278039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:39:19 devstack sudo[96495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:39:19 devstack sudo[96495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:39:20 devstack sudo[96493]: pam_unix(sudo:session): session closed for user root Sep 23 14:39:20 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-f6a1d81d-8fe7-4095-ba02-51a166364b9f tempest-AttachVolumeTestJSON-760750814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-1f636362-e6ea-471d-866f-dac50aefb9d5" returned: 0 in 0.368s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:39:20 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-f6a1d81d-8fe7-4095-ba02-51a166364b9f tempest-AttachVolumeTestJSON-760750814 None] Lock "cinder-quobyte-1f636362-e6ea-471d-866f-dac50aefb9d5" released by "delete_volume" :: held 0.894s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:39:20 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-f6a1d81d-8fe7-4095-ba02-51a166364b9f tempest-AttachVolumeTestJSON-760750814 None] Created reservations ['e5c63959-12d0-4d51-83f3-3fb0bc94e3d5', 'fb1d95be-e46e-4fc8-9c4f-2365ad1d86e3', '6f7abe3d-2557-46f7-ab1b-72d180bba57b', 'b0529c74-d168-4dd7-99de-6e94fc372a3f'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:39:20 devstack sudo[96495]: pam_unix(sudo:session): session closed for user root Sep 23 14:39:20 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-70a1f39c-a30d-4787-80e4-ede3e05630c1 tempest-VolumesActionsTest-987278039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.383s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:39:20 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-70a1f39c-a30d-4787-80e4-ede3e05630c1 tempest-VolumesActionsTest-987278039 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:39:20 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-70a1f39c-a30d-4787-80e4-ede3e05630c1 tempest-VolumesActionsTest-987278039 None] Deleted volume successfully. Sep 23 14:39:20 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-70a1f39c-a30d-4787-80e4-ede3e05630c1 tempest-VolumesActionsTest-987278039 None] Lock "cinder-1247d7cc-c0c0-4dd7-8014-432707bca70c-delete_volume" released by "delete_volume" :: held 1.689s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:39:20 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-f6a1d81d-8fe7-4095-ba02-51a166364b9f tempest-AttachVolumeTestJSON-760750814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:39:20 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-f6a1d81d-8fe7-4095-ba02-51a166364b9f tempest-AttachVolumeTestJSON-760750814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:39:20 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-f6a1d81d-8fe7-4095-ba02-51a166364b9f tempest-AttachVolumeTestJSON-760750814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:39:20 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-f6a1d81d-8fe7-4095-ba02-51a166364b9f tempest-AttachVolumeTestJSON-760750814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:39:20 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-f6a1d81d-8fe7-4095-ba02-51a166364b9f tempest-AttachVolumeTestJSON-760750814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:39:20 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-f6a1d81d-8fe7-4095-ba02-51a166364b9f tempest-AttachVolumeTestJSON-760750814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:39:20 devstack sudo[96499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:39:20 devstack sudo[96499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:39:20 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-d50b776f-fa30-483d-a2ca-ab4c559d856f tempest-AttachVolumeTestJSON-760750814 None] Acquiring lock "cinder-1b1b5b1d-2346-4dbf-9051-e7d92a4c6aec-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:39:20 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-d50b776f-fa30-483d-a2ca-ab4c559d856f tempest-AttachVolumeTestJSON-760750814 None] Lock "cinder-1b1b5b1d-2346-4dbf-9051-e7d92a4c6aec-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:39:20 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-d50b776f-fa30-483d-a2ca-ab4c559d856f tempest-AttachVolumeTestJSON-760750814 None] Acquiring lock "cinder-quobyte-1b1b5b1d-2346-4dbf-9051-e7d92a4c6aec" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:39:20 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-d50b776f-fa30-483d-a2ca-ab4c559d856f tempest-AttachVolumeTestJSON-760750814 None] Lock "cinder-quobyte-1b1b5b1d-2346-4dbf-9051-e7d92a4c6aec" acquired by "delete_volume" :: waited 0.018s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:39:20 devstack sudo[96499]: pam_unix(sudo:session): session closed for user root Sep 23 14:39:20 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-f6a1d81d-8fe7-4095-ba02-51a166364b9f tempest-AttachVolumeTestJSON-760750814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.357s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:39:20 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-f6a1d81d-8fe7-4095-ba02-51a166364b9f tempest-AttachVolumeTestJSON-760750814 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:39:20 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[26c6f575-5997-47a3-a97b-254b1d25566d]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:39:20 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d50b776f-fa30-483d-a2ca-ab4c559d856f tempest-AttachVolumeTestJSON-760750814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-1b1b5b1d-2346-4dbf-9051-e7d92a4c6aec {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:39:20 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-f6a1d81d-8fe7-4095-ba02-51a166364b9f tempest-AttachVolumeTestJSON-760750814 None] Deleted volume successfully. Sep 23 14:39:20 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-f6a1d81d-8fe7-4095-ba02-51a166364b9f tempest-AttachVolumeTestJSON-760750814 None] Lock "cinder-1f636362-e6ea-471d-866f-dac50aefb9d5-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:39:20 devstack sudo[96503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-1b1b5b1d-2346-4dbf-9051-e7d92a4c6aec Sep 23 14:39:20 devstack sudo[96503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:39:21 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d50b776f-fa30-483d-a2ca-ab4c559d856f tempest-AttachVolumeTestJSON-760750814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-1b1b5b1d-2346-4dbf-9051-e7d92a4c6aec" returned: 0 in 0.540s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:39:21 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d50b776f-fa30-483d-a2ca-ab4c559d856f tempest-AttachVolumeTestJSON-760750814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-1b1b5b1d-2346-4dbf-9051-e7d92a4c6aec {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:39:21 devstack sudo[96503]: pam_unix(sudo:session): session closed for user root Sep 23 14:39:21 devstack sudo[96510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-1b1b5b1d-2346-4dbf-9051-e7d92a4c6aec Sep 23 14:39:21 devstack sudo[96510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:39:21 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-daae78b1-7304-4727-a8c3-1fee0cec8e74 tempest-VolumesActionsTest-190168521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:39:21 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-daae78b1-7304-4727-a8c3-1fee0cec8e74 tempest-VolumesActionsTest-190168521 None] Flow 'volume_create_manager' (0d7c0ad7-1893-4a76-9eff-dc12806eca40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:39:21 devstack sudo[96510]: pam_unix(sudo:session): session closed for user root Sep 23 14:39:21 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-daae78b1-7304-4727-a8c3-1fee0cec8e74 tempest-VolumesActionsTest-190168521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7d24f72-3d94-40a7-9f2a-6fe278712644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:39:21 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d50b776f-fa30-483d-a2ca-ab4c559d856f tempest-AttachVolumeTestJSON-760750814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-1b1b5b1d-2346-4dbf-9051-e7d92a4c6aec" returned: 0 in 0.814s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:39:22 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-daae78b1-7304-4727-a8c3-1fee0cec8e74 tempest-VolumesActionsTest-190168521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7d24f72-3d94-40a7-9f2a-6fe278712644) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:39:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1877124667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=968ab29e-8978-42e8-a166-0903d999bac5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4885c86c91f4245bdc43ff368fc3b8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:39:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:39:22Z,use_quota=True,user_id='fa72e470c3174d72aad0add017605822',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:39:22 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-daae78b1-7304-4727-a8c3-1fee0cec8e74 tempest-VolumesActionsTest-190168521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6cdd3f8-4679-49c5-a7ae-e15f4f06b1d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:39:22 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-daae78b1-7304-4727-a8c3-1fee0cec8e74 tempest-VolumesActionsTest-190168521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6cdd3f8-4679-49c5-a7ae-e15f4f06b1d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:39:22 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-daae78b1-7304-4727-a8c3-1fee0cec8e74 tempest-VolumesActionsTest-190168521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e9d1a22-4b5a-46da-96c3-891c04141f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:39:22 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-daae78b1-7304-4727-a8c3-1fee0cec8e74 tempest-VolumesActionsTest-190168521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e9d1a22-4b5a-46da-96c3-891c04141f72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '968ab29e-8978-42e8-a166-0903d999bac5', 'volume_name': 'volume-968ab29e-8978-42e8-a166-0903d999bac5', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:39:22 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-daae78b1-7304-4727-a8c3-1fee0cec8e74 tempest-VolumesActionsTest-190168521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46e13df3-f4a7-4113-8ecb-2f113f5692a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:39:22 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-daae78b1-7304-4727-a8c3-1fee0cec8e74 tempest-VolumesActionsTest-190168521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46e13df3-f4a7-4113-8ecb-2f113f5692a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:39:22 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-daae78b1-7304-4727-a8c3-1fee0cec8e74 tempest-VolumesActionsTest-190168521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b28a82e7-cec4-484b-ba71-65a2925b9a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:39:22 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-daae78b1-7304-4727-a8c3-1fee0cec8e74 tempest-VolumesActionsTest-190168521 None] Volume 968ab29e-8978-42e8-a166-0903d999bac5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-968ab29e-8978-42e8-a166-0903d999bac5', 'volume_size': 1} Sep 23 14:39:22 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-daae78b1-7304-4727-a8c3-1fee0cec8e74 tempest-VolumesActionsTest-190168521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:39:22 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-daae78b1-7304-4727-a8c3-1fee0cec8e74 tempest-VolumesActionsTest-190168521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:39:22 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-daae78b1-7304-4727-a8c3-1fee0cec8e74 tempest-VolumesActionsTest-190168521 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:39:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1877124667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=968ab29e-8978-42e8-a166-0903d999bac5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4885c86c91f4245bdc43ff368fc3b8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:39:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:39:22Z,use_quota=True,user_id='fa72e470c3174d72aad0add017605822',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:39:22 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-daae78b1-7304-4727-a8c3-1fee0cec8e74 tempest-VolumesActionsTest-190168521 None] Creating volume 968ab29e-8978-42e8-a166-0903d999bac5 {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:39:22 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-daae78b1-7304-4727-a8c3-1fee0cec8e74 tempest-VolumesActionsTest-190168521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:39:22 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-daae78b1-7304-4727-a8c3-1fee0cec8e74 tempest-VolumesActionsTest-190168521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:39:22 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-daae78b1-7304-4727-a8c3-1fee0cec8e74 tempest-VolumesActionsTest-190168521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:39:22 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-daae78b1-7304-4727-a8c3-1fee0cec8e74 tempest-VolumesActionsTest-190168521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:39:22 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-daae78b1-7304-4727-a8c3-1fee0cec8e74 tempest-VolumesActionsTest-190168521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:39:22 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-daae78b1-7304-4727-a8c3-1fee0cec8e74 tempest-VolumesActionsTest-190168521 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:39:22 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-daae78b1-7304-4727-a8c3-1fee0cec8e74 tempest-VolumesActionsTest-190168521 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:39:22 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-daae78b1-7304-4727-a8c3-1fee0cec8e74 tempest-VolumesActionsTest-190168521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-968ab29e-8978-42e8-a166-0903d999bac5 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:39:22 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-d50b776f-fa30-483d-a2ca-ab4c559d856f tempest-AttachVolumeTestJSON-760750814 None] Lock "cinder-quobyte-1b1b5b1d-2346-4dbf-9051-e7d92a4c6aec" released by "delete_volume" :: held 1.593s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:39:22 devstack sudo[96571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-968ab29e-8978-42e8-a166-0903d999bac5 1073741824 Sep 23 14:39:22 devstack sudo[96571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:39:22 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-d50b776f-fa30-483d-a2ca-ab4c559d856f tempest-AttachVolumeTestJSON-760750814 None] Created reservations ['b5acf5ba-0552-4b44-b549-acf595681065', 'fbb1bced-af34-4d9d-89ec-19fb5ca5dd42', '00eef858-de07-4667-b3ca-5dc45224746b', 'c339313a-99dd-4634-b7e5-ca77daf885f0'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:39:22 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-d50b776f-fa30-483d-a2ca-ab4c559d856f tempest-AttachVolumeTestJSON-760750814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:39:22 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-d50b776f-fa30-483d-a2ca-ab4c559d856f tempest-AttachVolumeTestJSON-760750814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:39:22 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-d50b776f-fa30-483d-a2ca-ab4c559d856f tempest-AttachVolumeTestJSON-760750814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:39:22 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-d50b776f-fa30-483d-a2ca-ab4c559d856f tempest-AttachVolumeTestJSON-760750814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:39:22 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-d50b776f-fa30-483d-a2ca-ab4c559d856f tempest-AttachVolumeTestJSON-760750814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:39:22 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d50b776f-fa30-483d-a2ca-ab4c559d856f tempest-AttachVolumeTestJSON-760750814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:39:22 devstack sudo[96578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:39:22 devstack sudo[96578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:39:22 devstack sudo[96578]: pam_unix(sudo:session): session closed for user root Sep 23 14:39:22 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d50b776f-fa30-483d-a2ca-ab4c559d856f tempest-AttachVolumeTestJSON-760750814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.376s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:39:22 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-d50b776f-fa30-483d-a2ca-ab4c559d856f tempest-AttachVolumeTestJSON-760750814 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:39:22 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-d50b776f-fa30-483d-a2ca-ab4c559d856f tempest-AttachVolumeTestJSON-760750814 None] Deleted volume successfully. Sep 23 14:39:22 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-d50b776f-fa30-483d-a2ca-ab4c559d856f tempest-AttachVolumeTestJSON-760750814 None] Lock "cinder-1b1b5b1d-2346-4dbf-9051-e7d92a4c6aec-delete_volume" released by "delete_volume" :: held 2.429s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:39:23 devstack sudo[96571]: pam_unix(sudo:session): session closed for user root Sep 23 14:39:23 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-daae78b1-7304-4727-a8c3-1fee0cec8e74 tempest-VolumesActionsTest-190168521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-968ab29e-8978-42e8-a166-0903d999bac5 1073741824" returned: 0 in 0.969s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:39:23 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-daae78b1-7304-4727-a8c3-1fee0cec8e74 tempest-VolumesActionsTest-190168521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-968ab29e-8978-42e8-a166-0903d999bac5 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:39:23 devstack sudo[96590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-968ab29e-8978-42e8-a166-0903d999bac5 Sep 23 14:39:23 devstack sudo[96590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:39:23 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-463bd80a-5296-412d-a7e8-f75cb83776c8 tempest-VolumeQuotasAdminTestJSON-173594029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:39:23 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-463bd80a-5296-412d-a7e8-f75cb83776c8 tempest-VolumeQuotasAdminTestJSON-173594029 None] Flow 'volume_create_manager' (fa46e878-d533-4bdd-a714-8d994894aa82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:39:23 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-463bd80a-5296-412d-a7e8-f75cb83776c8 tempest-VolumeQuotasAdminTestJSON-173594029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d2c6bdd-86c3-460d-a7c1-550e6e221a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:39:23 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-463bd80a-5296-412d-a7e8-f75cb83776c8 tempest-VolumeQuotasAdminTestJSON-173594029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d2c6bdd-86c3-460d-a7c1-550e6e221a55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:39:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1449435365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e7709e4-ae1e-4ee0-b15b-2ba0bb80136c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='556f594c83ed4761ab85760d66e8842d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:39:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:39:24Z,use_quota=True,user_id='9a5376708e8a4ae7b2447d7f59715bc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:39:23 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-463bd80a-5296-412d-a7e8-f75cb83776c8 tempest-VolumeQuotasAdminTestJSON-173594029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (218df73a-017f-48d1-b639-058311ff9987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:39:23 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-463bd80a-5296-412d-a7e8-f75cb83776c8 tempest-VolumeQuotasAdminTestJSON-173594029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (218df73a-017f-48d1-b639-058311ff9987) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:39:23 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-463bd80a-5296-412d-a7e8-f75cb83776c8 tempest-VolumeQuotasAdminTestJSON-173594029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64de6441-5005-4d62-a124-f7d72289da66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:39:23 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-463bd80a-5296-412d-a7e8-f75cb83776c8 tempest-VolumeQuotasAdminTestJSON-173594029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64de6441-5005-4d62-a124-f7d72289da66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e7709e4-ae1e-4ee0-b15b-2ba0bb80136c', 'volume_name': 'volume-4e7709e4-ae1e-4ee0-b15b-2ba0bb80136c', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:39:23 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-463bd80a-5296-412d-a7e8-f75cb83776c8 tempest-VolumeQuotasAdminTestJSON-173594029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c15016d-6a86-4a1c-b5cc-0ff741fa6848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:39:23 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-463bd80a-5296-412d-a7e8-f75cb83776c8 tempest-VolumeQuotasAdminTestJSON-173594029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c15016d-6a86-4a1c-b5cc-0ff741fa6848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:39:23 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-463bd80a-5296-412d-a7e8-f75cb83776c8 tempest-VolumeQuotasAdminTestJSON-173594029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (835d6fe1-e4d0-4e1e-9ffa-ee1d27483904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:39:23 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-463bd80a-5296-412d-a7e8-f75cb83776c8 tempest-VolumeQuotasAdminTestJSON-173594029 None] Volume 4e7709e4-ae1e-4ee0-b15b-2ba0bb80136c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e7709e4-ae1e-4ee0-b15b-2ba0bb80136c', 'volume_size': 1} Sep 23 14:39:23 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-463bd80a-5296-412d-a7e8-f75cb83776c8 tempest-VolumeQuotasAdminTestJSON-173594029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:39:23 devstack sudo[96590]: pam_unix(sudo:session): session closed for user root Sep 23 14:39:23 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-daae78b1-7304-4727-a8c3-1fee0cec8e74 tempest-VolumesActionsTest-190168521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-968ab29e-8978-42e8-a166-0903d999bac5" returned: 0 in 0.606s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:39:23 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-daae78b1-7304-4727-a8c3-1fee0cec8e74 tempest-VolumesActionsTest-190168521 None] <== create_volume: return (1674ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:39:23 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-daae78b1-7304-4727-a8c3-1fee0cec8e74 tempest-VolumesActionsTest-190168521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.677s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:39:23 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-463bd80a-5296-412d-a7e8-f75cb83776c8 tempest-VolumeQuotasAdminTestJSON-173594029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.048s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:39:23 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-463bd80a-5296-412d-a7e8-f75cb83776c8 tempest-VolumeQuotasAdminTestJSON-173594029 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:39:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1449435365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e7709e4-ae1e-4ee0-b15b-2ba0bb80136c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='556f594c83ed4761ab85760d66e8842d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:39:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:39:24Z,use_quota=True,user_id='9a5376708e8a4ae7b2447d7f59715bc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:39:23 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-463bd80a-5296-412d-a7e8-f75cb83776c8 tempest-VolumeQuotasAdminTestJSON-173594029 None] Creating volume 4e7709e4-ae1e-4ee0-b15b-2ba0bb80136c {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:39:23 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-463bd80a-5296-412d-a7e8-f75cb83776c8 tempest-VolumeQuotasAdminTestJSON-173594029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:39:23 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-463bd80a-5296-412d-a7e8-f75cb83776c8 tempest-VolumeQuotasAdminTestJSON-173594029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:39:23 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-463bd80a-5296-412d-a7e8-f75cb83776c8 tempest-VolumeQuotasAdminTestJSON-173594029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:39:23 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-463bd80a-5296-412d-a7e8-f75cb83776c8 tempest-VolumeQuotasAdminTestJSON-173594029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:39:23 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-463bd80a-5296-412d-a7e8-f75cb83776c8 tempest-VolumeQuotasAdminTestJSON-173594029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:39:23 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-463bd80a-5296-412d-a7e8-f75cb83776c8 tempest-VolumeQuotasAdminTestJSON-173594029 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:39:23 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-463bd80a-5296-412d-a7e8-f75cb83776c8 tempest-VolumeQuotasAdminTestJSON-173594029 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:39:23 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-463bd80a-5296-412d-a7e8-f75cb83776c8 tempest-VolumeQuotasAdminTestJSON-173594029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4e7709e4-ae1e-4ee0-b15b-2ba0bb80136c 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:39:23 devstack sudo[96593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4e7709e4-ae1e-4ee0-b15b-2ba0bb80136c 1073741824 Sep 23 14:39:23 devstack sudo[96593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:39:23 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-daae78b1-7304-4727-a8c3-1fee0cec8e74 tempest-VolumesActionsTest-190168521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b28a82e7-cec4-484b-ba71-65a2925b9a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-968ab29e-8978-42e8-a166-0903d999bac5', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:39:23 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-daae78b1-7304-4727-a8c3-1fee0cec8e74 tempest-VolumesActionsTest-190168521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d00bf9a9-59f0-4a0f-a80e-c3a457fb9d6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:39:23 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-daae78b1-7304-4727-a8c3-1fee0cec8e74 tempest-VolumesActionsTest-190168521 None] Volume volume-968ab29e-8978-42e8-a166-0903d999bac5 (968ab29e-8978-42e8-a166-0903d999bac5): created successfully Sep 23 14:39:23 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-daae78b1-7304-4727-a8c3-1fee0cec8e74 tempest-VolumesActionsTest-190168521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d00bf9a9-59f0-4a0f-a80e-c3a457fb9d6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:39:23 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-daae78b1-7304-4727-a8c3-1fee0cec8e74 tempest-VolumesActionsTest-190168521 None] Flow 'volume_create_manager' (0d7c0ad7-1893-4a76-9eff-dc12806eca40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:39:23 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-daae78b1-7304-4727-a8c3-1fee0cec8e74 tempest-VolumesActionsTest-190168521 None] Created volume successfully. Sep 23 14:39:24 devstack sudo[96593]: pam_unix(sudo:session): session closed for user root Sep 23 14:39:24 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-463bd80a-5296-412d-a7e8-f75cb83776c8 tempest-VolumeQuotasAdminTestJSON-173594029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4e7709e4-ae1e-4ee0-b15b-2ba0bb80136c 1073741824" returned: 0 in 0.588s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:39:24 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-463bd80a-5296-412d-a7e8-f75cb83776c8 tempest-VolumeQuotasAdminTestJSON-173594029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4e7709e4-ae1e-4ee0-b15b-2ba0bb80136c {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:39:24 devstack sudo[96600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4e7709e4-ae1e-4ee0-b15b-2ba0bb80136c Sep 23 14:39:24 devstack sudo[96600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:39:24 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-47877a1f-19ae-4de7-b9e2-f11182b167c7 tempest-VolumesActionsTest-1930790160 None] Acquiring lock "cinder-91658ecc-b212-4cec-ab79-495726afbe66" by "attach_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:39:24 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-47877a1f-19ae-4de7-b9e2-f11182b167c7 tempest-VolumesActionsTest-1930790160 None] Lock "cinder-91658ecc-b212-4cec-ab79-495726afbe66" acquired by "attach_volume" :: waited 0.021s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:39:24 devstack sudo[96600]: pam_unix(sudo:session): session closed for user root Sep 23 14:39:24 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-463bd80a-5296-412d-a7e8-f75cb83776c8 tempest-VolumeQuotasAdminTestJSON-173594029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4e7709e4-ae1e-4ee0-b15b-2ba0bb80136c" returned: 0 in 0.433s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:39:24 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-463bd80a-5296-412d-a7e8-f75cb83776c8 tempest-VolumeQuotasAdminTestJSON-173594029 None] <== create_volume: return (1077ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:39:24 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-463bd80a-5296-412d-a7e8-f75cb83776c8 tempest-VolumeQuotasAdminTestJSON-173594029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.082s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:39:24 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-47877a1f-19ae-4de7-b9e2-f11182b167c7 tempest-VolumesActionsTest-1930790160 None] Attaching volume 91658ecc-b212-4cec-ab79-495726afbe66 to instance 222beaaf-90dc-42d7-bd32-85e2c50d1478 at mountpoint /dev/vdb on host None. Sep 23 14:39:24 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-463bd80a-5296-412d-a7e8-f75cb83776c8 tempest-VolumeQuotasAdminTestJSON-173594029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (835d6fe1-e4d0-4e1e-9ffa-ee1d27483904) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e7709e4-ae1e-4ee0-b15b-2ba0bb80136c', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:39:24 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-463bd80a-5296-412d-a7e8-f75cb83776c8 tempest-VolumeQuotasAdminTestJSON-173594029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc7cf558-361a-4488-b93d-7e4b85fe3ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:39:24 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-463bd80a-5296-412d-a7e8-f75cb83776c8 tempest-VolumeQuotasAdminTestJSON-173594029 None] Volume volume-4e7709e4-ae1e-4ee0-b15b-2ba0bb80136c (4e7709e4-ae1e-4ee0-b15b-2ba0bb80136c): created successfully Sep 23 14:39:24 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-463bd80a-5296-412d-a7e8-f75cb83776c8 tempest-VolumeQuotasAdminTestJSON-173594029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc7cf558-361a-4488-b93d-7e4b85fe3ab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:39:24 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-463bd80a-5296-412d-a7e8-f75cb83776c8 tempest-VolumeQuotasAdminTestJSON-173594029 None] Flow 'volume_create_manager' (fa46e878-d533-4bdd-a714-8d994894aa82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:39:24 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-47877a1f-19ae-4de7-b9e2-f11182b167c7 tempest-VolumesActionsTest-1930790160 None] Attach volume completed successfully. Sep 23 14:39:24 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-463bd80a-5296-412d-a7e8-f75cb83776c8 tempest-VolumeQuotasAdminTestJSON-173594029 None] Created volume successfully. Sep 23 14:39:24 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-47877a1f-19ae-4de7-b9e2-f11182b167c7 tempest-VolumesActionsTest-1930790160 None] Lock "cinder-91658ecc-b212-4cec-ab79-495726afbe66" released by "attach_volume" :: held 0.185s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:39:25 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-cdeaed7b-93f9-4182-902a-18c9e72918e5 tempest-VolumesActionsTest-987278039 None] Acquiring lock "cinder-968ab29e-8978-42e8-a166-0903d999bac5-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:39:25 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-cdeaed7b-93f9-4182-902a-18c9e72918e5 tempest-VolumesActionsTest-987278039 None] Lock "cinder-968ab29e-8978-42e8-a166-0903d999bac5-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:39:25 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-cdeaed7b-93f9-4182-902a-18c9e72918e5 tempest-VolumesActionsTest-987278039 None] Acquiring lock "cinder-quobyte-968ab29e-8978-42e8-a166-0903d999bac5" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:39:25 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-cdeaed7b-93f9-4182-902a-18c9e72918e5 tempest-VolumesActionsTest-987278039 None] Lock "cinder-quobyte-968ab29e-8978-42e8-a166-0903d999bac5" acquired by "delete_volume" :: waited 0.021s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:39:25 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f37c8b7-1531-4104-adef-8197e9413266]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:39:25 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-cdeaed7b-93f9-4182-902a-18c9e72918e5 tempest-VolumesActionsTest-987278039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-968ab29e-8978-42e8-a166-0903d999bac5 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:39:25 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-739332d6-9716-4f6c-a0ea-def8c7bae9c1 tempest-VolumesActionsTest-1930790160 None] Acquiring lock "cinder-91658ecc-b212-4cec-ab79-495726afbe66-detach_volume" by "detach_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:39:25 devstack sudo[96604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-968ab29e-8978-42e8-a166-0903d999bac5 Sep 23 14:39:25 devstack sudo[96604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:39:25 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-739332d6-9716-4f6c-a0ea-def8c7bae9c1 tempest-VolumesActionsTest-1930790160 None] Lock "cinder-91658ecc-b212-4cec-ab79-495726afbe66-detach_volume" acquired by "detach_volume" :: waited 0.033s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:39:25 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-739332d6-9716-4f6c-a0ea-def8c7bae9c1 tempest-VolumesActionsTest-1930790160 None] Detaching volume 91658ecc-b212-4cec-ab79-495726afbe66 from instance 222beaaf-90dc-42d7-bd32-85e2c50d1478. Sep 23 14:39:25 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-739332d6-9716-4f6c-a0ea-def8c7bae9c1 tempest-VolumesActionsTest-1930790160 None] Detach volume completed successfully. Sep 23 14:39:25 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-739332d6-9716-4f6c-a0ea-def8c7bae9c1 tempest-VolumesActionsTest-1930790160 None] Lock "cinder-91658ecc-b212-4cec-ab79-495726afbe66-detach_volume" released by "detach_volume" :: held 0.083s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:39:26 devstack sudo[96604]: pam_unix(sudo:session): session closed for user root Sep 23 14:39:26 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-eddfbe39-8e99-449a-a38d-eafd515d043e tempest-VolumeQuotasAdminTestJSON-173594029 None] Acquiring lock "cinder-4e7709e4-ae1e-4ee0-b15b-2ba0bb80136c-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:39:26 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-cdeaed7b-93f9-4182-902a-18c9e72918e5 tempest-VolumesActionsTest-987278039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-968ab29e-8978-42e8-a166-0903d999bac5" returned: 0 in 0.673s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:39:26 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-cdeaed7b-93f9-4182-902a-18c9e72918e5 tempest-VolumesActionsTest-987278039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-968ab29e-8978-42e8-a166-0903d999bac5 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:39:26 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-eddfbe39-8e99-449a-a38d-eafd515d043e tempest-VolumeQuotasAdminTestJSON-173594029 None] Lock "cinder-4e7709e4-ae1e-4ee0-b15b-2ba0bb80136c-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:39:26 devstack sudo[96609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-968ab29e-8978-42e8-a166-0903d999bac5 Sep 23 14:39:26 devstack sudo[96609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:39:26 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-eddfbe39-8e99-449a-a38d-eafd515d043e tempest-VolumeQuotasAdminTestJSON-173594029 None] Acquiring lock "cinder-quobyte-4e7709e4-ae1e-4ee0-b15b-2ba0bb80136c" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:39:26 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-eddfbe39-8e99-449a-a38d-eafd515d043e tempest-VolumeQuotasAdminTestJSON-173594029 None] Lock "cinder-quobyte-4e7709e4-ae1e-4ee0-b15b-2ba0bb80136c" acquired by "delete_volume" :: waited 0.037s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:39:26 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eb47273-b533-4d12-94c7-ebb46a1eafac]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:39:26 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-eddfbe39-8e99-449a-a38d-eafd515d043e tempest-VolumeQuotasAdminTestJSON-173594029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4e7709e4-ae1e-4ee0-b15b-2ba0bb80136c {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:39:26 devstack sudo[96611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4e7709e4-ae1e-4ee0-b15b-2ba0bb80136c Sep 23 14:39:26 devstack sudo[96611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:39:26 devstack sudo[96609]: pam_unix(sudo:session): session closed for user root Sep 23 14:39:26 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-cdeaed7b-93f9-4182-902a-18c9e72918e5 tempest-VolumesActionsTest-987278039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-968ab29e-8978-42e8-a166-0903d999bac5" returned: 0 in 0.463s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:39:26 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-cdeaed7b-93f9-4182-902a-18c9e72918e5 tempest-VolumesActionsTest-987278039 None] Lock "cinder-quobyte-968ab29e-8978-42e8-a166-0903d999bac5" released by "delete_volume" :: held 1.248s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:39:26 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-cdeaed7b-93f9-4182-902a-18c9e72918e5 tempest-VolumesActionsTest-987278039 None] Created reservations ['ef972a13-4a5c-48cf-9090-db8f2f8be9af', '63aa579f-1a08-4dae-9e31-502ca6538f7a', 'ef890638-cca8-4575-955a-f8519ddf9f60', 'bace06b1-5be6-406c-abeb-1267605f87f5'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:39:26 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-cdeaed7b-93f9-4182-902a-18c9e72918e5 tempest-VolumesActionsTest-987278039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:39:26 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-cdeaed7b-93f9-4182-902a-18c9e72918e5 tempest-VolumesActionsTest-987278039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:39:26 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-cdeaed7b-93f9-4182-902a-18c9e72918e5 tempest-VolumesActionsTest-987278039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:39:26 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-cdeaed7b-93f9-4182-902a-18c9e72918e5 tempest-VolumesActionsTest-987278039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:39:26 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-cdeaed7b-93f9-4182-902a-18c9e72918e5 tempest-VolumesActionsTest-987278039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:39:26 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-cdeaed7b-93f9-4182-902a-18c9e72918e5 tempest-VolumesActionsTest-987278039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:39:26 devstack sudo[96633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:39:26 devstack sudo[96633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:39:26 devstack sudo[96611]: pam_unix(sudo:session): session closed for user root Sep 23 14:39:26 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-eddfbe39-8e99-449a-a38d-eafd515d043e tempest-VolumeQuotasAdminTestJSON-173594029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4e7709e4-ae1e-4ee0-b15b-2ba0bb80136c" returned: 0 in 0.718s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:39:26 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-eddfbe39-8e99-449a-a38d-eafd515d043e tempest-VolumeQuotasAdminTestJSON-173594029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4e7709e4-ae1e-4ee0-b15b-2ba0bb80136c {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:39:27 devstack sudo[96639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4e7709e4-ae1e-4ee0-b15b-2ba0bb80136c Sep 23 14:39:27 devstack sudo[96639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:39:27 devstack sudo[96633]: pam_unix(sudo:session): session closed for user root Sep 23 14:39:27 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-cdeaed7b-93f9-4182-902a-18c9e72918e5 tempest-VolumesActionsTest-987278039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.318s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:39:27 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-cdeaed7b-93f9-4182-902a-18c9e72918e5 tempest-VolumesActionsTest-987278039 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:39:27 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-cdeaed7b-93f9-4182-902a-18c9e72918e5 tempest-VolumesActionsTest-987278039 None] Deleted volume successfully. Sep 23 14:39:27 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-cdeaed7b-93f9-4182-902a-18c9e72918e5 tempest-VolumesActionsTest-987278039 None] Lock "cinder-968ab29e-8978-42e8-a166-0903d999bac5-delete_volume" released by "delete_volume" :: held 2.027s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:39:27 devstack sudo[96639]: pam_unix(sudo:session): session closed for user root Sep 23 14:39:27 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-eddfbe39-8e99-449a-a38d-eafd515d043e tempest-VolumeQuotasAdminTestJSON-173594029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4e7709e4-ae1e-4ee0-b15b-2ba0bb80136c" returned: 0 in 0.353s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:39:27 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-eddfbe39-8e99-449a-a38d-eafd515d043e tempest-VolumeQuotasAdminTestJSON-173594029 None] Lock "cinder-quobyte-4e7709e4-ae1e-4ee0-b15b-2ba0bb80136c" released by "delete_volume" :: held 1.163s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:39:27 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-eddfbe39-8e99-449a-a38d-eafd515d043e tempest-VolumeQuotasAdminTestJSON-173594029 None] Created reservations ['a03a78d6-496d-4600-a474-1120ad22939e', 'ec04afc2-b14b-4ad2-980d-ff601e4b181d', '4ca72c4e-479d-45a7-93d6-0b46ab74755b', '809963c0-3606-41bd-866d-2191061a2754'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:39:27 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-eddfbe39-8e99-449a-a38d-eafd515d043e tempest-VolumeQuotasAdminTestJSON-173594029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:39:27 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-eddfbe39-8e99-449a-a38d-eafd515d043e tempest-VolumeQuotasAdminTestJSON-173594029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:39:27 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-eddfbe39-8e99-449a-a38d-eafd515d043e tempest-VolumeQuotasAdminTestJSON-173594029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:39:27 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-eddfbe39-8e99-449a-a38d-eafd515d043e tempest-VolumeQuotasAdminTestJSON-173594029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:39:27 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-eddfbe39-8e99-449a-a38d-eafd515d043e tempest-VolumeQuotasAdminTestJSON-173594029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:39:27 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-eddfbe39-8e99-449a-a38d-eafd515d043e tempest-VolumeQuotasAdminTestJSON-173594029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:39:27 devstack sudo[96644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:39:27 devstack sudo[96644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:39:28 devstack sudo[96644]: pam_unix(sudo:session): session closed for user root Sep 23 14:39:28 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-eddfbe39-8e99-449a-a38d-eafd515d043e tempest-VolumeQuotasAdminTestJSON-173594029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.318s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:39:28 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-eddfbe39-8e99-449a-a38d-eafd515d043e tempest-VolumeQuotasAdminTestJSON-173594029 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:39:28 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-eddfbe39-8e99-449a-a38d-eafd515d043e tempest-VolumeQuotasAdminTestJSON-173594029 None] Deleted volume successfully. Sep 23 14:39:28 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-eddfbe39-8e99-449a-a38d-eafd515d043e tempest-VolumeQuotasAdminTestJSON-173594029 None] Lock "cinder-4e7709e4-ae1e-4ee0-b15b-2ba0bb80136c-delete_volume" released by "delete_volume" :: held 1.963s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:39:28 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d19f193-dc82-4b9d-b1e9-ffb854e9c1ec tempest-VolumesActionsTest-190168521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:39:28 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-6d19f193-dc82-4b9d-b1e9-ffb854e9c1ec tempest-VolumesActionsTest-190168521 None] Flow 'volume_create_manager' (39330268-243d-470a-b6e5-d7b3a77fbbcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:39:28 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-6d19f193-dc82-4b9d-b1e9-ffb854e9c1ec tempest-VolumesActionsTest-190168521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e614f3d1-f878-4fcd-b705-cffb073208d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:39:28 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-6d19f193-dc82-4b9d-b1e9-ffb854e9c1ec tempest-VolumesActionsTest-190168521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e614f3d1-f878-4fcd-b705-cffb073208d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:39:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1437207400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=013ef4c3-c815-465c-af46-e21c439048e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4885c86c91f4245bdc43ff368fc3b8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:39:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:39:28Z,use_quota=True,user_id='fa72e470c3174d72aad0add017605822',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:39:28 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-6d19f193-dc82-4b9d-b1e9-ffb854e9c1ec tempest-VolumesActionsTest-190168521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc8ec43e-d9c3-4d3c-9231-76bed54cf0fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:39:28 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-6d19f193-dc82-4b9d-b1e9-ffb854e9c1ec tempest-VolumesActionsTest-190168521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc8ec43e-d9c3-4d3c-9231-76bed54cf0fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:39:28 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-6d19f193-dc82-4b9d-b1e9-ffb854e9c1ec tempest-VolumesActionsTest-190168521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ae66379-b5eb-4920-ba98-bdd5a9ee2efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:39:28 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-6d19f193-dc82-4b9d-b1e9-ffb854e9c1ec tempest-VolumesActionsTest-190168521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ae66379-b5eb-4920-ba98-bdd5a9ee2efa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '013ef4c3-c815-465c-af46-e21c439048e8', 'volume_name': 'volume-013ef4c3-c815-465c-af46-e21c439048e8', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:39:28 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-6d19f193-dc82-4b9d-b1e9-ffb854e9c1ec tempest-VolumesActionsTest-190168521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (490e6f63-6b12-41f9-ac3c-cbf461fd065b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:39:28 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-6d19f193-dc82-4b9d-b1e9-ffb854e9c1ec tempest-VolumesActionsTest-190168521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (490e6f63-6b12-41f9-ac3c-cbf461fd065b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:39:28 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-6d19f193-dc82-4b9d-b1e9-ffb854e9c1ec tempest-VolumesActionsTest-190168521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c791138-3e57-4ea9-984a-0b417e79c9b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:39:28 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-6d19f193-dc82-4b9d-b1e9-ffb854e9c1ec tempest-VolumesActionsTest-190168521 None] Volume 013ef4c3-c815-465c-af46-e21c439048e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-013ef4c3-c815-465c-af46-e21c439048e8', 'volume_size': 1} Sep 23 14:39:28 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-6d19f193-dc82-4b9d-b1e9-ffb854e9c1ec tempest-VolumesActionsTest-190168521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:39:28 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-6d19f193-dc82-4b9d-b1e9-ffb854e9c1ec tempest-VolumesActionsTest-190168521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:39:28 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-6d19f193-dc82-4b9d-b1e9-ffb854e9c1ec tempest-VolumesActionsTest-190168521 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:39:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1437207400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=013ef4c3-c815-465c-af46-e21c439048e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4885c86c91f4245bdc43ff368fc3b8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:39:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:39:28Z,use_quota=True,user_id='fa72e470c3174d72aad0add017605822',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:39:28 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-6d19f193-dc82-4b9d-b1e9-ffb854e9c1ec tempest-VolumesActionsTest-190168521 None] Creating volume 013ef4c3-c815-465c-af46-e21c439048e8 {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:39:28 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-6d19f193-dc82-4b9d-b1e9-ffb854e9c1ec tempest-VolumesActionsTest-190168521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:39:28 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-6d19f193-dc82-4b9d-b1e9-ffb854e9c1ec tempest-VolumesActionsTest-190168521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:39:28 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-6d19f193-dc82-4b9d-b1e9-ffb854e9c1ec tempest-VolumesActionsTest-190168521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:39:28 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-6d19f193-dc82-4b9d-b1e9-ffb854e9c1ec tempest-VolumesActionsTest-190168521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:39:28 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-6d19f193-dc82-4b9d-b1e9-ffb854e9c1ec tempest-VolumesActionsTest-190168521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:39:28 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-6d19f193-dc82-4b9d-b1e9-ffb854e9c1ec tempest-VolumesActionsTest-190168521 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:39:28 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-6d19f193-dc82-4b9d-b1e9-ffb854e9c1ec tempest-VolumesActionsTest-190168521 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:39:28 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-6d19f193-dc82-4b9d-b1e9-ffb854e9c1ec tempest-VolumesActionsTest-190168521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-013ef4c3-c815-465c-af46-e21c439048e8 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:39:28 devstack sudo[96649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-013ef4c3-c815-465c-af46-e21c439048e8 1073741824 Sep 23 14:39:28 devstack sudo[96649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:39:29 devstack sudo[96649]: pam_unix(sudo:session): session closed for user root Sep 23 14:39:29 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-6d19f193-dc82-4b9d-b1e9-ffb854e9c1ec tempest-VolumesActionsTest-190168521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-013ef4c3-c815-465c-af46-e21c439048e8 1073741824" returned: 0 in 0.617s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:39:29 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-6d19f193-dc82-4b9d-b1e9-ffb854e9c1ec tempest-VolumesActionsTest-190168521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-013ef4c3-c815-465c-af46-e21c439048e8 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:39:29 devstack sudo[96655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-013ef4c3-c815-465c-af46-e21c439048e8 Sep 23 14:39:29 devstack sudo[96655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:39:29 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-158b3527-bea4-4458-84c4-790acea1e2ec tempest-VolumeQuotasAdminTestJSON-173594029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:39:29 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-158b3527-bea4-4458-84c4-790acea1e2ec tempest-VolumeQuotasAdminTestJSON-173594029 None] Flow 'volume_create_manager' (6843e750-b8db-4f7c-aa63-51abb9856c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:39:29 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-158b3527-bea4-4458-84c4-790acea1e2ec tempest-VolumeQuotasAdminTestJSON-173594029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65af8e53-4901-4051-a600-2852636c6dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:39:29 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-158b3527-bea4-4458-84c4-790acea1e2ec tempest-VolumeQuotasAdminTestJSON-173594029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65af8e53-4901-4051-a600-2852636c6dcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:39:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-637997089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=512ad90d-1e26-43e6-a8a9-b24471108305,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='556f594c83ed4761ab85760d66e8842d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:39:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:39:29Z,use_quota=True,user_id='9a5376708e8a4ae7b2447d7f59715bc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:39:29 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-158b3527-bea4-4458-84c4-790acea1e2ec tempest-VolumeQuotasAdminTestJSON-173594029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6faa6265-edd0-4137-a5e3-0b7b4addf1a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:39:29 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-158b3527-bea4-4458-84c4-790acea1e2ec tempest-VolumeQuotasAdminTestJSON-173594029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6faa6265-edd0-4137-a5e3-0b7b4addf1a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:39:29 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-158b3527-bea4-4458-84c4-790acea1e2ec tempest-VolumeQuotasAdminTestJSON-173594029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c87a65d0-84a9-425e-9abc-945d79b84e50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:39:29 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-158b3527-bea4-4458-84c4-790acea1e2ec tempest-VolumeQuotasAdminTestJSON-173594029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c87a65d0-84a9-425e-9abc-945d79b84e50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '512ad90d-1e26-43e6-a8a9-b24471108305', 'volume_name': 'volume-512ad90d-1e26-43e6-a8a9-b24471108305', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:39:29 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-158b3527-bea4-4458-84c4-790acea1e2ec tempest-VolumeQuotasAdminTestJSON-173594029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf44b056-51bb-476e-ae1c-8c69a3ef4a0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:39:29 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-158b3527-bea4-4458-84c4-790acea1e2ec tempest-VolumeQuotasAdminTestJSON-173594029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf44b056-51bb-476e-ae1c-8c69a3ef4a0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:39:29 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-158b3527-bea4-4458-84c4-790acea1e2ec tempest-VolumeQuotasAdminTestJSON-173594029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b89193d-1346-4ed0-9cac-03fa7db80540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:39:29 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-158b3527-bea4-4458-84c4-790acea1e2ec tempest-VolumeQuotasAdminTestJSON-173594029 None] Volume 512ad90d-1e26-43e6-a8a9-b24471108305: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-512ad90d-1e26-43e6-a8a9-b24471108305', 'volume_size': 1} Sep 23 14:39:29 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-158b3527-bea4-4458-84c4-790acea1e2ec tempest-VolumeQuotasAdminTestJSON-173594029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:39:29 devstack sudo[96655]: pam_unix(sudo:session): session closed for user root Sep 23 14:39:29 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-6d19f193-dc82-4b9d-b1e9-ffb854e9c1ec tempest-VolumesActionsTest-190168521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-013ef4c3-c815-465c-af46-e21c439048e8" returned: 0 in 0.424s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:39:29 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-6d19f193-dc82-4b9d-b1e9-ffb854e9c1ec tempest-VolumesActionsTest-190168521 None] <== create_volume: return (1136ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:39:29 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-6d19f193-dc82-4b9d-b1e9-ffb854e9c1ec tempest-VolumesActionsTest-190168521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.140s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:39:29 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-158b3527-bea4-4458-84c4-790acea1e2ec tempest-VolumeQuotasAdminTestJSON-173594029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.159s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:39:29 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-158b3527-bea4-4458-84c4-790acea1e2ec tempest-VolumeQuotasAdminTestJSON-173594029 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:39:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-637997089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=512ad90d-1e26-43e6-a8a9-b24471108305,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='556f594c83ed4761ab85760d66e8842d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:39:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:39:29Z,use_quota=True,user_id='9a5376708e8a4ae7b2447d7f59715bc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:39:29 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-158b3527-bea4-4458-84c4-790acea1e2ec tempest-VolumeQuotasAdminTestJSON-173594029 None] Creating volume 512ad90d-1e26-43e6-a8a9-b24471108305 {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:39:29 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-158b3527-bea4-4458-84c4-790acea1e2ec tempest-VolumeQuotasAdminTestJSON-173594029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:39:29 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-158b3527-bea4-4458-84c4-790acea1e2ec tempest-VolumeQuotasAdminTestJSON-173594029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:39:29 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-158b3527-bea4-4458-84c4-790acea1e2ec tempest-VolumeQuotasAdminTestJSON-173594029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:39:29 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-158b3527-bea4-4458-84c4-790acea1e2ec tempest-VolumeQuotasAdminTestJSON-173594029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:39:29 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-158b3527-bea4-4458-84c4-790acea1e2ec tempest-VolumeQuotasAdminTestJSON-173594029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:39:29 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-158b3527-bea4-4458-84c4-790acea1e2ec tempest-VolumeQuotasAdminTestJSON-173594029 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:39:29 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-158b3527-bea4-4458-84c4-790acea1e2ec tempest-VolumeQuotasAdminTestJSON-173594029 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:39:29 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-158b3527-bea4-4458-84c4-790acea1e2ec tempest-VolumeQuotasAdminTestJSON-173594029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-512ad90d-1e26-43e6-a8a9-b24471108305 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:39:29 devstack sudo[96660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-512ad90d-1e26-43e6-a8a9-b24471108305 1073741824 Sep 23 14:39:29 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-6d19f193-dc82-4b9d-b1e9-ffb854e9c1ec tempest-VolumesActionsTest-190168521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c791138-3e57-4ea9-984a-0b417e79c9b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-013ef4c3-c815-465c-af46-e21c439048e8', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:39:29 devstack sudo[96660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:39:29 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-6d19f193-dc82-4b9d-b1e9-ffb854e9c1ec tempest-VolumesActionsTest-190168521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67c10241-dc6d-49e6-85b3-2c99625341b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:39:29 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-6d19f193-dc82-4b9d-b1e9-ffb854e9c1ec tempest-VolumesActionsTest-190168521 None] Volume volume-013ef4c3-c815-465c-af46-e21c439048e8 (013ef4c3-c815-465c-af46-e21c439048e8): created successfully Sep 23 14:39:29 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-6d19f193-dc82-4b9d-b1e9-ffb854e9c1ec tempest-VolumesActionsTest-190168521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67c10241-dc6d-49e6-85b3-2c99625341b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:39:29 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-6d19f193-dc82-4b9d-b1e9-ffb854e9c1ec tempest-VolumesActionsTest-190168521 None] Flow 'volume_create_manager' (39330268-243d-470a-b6e5-d7b3a77fbbcf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:39:29 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-6d19f193-dc82-4b9d-b1e9-ffb854e9c1ec tempest-VolumesActionsTest-190168521 None] Created volume successfully. Sep 23 14:39:30 devstack sudo[96660]: pam_unix(sudo:session): session closed for user root Sep 23 14:39:30 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-158b3527-bea4-4458-84c4-790acea1e2ec tempest-VolumeQuotasAdminTestJSON-173594029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-512ad90d-1e26-43e6-a8a9-b24471108305 1073741824" returned: 0 in 0.606s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:39:30 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-158b3527-bea4-4458-84c4-790acea1e2ec tempest-VolumeQuotasAdminTestJSON-173594029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-512ad90d-1e26-43e6-a8a9-b24471108305 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:39:30 devstack sudo[96667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-512ad90d-1e26-43e6-a8a9-b24471108305 Sep 23 14:39:30 devstack sudo[96667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:39:30 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-e19d8a61-673c-4271-b8a5-3691fa3d8651 tempest-VolumesActionsTest-987278039 None] Acquiring lock "cinder-013ef4c3-c815-465c-af46-e21c439048e8-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:39:30 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-e19d8a61-673c-4271-b8a5-3691fa3d8651 tempest-VolumesActionsTest-987278039 None] Lock "cinder-013ef4c3-c815-465c-af46-e21c439048e8-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:39:30 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-e19d8a61-673c-4271-b8a5-3691fa3d8651 tempest-VolumesActionsTest-987278039 None] Acquiring lock "cinder-quobyte-013ef4c3-c815-465c-af46-e21c439048e8" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:39:30 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-e19d8a61-673c-4271-b8a5-3691fa3d8651 tempest-VolumesActionsTest-987278039 None] Lock "cinder-quobyte-013ef4c3-c815-465c-af46-e21c439048e8" acquired by "delete_volume" :: waited 0.022s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:39:30 devstack sudo[96667]: pam_unix(sudo:session): session closed for user root Sep 23 14:39:30 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-158b3527-bea4-4458-84c4-790acea1e2ec tempest-VolumeQuotasAdminTestJSON-173594029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-512ad90d-1e26-43e6-a8a9-b24471108305" returned: 0 in 0.405s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:39:30 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-158b3527-bea4-4458-84c4-790acea1e2ec tempest-VolumeQuotasAdminTestJSON-173594029 None] <== create_volume: return (1082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:39:30 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-158b3527-bea4-4458-84c4-790acea1e2ec tempest-VolumeQuotasAdminTestJSON-173594029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.087s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:39:30 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfd9ca5c-df07-4ff4-8d74-992f7f3211ae]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:39:30 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-e19d8a61-673c-4271-b8a5-3691fa3d8651 tempest-VolumesActionsTest-987278039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-013ef4c3-c815-465c-af46-e21c439048e8 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:39:30 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-158b3527-bea4-4458-84c4-790acea1e2ec tempest-VolumeQuotasAdminTestJSON-173594029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b89193d-1346-4ed0-9cac-03fa7db80540) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-512ad90d-1e26-43e6-a8a9-b24471108305', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:39:30 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-158b3527-bea4-4458-84c4-790acea1e2ec tempest-VolumeQuotasAdminTestJSON-173594029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (452ed185-3cda-4bbc-882e-5d42ebcd45b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:39:30 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-158b3527-bea4-4458-84c4-790acea1e2ec tempest-VolumeQuotasAdminTestJSON-173594029 None] Volume volume-512ad90d-1e26-43e6-a8a9-b24471108305 (512ad90d-1e26-43e6-a8a9-b24471108305): created successfully Sep 23 14:39:30 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-158b3527-bea4-4458-84c4-790acea1e2ec tempest-VolumeQuotasAdminTestJSON-173594029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (452ed185-3cda-4bbc-882e-5d42ebcd45b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:39:30 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-158b3527-bea4-4458-84c4-790acea1e2ec tempest-VolumeQuotasAdminTestJSON-173594029 None] Flow 'volume_create_manager' (6843e750-b8db-4f7c-aa63-51abb9856c58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:39:30 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-158b3527-bea4-4458-84c4-790acea1e2ec tempest-VolumeQuotasAdminTestJSON-173594029 None] Created volume successfully. Sep 23 14:39:30 devstack sudo[96670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-013ef4c3-c815-465c-af46-e21c439048e8 Sep 23 14:39:30 devstack sudo[96670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:39:31 devstack sudo[96670]: pam_unix(sudo:session): session closed for user root Sep 23 14:39:31 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-e19d8a61-673c-4271-b8a5-3691fa3d8651 tempest-VolumesActionsTest-987278039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-013ef4c3-c815-465c-af46-e21c439048e8" returned: 0 in 0.390s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:39:31 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-e19d8a61-673c-4271-b8a5-3691fa3d8651 tempest-VolumesActionsTest-987278039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-013ef4c3-c815-465c-af46-e21c439048e8 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:39:31 devstack sudo[96675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-013ef4c3-c815-465c-af46-e21c439048e8 Sep 23 14:39:31 devstack sudo[96675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:39:31 devstack sudo[96675]: pam_unix(sudo:session): session closed for user root Sep 23 14:39:31 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-e19d8a61-673c-4271-b8a5-3691fa3d8651 tempest-VolumesActionsTest-987278039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-013ef4c3-c815-465c-af46-e21c439048e8" returned: 0 in 0.325s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:39:31 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-e19d8a61-673c-4271-b8a5-3691fa3d8651 tempest-VolumesActionsTest-987278039 None] Lock "cinder-quobyte-013ef4c3-c815-465c-af46-e21c439048e8" released by "delete_volume" :: held 0.782s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:39:31 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-e19d8a61-673c-4271-b8a5-3691fa3d8651 tempest-VolumesActionsTest-987278039 None] Created reservations ['039afac4-67c5-46c1-afcc-19e0309cfbb3', 'ddf9ee0b-5706-4136-b643-1bbd4dcdddc3', '284a650e-f849-4cb4-af4f-01752b76cb83', '4596079f-b9c2-4932-a3e4-9c5c29d32fa6'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:39:31 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-e19d8a61-673c-4271-b8a5-3691fa3d8651 tempest-VolumesActionsTest-987278039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:39:31 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-e19d8a61-673c-4271-b8a5-3691fa3d8651 tempest-VolumesActionsTest-987278039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:39:31 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-e19d8a61-673c-4271-b8a5-3691fa3d8651 tempest-VolumesActionsTest-987278039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:39:31 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-e19d8a61-673c-4271-b8a5-3691fa3d8651 tempest-VolumesActionsTest-987278039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:39:31 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-e19d8a61-673c-4271-b8a5-3691fa3d8651 tempest-VolumesActionsTest-987278039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:39:31 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-e19d8a61-673c-4271-b8a5-3691fa3d8651 tempest-VolumesActionsTest-987278039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:39:31 devstack sudo[96678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:39:31 devstack sudo[96678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:39:31 devstack sudo[96678]: pam_unix(sudo:session): session closed for user root Sep 23 14:39:31 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-e19d8a61-673c-4271-b8a5-3691fa3d8651 tempest-VolumesActionsTest-987278039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.294s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:39:31 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-e19d8a61-673c-4271-b8a5-3691fa3d8651 tempest-VolumesActionsTest-987278039 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:39:31 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-e19d8a61-673c-4271-b8a5-3691fa3d8651 tempest-VolumesActionsTest-987278039 None] Deleted volume successfully. Sep 23 14:39:31 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-e19d8a61-673c-4271-b8a5-3691fa3d8651 tempest-VolumesActionsTest-987278039 None] Lock "cinder-013ef4c3-c815-465c-af46-e21c439048e8-delete_volume" released by "delete_volume" :: held 1.349s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:39:31 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-bdf36016-1330-41e2-92cb-e250e4068386 tempest-VolumesActionsTest-1930790160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:39:31 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-bdf36016-1330-41e2-92cb-e250e4068386 tempest-VolumesActionsTest-1930790160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.002s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:39:32 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e8f1a7b-47f5-46e4-a9bd-9867af7e1e5c]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:39:32 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-bdf36016-1330-41e2-92cb-e250e4068386 tempest-VolumesActionsTest-1930790160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-91658ecc-b212-4cec-ab79-495726afbe66 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:39:32 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-c7fc4caa-fb19-473b-8f57-8c2681e8d6fa tempest-VolumeQuotasAdminTestJSON-1099870861 None] Transfer volume completed successfully. Sep 23 14:39:32 devstack sudo[96681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-91658ecc-b212-4cec-ab79-495726afbe66 Sep 23 14:39:32 devstack sudo[96681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:39:32 devstack sudo[96681]: pam_unix(sudo:session): session closed for user root Sep 23 14:39:32 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-bdf36016-1330-41e2-92cb-e250e4068386 tempest-VolumesActionsTest-1930790160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-91658ecc-b212-4cec-ab79-495726afbe66" returned: 0 in 0.498s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:39:32 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[536f3b72-0fc9-4be7-a5cd-2dcf21170e9b]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:39:32 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-bdf36016-1330-41e2-92cb-e250e4068386 tempest-VolumesActionsTest-1930790160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-91658ecc-b212-4cec-ab79-495726afbe66 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:39:32 devstack sudo[96688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-91658ecc-b212-4cec-ab79-495726afbe66 Sep 23 14:39:32 devstack sudo[96688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:39:32 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-1b96e6f9-d931-4c6b-a585-a5d199df7af1 tempest-VolumeQuotasAdminTestJSON-1295757964 None] Acquiring lock "cinder-512ad90d-1e26-43e6-a8a9-b24471108305-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:39:32 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-1b96e6f9-d931-4c6b-a585-a5d199df7af1 tempest-VolumeQuotasAdminTestJSON-1295757964 None] Lock "cinder-512ad90d-1e26-43e6-a8a9-b24471108305-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:39:32 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-1b96e6f9-d931-4c6b-a585-a5d199df7af1 tempest-VolumeQuotasAdminTestJSON-1295757964 None] Acquiring lock "cinder-quobyte-512ad90d-1e26-43e6-a8a9-b24471108305" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:39:32 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-1b96e6f9-d931-4c6b-a585-a5d199df7af1 tempest-VolumeQuotasAdminTestJSON-1295757964 None] Lock "cinder-quobyte-512ad90d-1e26-43e6-a8a9-b24471108305" acquired by "delete_volume" :: waited 0.019s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:39:32 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[86765f60-f9d6-4bb7-9706-1b500d42debf]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:39:32 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-1b96e6f9-d931-4c6b-a585-a5d199df7af1 tempest-VolumeQuotasAdminTestJSON-1295757964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-512ad90d-1e26-43e6-a8a9-b24471108305 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:39:32 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c500e43-151d-4c2b-a61c-0f1015d5fda5 tempest-VolumesActionsTest-190168521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:39:32 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-3c500e43-151d-4c2b-a61c-0f1015d5fda5 tempest-VolumesActionsTest-190168521 None] Flow 'volume_create_manager' (1d4c8e0f-5677-421b-823d-b9c4ccb05fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:39:32 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-3c500e43-151d-4c2b-a61c-0f1015d5fda5 tempest-VolumesActionsTest-190168521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eaa585a6-40b4-469a-a61e-ef6beed5282d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:39:33 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-3c500e43-151d-4c2b-a61c-0f1015d5fda5 tempest-VolumesActionsTest-190168521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eaa585a6-40b4-469a-a61e-ef6beed5282d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:39:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-942244634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5e4e422-997a-41ab-b30c-03cdfc9e00bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4885c86c91f4245bdc43ff368fc3b8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:39:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:39:33Z,use_quota=True,user_id='fa72e470c3174d72aad0add017605822',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:39:33 devstack sudo[96688]: pam_unix(sudo:session): session closed for user root Sep 23 14:39:33 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-3c500e43-151d-4c2b-a61c-0f1015d5fda5 tempest-VolumesActionsTest-190168521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c090e17-893a-494c-8b4f-94d1103ca2ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:39:33 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-3c500e43-151d-4c2b-a61c-0f1015d5fda5 tempest-VolumesActionsTest-190168521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c090e17-893a-494c-8b4f-94d1103ca2ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:39:33 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-3c500e43-151d-4c2b-a61c-0f1015d5fda5 tempest-VolumesActionsTest-190168521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2ee1ff2-a15d-4ee2-a862-a552538f0b0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:39:33 devstack sudo[96692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-512ad90d-1e26-43e6-a8a9-b24471108305 Sep 23 14:39:33 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-3c500e43-151d-4c2b-a61c-0f1015d5fda5 tempest-VolumesActionsTest-190168521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2ee1ff2-a15d-4ee2-a862-a552538f0b0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5e4e422-997a-41ab-b30c-03cdfc9e00bd', 'volume_name': 'volume-c5e4e422-997a-41ab-b30c-03cdfc9e00bd', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:39:33 devstack sudo[96692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:39:33 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-3c500e43-151d-4c2b-a61c-0f1015d5fda5 tempest-VolumesActionsTest-190168521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adbb163a-ab27-4211-b011-f5bce16cfae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:39:33 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-3c500e43-151d-4c2b-a61c-0f1015d5fda5 tempest-VolumesActionsTest-190168521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adbb163a-ab27-4211-b011-f5bce16cfae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:39:33 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-3c500e43-151d-4c2b-a61c-0f1015d5fda5 tempest-VolumesActionsTest-190168521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (651509b1-accd-4c76-bda5-fcbc8a055afa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:39:33 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-3c500e43-151d-4c2b-a61c-0f1015d5fda5 tempest-VolumesActionsTest-190168521 None] Volume c5e4e422-997a-41ab-b30c-03cdfc9e00bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5e4e422-997a-41ab-b30c-03cdfc9e00bd', 'volume_size': 1} Sep 23 14:39:33 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-3c500e43-151d-4c2b-a61c-0f1015d5fda5 tempest-VolumesActionsTest-190168521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:39:33 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-bdf36016-1330-41e2-92cb-e250e4068386 tempest-VolumesActionsTest-1930790160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-91658ecc-b212-4cec-ab79-495726afbe66" returned: 0 in 0.504s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:39:33 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-bdf36016-1330-41e2-92cb-e250e4068386 tempest-VolumesActionsTest-1930790160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-91658ecc-b212-4cec-ab79-495726afbe66 /opt/stack/data/cinder/conversion/91658ecc-b212-4cec-ab79-495726afbe66.temp_image.4bc8ec82-e130-44fe-abdc-59e5a59581e9cx5t9zwz.img {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:39:33 devstack sudo[96695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-91658ecc-b212-4cec-ab79-495726afbe66 /opt/stack/data/cinder/conversion/91658ecc-b212-4cec-ab79-495726afbe66.temp_image.4bc8ec82-e130-44fe-abdc-59e5a59581e9cx5t9zwz.img Sep 23 14:39:33 devstack sudo[96695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:39:33 devstack sudo[96692]: pam_unix(sudo:session): session closed for user root Sep 23 14:39:33 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-1b96e6f9-d931-4c6b-a585-a5d199df7af1 tempest-VolumeQuotasAdminTestJSON-1295757964 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-512ad90d-1e26-43e6-a8a9-b24471108305" returned: 0 in 0.433s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:39:33 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-1b96e6f9-d931-4c6b-a585-a5d199df7af1 tempest-VolumeQuotasAdminTestJSON-1295757964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-512ad90d-1e26-43e6-a8a9-b24471108305 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:39:33 devstack sudo[96709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-512ad90d-1e26-43e6-a8a9-b24471108305 Sep 23 14:39:33 devstack sudo[96709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:39:33 devstack sudo[96709]: pam_unix(sudo:session): session closed for user root Sep 23 14:39:33 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-1b96e6f9-d931-4c6b-a585-a5d199df7af1 tempest-VolumeQuotasAdminTestJSON-1295757964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-512ad90d-1e26-43e6-a8a9-b24471108305" returned: 0 in 0.587s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:39:33 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-1b96e6f9-d931-4c6b-a585-a5d199df7af1 tempest-VolumeQuotasAdminTestJSON-1295757964 None] Lock "cinder-quobyte-512ad90d-1e26-43e6-a8a9-b24471108305" released by "delete_volume" :: held 1.116s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:39:34 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-1b96e6f9-d931-4c6b-a585-a5d199df7af1 tempest-VolumeQuotasAdminTestJSON-1295757964 None] Created reservations ['1e1287b6-ff40-46c2-9ef2-3925c509c223', '0de24a7f-660d-46f3-9645-158bf2ee5d9b', '9ae2581f-f926-4506-b9fe-6926c8cdad07', '2e5b8fb2-403a-47f7-b577-a71aca6199ac'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:39:34 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-1b96e6f9-d931-4c6b-a585-a5d199df7af1 tempest-VolumeQuotasAdminTestJSON-1295757964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:39:34 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-1b96e6f9-d931-4c6b-a585-a5d199df7af1 tempest-VolumeQuotasAdminTestJSON-1295757964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:39:34 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-1b96e6f9-d931-4c6b-a585-a5d199df7af1 tempest-VolumeQuotasAdminTestJSON-1295757964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:39:34 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-1b96e6f9-d931-4c6b-a585-a5d199df7af1 tempest-VolumeQuotasAdminTestJSON-1295757964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:39:34 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-1b96e6f9-d931-4c6b-a585-a5d199df7af1 tempest-VolumeQuotasAdminTestJSON-1295757964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:39:34 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-1b96e6f9-d931-4c6b-a585-a5d199df7af1 tempest-VolumeQuotasAdminTestJSON-1295757964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:39:34 devstack sudo[96719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:39:34 devstack sudo[96719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:39:34 devstack sudo[96719]: pam_unix(sudo:session): session closed for user root Sep 23 14:39:34 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-1b96e6f9-d931-4c6b-a585-a5d199df7af1 tempest-VolumeQuotasAdminTestJSON-1295757964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.487s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:39:34 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-1b96e6f9-d931-4c6b-a585-a5d199df7af1 tempest-VolumeQuotasAdminTestJSON-1295757964 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:39:34 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-1b96e6f9-d931-4c6b-a585-a5d199df7af1 tempest-VolumeQuotasAdminTestJSON-1295757964 None] Deleted volume successfully. Sep 23 14:39:34 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-1b96e6f9-d931-4c6b-a585-a5d199df7af1 tempest-VolumeQuotasAdminTestJSON-1295757964 None] Lock "cinder-512ad90d-1e26-43e6-a8a9-b24471108305-delete_volume" released by "delete_volume" :: held 2.109s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:39:34 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [req-03cb3d6f-4dba-403f-a0bf-6e55b612beca req-f385678c-e760-43b9-a4a1-490560d65b4d tempest-VolumesGetTestJSON-1778309354 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:39:34 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [req-03cb3d6f-4dba-403f-a0bf-6e55b612beca req-f385678c-e760-43b9-a4a1-490560d65b4d tempest-VolumesGetTestJSON-1778309354 None] Flow 'volume_create_manager' (4798b136-6cb5-4636-b61b-efb73cc61fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:39:35 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [req-03cb3d6f-4dba-403f-a0bf-6e55b612beca req-f385678c-e760-43b9-a4a1-490560d65b4d tempest-VolumesGetTestJSON-1778309354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ab23208-7955-4bc2-b250-9983e896f4f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:39:35 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [req-03cb3d6f-4dba-403f-a0bf-6e55b612beca req-f385678c-e760-43b9-a4a1-490560d65b4d tempest-VolumesGetTestJSON-1778309354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ab23208-7955-4bc2-b250-9983e896f4f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:39:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1791864976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f5ce37a-b880-4b13-9175-318cf4de1b01,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7590dd2aa81f429baf6354f1bbcb79b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:39:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:39:35Z,use_quota=True,user_id='a3bc1098d37c4c5cae57c67f5e8568fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:39:35 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [req-03cb3d6f-4dba-403f-a0bf-6e55b612beca req-f385678c-e760-43b9-a4a1-490560d65b4d tempest-VolumesGetTestJSON-1778309354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdee83e4-835c-487d-b4de-10b145eb3fb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:39:35 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [req-03cb3d6f-4dba-403f-a0bf-6e55b612beca req-f385678c-e760-43b9-a4a1-490560d65b4d tempest-VolumesGetTestJSON-1778309354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdee83e4-835c-487d-b4de-10b145eb3fb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:39:35 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [req-03cb3d6f-4dba-403f-a0bf-6e55b612beca req-f385678c-e760-43b9-a4a1-490560d65b4d tempest-VolumesGetTestJSON-1778309354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e387a2c-635b-49d0-bb87-c04c8df1d4e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:39:35 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [req-03cb3d6f-4dba-403f-a0bf-6e55b612beca req-f385678c-e760-43b9-a4a1-490560d65b4d tempest-VolumesGetTestJSON-1778309354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e387a2c-635b-49d0-bb87-c04c8df1d4e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f5ce37a-b880-4b13-9175-318cf4de1b01', 'volume_name': 'volume-0f5ce37a-b880-4b13-9175-318cf4de1b01', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:39:35 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [req-03cb3d6f-4dba-403f-a0bf-6e55b612beca req-f385678c-e760-43b9-a4a1-490560d65b4d tempest-VolumesGetTestJSON-1778309354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc87109c-78fe-4727-81f8-79a6edab0b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:39:35 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [req-03cb3d6f-4dba-403f-a0bf-6e55b612beca req-f385678c-e760-43b9-a4a1-490560d65b4d tempest-VolumesGetTestJSON-1778309354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc87109c-78fe-4727-81f8-79a6edab0b70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:39:35 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [req-03cb3d6f-4dba-403f-a0bf-6e55b612beca req-f385678c-e760-43b9-a4a1-490560d65b4d tempest-VolumesGetTestJSON-1778309354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9567a13e-1119-40ab-ab4f-34c0b5f27cdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:39:35 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [req-03cb3d6f-4dba-403f-a0bf-6e55b612beca req-f385678c-e760-43b9-a4a1-490560d65b4d tempest-VolumesGetTestJSON-1778309354 None] Volume 0f5ce37a-b880-4b13-9175-318cf4de1b01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f5ce37a-b880-4b13-9175-318cf4de1b01', 'volume_size': 1} Sep 23 14:39:35 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [req-03cb3d6f-4dba-403f-a0bf-6e55b612beca req-f385678c-e760-43b9-a4a1-490560d65b4d tempest-VolumesGetTestJSON-1778309354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:39:40 devstack sudo[96695]: pam_unix(sudo:session): session closed for user root Sep 23 14:39:40 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-bdf36016-1330-41e2-92cb-e250e4068386 tempest-VolumesActionsTest-1930790160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-91658ecc-b212-4cec-ab79-495726afbe66 /opt/stack/data/cinder/conversion/91658ecc-b212-4cec-ab79-495726afbe66.temp_image.4bc8ec82-e130-44fe-abdc-59e5a59581e9cx5t9zwz.img" returned: 0 in 7.411s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:39:40 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[203106c8-9256-4255-85b9-db4457db3a23]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:39:40 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-bdf36016-1330-41e2-92cb-e250e4068386 tempest-VolumesActionsTest-1930790160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-91658ecc-b212-4cec-ab79-495726afbe66 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:39:40 devstack sudo[96724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-91658ecc-b212-4cec-ab79-495726afbe66 Sep 23 14:39:40 devstack sudo[96724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:39:41 devstack sudo[96724]: pam_unix(sudo:session): session closed for user root Sep 23 14:39:41 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-bdf36016-1330-41e2-92cb-e250e4068386 tempest-VolumesActionsTest-1930790160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-91658ecc-b212-4cec-ab79-495726afbe66" returned: 0 in 0.556s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:39:41 devstack cinder-volume[86310]: DEBUG cinder.image.image_utils [None req-bdf36016-1330-41e2-92cb-e250e4068386 tempest-VolumesActionsTest-1930790160 None] Image conversion details: src /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-91658ecc-b212-4cec-ab79-495726afbe66, size 1024.00 MB, duration 7.41 sec, destination /opt/stack/data/cinder/conversion/91658ecc-b212-4cec-ab79-495726afbe66.temp_image.4bc8ec82-e130-44fe-abdc-59e5a59581e9cx5t9zwz.img {{(pid=86310) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 14:39:41 devstack cinder-volume[86310]: INFO cinder.image.image_utils [None req-bdf36016-1330-41e2-92cb-e250e4068386 tempest-VolumesActionsTest-1930790160 None] Converted 1024.00 MB image at 138.17 MB/s Sep 23 14:39:41 devstack cinder-volume[86310]: DEBUG dbcounter [-] [86310] Writing DB stats cinder:SELECT=112,cinder:INSERT=30,cinder:UPDATE=109,cinder:DELETE=7 {{(pid=86310) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 14:39:41 devstack cinder-volume[86310]: DEBUG dbcounter [-] [86310] Writing DB stats cinder:INSERT=25,cinder:UPDATE=135,cinder:SELECT=102,cinder:DELETE=11 {{(pid=86310) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 14:39:41 devstack cinder-volume[86310]: DEBUG cinder.image.image_utils [None req-bdf36016-1330-41e2-92cb-e250e4068386 tempest-VolumesActionsTest-1930790160 None] 4bc8ec82-e130-44fe-abdc-59e5a59581e9 was raw, no need to convert to raw {{(pid=86310) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 23 14:39:45 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cead2af-c396-4471-90de-909fbd37f4d0 tempest-VolumeTypesAccessTest-1714258647 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:39:45 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-1cead2af-c396-4471-90de-909fbd37f4d0 tempest-VolumeTypesAccessTest-1714258647 None] Flow 'volume_create_manager' (5f7a9005-f8b2-4248-a8e9-c3fda970b200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:39:45 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-1cead2af-c396-4471-90de-909fbd37f4d0 tempest-VolumeTypesAccessTest-1714258647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d345f225-1fe1-463e-aafa-52281b117c13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:39:45 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-1cead2af-c396-4471-90de-909fbd37f4d0 tempest-VolumeTypesAccessTest-1714258647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d345f225-1fe1-463e-aafa-52281b117c13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:39:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-200064115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0563ac47-1040-4579-ac64-bfa523c814ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6df6fc3d762c42aeb8c006a7b1992250',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:39:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:39:45Z,use_quota=True,user_id='9b98911f848b4faeb0dcc44ad67a4aea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(086a809e-111b-428a-abfe-eea9fdb31354),volume_type_id=086a809e-111b-428a-abfe-eea9fdb31354)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:39:45 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-1cead2af-c396-4471-90de-909fbd37f4d0 tempest-VolumeTypesAccessTest-1714258647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8880b6a-d8de-420b-98f2-a2cd1c7e08c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:39:45 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-1cead2af-c396-4471-90de-909fbd37f4d0 tempest-VolumeTypesAccessTest-1714258647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8880b6a-d8de-420b-98f2-a2cd1c7e08c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:39:45 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-1cead2af-c396-4471-90de-909fbd37f4d0 tempest-VolumeTypesAccessTest-1714258647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ee02ca3-a382-473d-9933-e37fd159a710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:39:45 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-1cead2af-c396-4471-90de-909fbd37f4d0 tempest-VolumeTypesAccessTest-1714258647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ee02ca3-a382-473d-9933-e37fd159a710) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0563ac47-1040-4579-ac64-bfa523c814ee', 'volume_name': 'volume-0563ac47-1040-4579-ac64-bfa523c814ee', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:39:45 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-1cead2af-c396-4471-90de-909fbd37f4d0 tempest-VolumeTypesAccessTest-1714258647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e7e8d15-9bb0-47bb-a4bc-624c69c1ca7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:39:45 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-1cead2af-c396-4471-90de-909fbd37f4d0 tempest-VolumeTypesAccessTest-1714258647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e7e8d15-9bb0-47bb-a4bc-624c69c1ca7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:39:45 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-1cead2af-c396-4471-90de-909fbd37f4d0 tempest-VolumeTypesAccessTest-1714258647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6ed58ba-1933-42e0-9d92-af1e99dc2ade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:39:45 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-1cead2af-c396-4471-90de-909fbd37f4d0 tempest-VolumeTypesAccessTest-1714258647 None] Volume 0563ac47-1040-4579-ac64-bfa523c814ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0563ac47-1040-4579-ac64-bfa523c814ee', 'volume_size': 1} Sep 23 14:39:45 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-1cead2af-c396-4471-90de-909fbd37f4d0 tempest-VolumeTypesAccessTest-1714258647 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:39:51 devstack cinder-volume[86310]: DEBUG oslo_service.periodic_task [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86310) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 14:39:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:39:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:39:51 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:39:51 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:39:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:39:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:39:51 devstack sudo[96732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:39:51 devstack sudo[96732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:39:51 devstack sudo[96732]: pam_unix(sudo:session): session closed for user root Sep 23 14:39:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.287s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:39:51 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:39:51 devstack cinder-volume[86310]: DEBUG oslo_service.periodic_task [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Running periodic task VolumeManager._thread_info {{(pid=86310) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 14:39:51 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] thread count: 28 {{(pid=86310) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 14:39:51 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] thread info: [<_MainThread(MainThread, started 128854208852096)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86310) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 14:39:55 devstack cinder-volume[86310]: DEBUG dbcounter [-] [86310] Writing DB stats cinder:UPDATE=1 {{(pid=86310) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 14:39:55 devstack cinder-volume[86310]: DEBUG dbcounter [-] [86310] Writing DB stats cinder:SELECT=2 {{(pid=86310) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 14:40:00 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-bdf36016-1330-41e2-92cb-e250e4068386 tempest-VolumesActionsTest-1930790160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 28.505s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:40:00 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-bdf36016-1330-41e2-92cb-e250e4068386 tempest-VolumesActionsTest-1930790160 None] Uploaded volume to glance image-id: 4bc8ec82-e130-44fe-abdc-59e5a59581e9. {{(pid=86310) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 23 14:40:00 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-3c500e43-151d-4c2b-a61c-0f1015d5fda5 tempest-VolumesActionsTest-190168521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 27.438s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:40:00 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-3c500e43-151d-4c2b-a61c-0f1015d5fda5 tempest-VolumesActionsTest-190168521 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:39:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-942244634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5e4e422-997a-41ab-b30c-03cdfc9e00bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4885c86c91f4245bdc43ff368fc3b8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:39:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:39:33Z,use_quota=True,user_id='fa72e470c3174d72aad0add017605822',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:40:00 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-3c500e43-151d-4c2b-a61c-0f1015d5fda5 tempest-VolumesActionsTest-190168521 None] Creating volume c5e4e422-997a-41ab-b30c-03cdfc9e00bd {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:40:00 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-3c500e43-151d-4c2b-a61c-0f1015d5fda5 tempest-VolumesActionsTest-190168521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:40:00 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-3c500e43-151d-4c2b-a61c-0f1015d5fda5 tempest-VolumesActionsTest-190168521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:40:00 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-3c500e43-151d-4c2b-a61c-0f1015d5fda5 tempest-VolumesActionsTest-190168521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:40:00 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-3c500e43-151d-4c2b-a61c-0f1015d5fda5 tempest-VolumesActionsTest-190168521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:40:00 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-3c500e43-151d-4c2b-a61c-0f1015d5fda5 tempest-VolumesActionsTest-190168521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:40:00 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-3c500e43-151d-4c2b-a61c-0f1015d5fda5 tempest-VolumesActionsTest-190168521 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:40:00 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-3c500e43-151d-4c2b-a61c-0f1015d5fda5 tempest-VolumesActionsTest-190168521 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:40:00 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-3c500e43-151d-4c2b-a61c-0f1015d5fda5 tempest-VolumesActionsTest-190168521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-c5e4e422-997a-41ab-b30c-03cdfc9e00bd 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:40:00 devstack sudo[96736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-c5e4e422-997a-41ab-b30c-03cdfc9e00bd 1073741824 Sep 23 14:40:00 devstack sudo[96736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:40:00 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-bdf36016-1330-41e2-92cb-e250e4068386 tempest-VolumesActionsTest-1930790160 None] Copy volume to image completed successfully. Sep 23 14:40:00 devstack sudo[96736]: pam_unix(sudo:session): session closed for user root Sep 23 14:40:00 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-3c500e43-151d-4c2b-a61c-0f1015d5fda5 tempest-VolumesActionsTest-190168521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-c5e4e422-997a-41ab-b30c-03cdfc9e00bd 1073741824" returned: 0 in 0.412s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:40:00 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-3c500e43-151d-4c2b-a61c-0f1015d5fda5 tempest-VolumesActionsTest-190168521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-c5e4e422-997a-41ab-b30c-03cdfc9e00bd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:40:00 devstack sudo[96741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-c5e4e422-997a-41ab-b30c-03cdfc9e00bd Sep 23 14:40:00 devstack sudo[96741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:40:01 devstack sudo[96741]: pam_unix(sudo:session): session closed for user root Sep 23 14:40:01 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-3c500e43-151d-4c2b-a61c-0f1015d5fda5 tempest-VolumesActionsTest-190168521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-c5e4e422-997a-41ab-b30c-03cdfc9e00bd" returned: 0 in 0.257s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:40:01 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-3c500e43-151d-4c2b-a61c-0f1015d5fda5 tempest-VolumesActionsTest-190168521 None] <== create_volume: return (710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:40:01 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-3c500e43-151d-4c2b-a61c-0f1015d5fda5 tempest-VolumesActionsTest-190168521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.712s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:40:01 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [req-03cb3d6f-4dba-403f-a0bf-6e55b612beca req-f385678c-e760-43b9-a4a1-490560d65b4d tempest-VolumesGetTestJSON-1778309354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 26.089s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:40:01 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [req-03cb3d6f-4dba-403f-a0bf-6e55b612beca req-f385678c-e760-43b9-a4a1-490560d65b4d tempest-VolumesGetTestJSON-1778309354 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:39:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1791864976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f5ce37a-b880-4b13-9175-318cf4de1b01,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7590dd2aa81f429baf6354f1bbcb79b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:39:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:39:35Z,use_quota=True,user_id='a3bc1098d37c4c5cae57c67f5e8568fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:40:01 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [req-03cb3d6f-4dba-403f-a0bf-6e55b612beca req-f385678c-e760-43b9-a4a1-490560d65b4d tempest-VolumesGetTestJSON-1778309354 None] Creating volume 0f5ce37a-b880-4b13-9175-318cf4de1b01 {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:40:01 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [req-03cb3d6f-4dba-403f-a0bf-6e55b612beca req-f385678c-e760-43b9-a4a1-490560d65b4d tempest-VolumesGetTestJSON-1778309354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:40:01 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [req-03cb3d6f-4dba-403f-a0bf-6e55b612beca req-f385678c-e760-43b9-a4a1-490560d65b4d tempest-VolumesGetTestJSON-1778309354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:40:01 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [req-03cb3d6f-4dba-403f-a0bf-6e55b612beca req-f385678c-e760-43b9-a4a1-490560d65b4d tempest-VolumesGetTestJSON-1778309354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:40:01 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [req-03cb3d6f-4dba-403f-a0bf-6e55b612beca req-f385678c-e760-43b9-a4a1-490560d65b4d tempest-VolumesGetTestJSON-1778309354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:40:01 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [req-03cb3d6f-4dba-403f-a0bf-6e55b612beca req-f385678c-e760-43b9-a4a1-490560d65b4d tempest-VolumesGetTestJSON-1778309354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:40:01 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [req-03cb3d6f-4dba-403f-a0bf-6e55b612beca req-f385678c-e760-43b9-a4a1-490560d65b4d tempest-VolumesGetTestJSON-1778309354 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:40:01 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [req-03cb3d6f-4dba-403f-a0bf-6e55b612beca req-f385678c-e760-43b9-a4a1-490560d65b4d tempest-VolumesGetTestJSON-1778309354 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:40:01 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [req-03cb3d6f-4dba-403f-a0bf-6e55b612beca req-f385678c-e760-43b9-a4a1-490560d65b4d tempest-VolumesGetTestJSON-1778309354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-0f5ce37a-b880-4b13-9175-318cf4de1b01 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:40:01 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-3c500e43-151d-4c2b-a61c-0f1015d5fda5 tempest-VolumesActionsTest-190168521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (651509b1-accd-4c76-bda5-fcbc8a055afa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5e4e422-997a-41ab-b30c-03cdfc9e00bd', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:40:01 devstack sudo[96744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-0f5ce37a-b880-4b13-9175-318cf4de1b01 1073741824 Sep 23 14:40:01 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-3c500e43-151d-4c2b-a61c-0f1015d5fda5 tempest-VolumesActionsTest-190168521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01ae3a9f-35d0-416f-9eff-05fea01f6cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:40:01 devstack sudo[96744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:40:01 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-3c500e43-151d-4c2b-a61c-0f1015d5fda5 tempest-VolumesActionsTest-190168521 None] Volume volume-c5e4e422-997a-41ab-b30c-03cdfc9e00bd (c5e4e422-997a-41ab-b30c-03cdfc9e00bd): created successfully Sep 23 14:40:01 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-3c500e43-151d-4c2b-a61c-0f1015d5fda5 tempest-VolumesActionsTest-190168521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01ae3a9f-35d0-416f-9eff-05fea01f6cde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:40:01 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-3c500e43-151d-4c2b-a61c-0f1015d5fda5 tempest-VolumesActionsTest-190168521 None] Flow 'volume_create_manager' (1d4c8e0f-5677-421b-823d-b9c4ccb05fcb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:40:01 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-3c500e43-151d-4c2b-a61c-0f1015d5fda5 tempest-VolumesActionsTest-190168521 None] Created volume successfully. Sep 23 14:40:01 devstack sudo[96744]: pam_unix(sudo:session): session closed for user root Sep 23 14:40:01 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [req-03cb3d6f-4dba-403f-a0bf-6e55b612beca req-f385678c-e760-43b9-a4a1-490560d65b4d tempest-VolumesGetTestJSON-1778309354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-0f5ce37a-b880-4b13-9175-318cf4de1b01 1073741824" returned: 0 in 0.475s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:40:01 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [req-03cb3d6f-4dba-403f-a0bf-6e55b612beca req-f385678c-e760-43b9-a4a1-490560d65b4d tempest-VolumesGetTestJSON-1778309354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-0f5ce37a-b880-4b13-9175-318cf4de1b01 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:40:01 devstack sudo[96750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-0f5ce37a-b880-4b13-9175-318cf4de1b01 Sep 23 14:40:01 devstack sudo[96750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:40:01 devstack sudo[96750]: pam_unix(sudo:session): session closed for user root Sep 23 14:40:01 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [req-03cb3d6f-4dba-403f-a0bf-6e55b612beca req-f385678c-e760-43b9-a4a1-490560d65b4d tempest-VolumesGetTestJSON-1778309354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-0f5ce37a-b880-4b13-9175-318cf4de1b01" returned: 0 in 0.245s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:40:01 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [req-03cb3d6f-4dba-403f-a0bf-6e55b612beca req-f385678c-e760-43b9-a4a1-490560d65b4d tempest-VolumesGetTestJSON-1778309354 None] <== create_volume: return (776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:40:01 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [req-03cb3d6f-4dba-403f-a0bf-6e55b612beca req-f385678c-e760-43b9-a4a1-490560d65b4d tempest-VolumesGetTestJSON-1778309354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.780s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:40:01 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-1cead2af-c396-4471-90de-909fbd37f4d0 tempest-VolumeTypesAccessTest-1714258647 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.552s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:40:01 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-1cead2af-c396-4471-90de-909fbd37f4d0 tempest-VolumeTypesAccessTest-1714258647 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:39:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-200064115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0563ac47-1040-4579-ac64-bfa523c814ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6df6fc3d762c42aeb8c006a7b1992250',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:39:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:39:45Z,use_quota=True,user_id='9b98911f848b4faeb0dcc44ad67a4aea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(086a809e-111b-428a-abfe-eea9fdb31354),volume_type_id=086a809e-111b-428a-abfe-eea9fdb31354)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:40:01 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-1cead2af-c396-4471-90de-909fbd37f4d0 tempest-VolumeTypesAccessTest-1714258647 None] Creating volume 0563ac47-1040-4579-ac64-bfa523c814ee {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:40:01 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-1cead2af-c396-4471-90de-909fbd37f4d0 tempest-VolumeTypesAccessTest-1714258647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:40:01 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-1cead2af-c396-4471-90de-909fbd37f4d0 tempest-VolumeTypesAccessTest-1714258647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:40:01 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-1cead2af-c396-4471-90de-909fbd37f4d0 tempest-VolumeTypesAccessTest-1714258647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:40:01 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-1cead2af-c396-4471-90de-909fbd37f4d0 tempest-VolumeTypesAccessTest-1714258647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:40:01 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-1cead2af-c396-4471-90de-909fbd37f4d0 tempest-VolumeTypesAccessTest-1714258647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:40:01 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-1cead2af-c396-4471-90de-909fbd37f4d0 tempest-VolumeTypesAccessTest-1714258647 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:40:01 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-1cead2af-c396-4471-90de-909fbd37f4d0 tempest-VolumeTypesAccessTest-1714258647 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:40:01 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-1cead2af-c396-4471-90de-909fbd37f4d0 tempest-VolumeTypesAccessTest-1714258647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-0563ac47-1040-4579-ac64-bfa523c814ee 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:40:02 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [req-03cb3d6f-4dba-403f-a0bf-6e55b612beca req-f385678c-e760-43b9-a4a1-490560d65b4d tempest-VolumesGetTestJSON-1778309354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9567a13e-1119-40ab-ab4f-34c0b5f27cdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f5ce37a-b880-4b13-9175-318cf4de1b01', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:40:02 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [req-03cb3d6f-4dba-403f-a0bf-6e55b612beca req-f385678c-e760-43b9-a4a1-490560d65b4d tempest-VolumesGetTestJSON-1778309354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b08f009a-b9e4-4764-af79-b5997f707891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:40:02 devstack sudo[96753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-0563ac47-1040-4579-ac64-bfa523c814ee 1073741824 Sep 23 14:40:02 devstack sudo[96753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:40:02 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [req-03cb3d6f-4dba-403f-a0bf-6e55b612beca req-f385678c-e760-43b9-a4a1-490560d65b4d tempest-VolumesGetTestJSON-1778309354 None] Volume volume-0f5ce37a-b880-4b13-9175-318cf4de1b01 (0f5ce37a-b880-4b13-9175-318cf4de1b01): created successfully Sep 23 14:40:02 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [req-03cb3d6f-4dba-403f-a0bf-6e55b612beca req-f385678c-e760-43b9-a4a1-490560d65b4d tempest-VolumesGetTestJSON-1778309354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b08f009a-b9e4-4764-af79-b5997f707891) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:40:02 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [req-03cb3d6f-4dba-403f-a0bf-6e55b612beca req-f385678c-e760-43b9-a4a1-490560d65b4d tempest-VolumesGetTestJSON-1778309354 None] Flow 'volume_create_manager' (4798b136-6cb5-4636-b61b-efb73cc61fcd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:40:02 devstack cinder-volume[86310]: INFO cinder.volume.manager [req-03cb3d6f-4dba-403f-a0bf-6e55b612beca req-f385678c-e760-43b9-a4a1-490560d65b4d tempest-VolumesGetTestJSON-1778309354 None] Created volume successfully. Sep 23 14:40:02 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-8682950c-c27e-406b-b5b8-8dcb24a9c668 tempest-VolumesActionsTest-1930790160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:40:02 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-2f437b0e-212e-44fd-a047-b3498864dc7d tempest-VolumesActionsTest-987278039 None] Acquiring lock "cinder-c5e4e422-997a-41ab-b30c-03cdfc9e00bd-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:40:02 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-2f437b0e-212e-44fd-a047-b3498864dc7d tempest-VolumesActionsTest-987278039 None] Lock "cinder-c5e4e422-997a-41ab-b30c-03cdfc9e00bd-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:40:02 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-2f437b0e-212e-44fd-a047-b3498864dc7d tempest-VolumesActionsTest-987278039 None] Acquiring lock "cinder-quobyte-c5e4e422-997a-41ab-b30c-03cdfc9e00bd" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:40:02 devstack sudo[96753]: pam_unix(sudo:session): session closed for user root Sep 23 14:40:02 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-1cead2af-c396-4471-90de-909fbd37f4d0 tempest-VolumeTypesAccessTest-1714258647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-0563ac47-1040-4579-ac64-bfa523c814ee 1073741824" returned: 0 in 0.600s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:40:02 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-2f437b0e-212e-44fd-a047-b3498864dc7d tempest-VolumesActionsTest-987278039 None] Lock "cinder-quobyte-c5e4e422-997a-41ab-b30c-03cdfc9e00bd" acquired by "delete_volume" :: waited 0.029s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:40:02 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[d06c97eb-03d9-4f5e-90e3-f9de66af3bde]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:40:02 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-2f437b0e-212e-44fd-a047-b3498864dc7d tempest-VolumesActionsTest-987278039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-c5e4e422-997a-41ab-b30c-03cdfc9e00bd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:40:02 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-1cead2af-c396-4471-90de-909fbd37f4d0 tempest-VolumeTypesAccessTest-1714258647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-0563ac47-1040-4579-ac64-bfa523c814ee {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:40:02 devstack sudo[96761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-0563ac47-1040-4579-ac64-bfa523c814ee Sep 23 14:40:02 devstack sudo[96761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:40:02 devstack sudo[96760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-c5e4e422-997a-41ab-b30c-03cdfc9e00bd Sep 23 14:40:02 devstack sudo[96760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:40:02 devstack cinder-volume[86310]: DEBUG cinder.coordination [req-24a4db22-420b-4ea6-bf1b-6cf37c9fe3db req-a470b18b-4f04-407f-98fa-eb2ebb2384a2 tempest-VolumesGetTestJSON-1778309354 None] Acquiring lock "cinder-0f5ce37a-b880-4b13-9175-318cf4de1b01-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:40:02 devstack cinder-volume[86310]: DEBUG cinder.coordination [req-24a4db22-420b-4ea6-bf1b-6cf37c9fe3db req-a470b18b-4f04-407f-98fa-eb2ebb2384a2 tempest-VolumesGetTestJSON-1778309354 None] Lock "cinder-0f5ce37a-b880-4b13-9175-318cf4de1b01-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:40:02 devstack sudo[96761]: pam_unix(sudo:session): session closed for user root Sep 23 14:40:02 devstack cinder-volume[86310]: DEBUG cinder.coordination [req-24a4db22-420b-4ea6-bf1b-6cf37c9fe3db req-a470b18b-4f04-407f-98fa-eb2ebb2384a2 tempest-VolumesGetTestJSON-1778309354 None] Acquiring lock "cinder-quobyte-0f5ce37a-b880-4b13-9175-318cf4de1b01" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:40:02 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-1cead2af-c396-4471-90de-909fbd37f4d0 tempest-VolumeTypesAccessTest-1714258647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-0563ac47-1040-4579-ac64-bfa523c814ee" returned: 0 in 0.328s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:40:02 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-1cead2af-c396-4471-90de-909fbd37f4d0 tempest-VolumeTypesAccessTest-1714258647 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:40:02 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-1cead2af-c396-4471-90de-909fbd37f4d0 tempest-VolumeTypesAccessTest-1714258647 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.009s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:40:03 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-8682950c-c27e-406b-b5b8-8dcb24a9c668 tempest-VolumesActionsTest-1930790160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.553s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:40:03 devstack cinder-volume[86310]: DEBUG cinder.coordination [req-24a4db22-420b-4ea6-bf1b-6cf37c9fe3db req-a470b18b-4f04-407f-98fa-eb2ebb2384a2 tempest-VolumesGetTestJSON-1778309354 None] Lock "cinder-quobyte-0f5ce37a-b880-4b13-9175-318cf4de1b01" acquired by "delete_volume" :: waited 0.028s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:40:03 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd4d01fd-576e-433c-b04d-f0076ce201ce]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:40:03 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8682950c-c27e-406b-b5b8-8dcb24a9c668 tempest-VolumesActionsTest-1930790160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-91658ecc-b212-4cec-ab79-495726afbe66 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:40:03 devstack sudo[96760]: pam_unix(sudo:session): session closed for user root Sep 23 14:40:03 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-1cead2af-c396-4471-90de-909fbd37f4d0 tempest-VolumeTypesAccessTest-1714258647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6ed58ba-1933-42e0-9d92-af1e99dc2ade) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0563ac47-1040-4579-ac64-bfa523c814ee', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:40:03 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-1cead2af-c396-4471-90de-909fbd37f4d0 tempest-VolumeTypesAccessTest-1714258647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7bc783e-9c13-4cf5-9bac-60e24fb1372a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:40:03 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba9fe7cd-5349-4c77-859f-1253847bd2eb]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:40:03 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [req-24a4db22-420b-4ea6-bf1b-6cf37c9fe3db req-a470b18b-4f04-407f-98fa-eb2ebb2384a2 tempest-VolumesGetTestJSON-1778309354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-0f5ce37a-b880-4b13-9175-318cf4de1b01 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:40:03 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-2f437b0e-212e-44fd-a047-b3498864dc7d tempest-VolumesActionsTest-987278039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-c5e4e422-997a-41ab-b30c-03cdfc9e00bd" returned: 0 in 0.446s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:40:03 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-2f437b0e-212e-44fd-a047-b3498864dc7d tempest-VolumesActionsTest-987278039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-c5e4e422-997a-41ab-b30c-03cdfc9e00bd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:40:03 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-1cead2af-c396-4471-90de-909fbd37f4d0 tempest-VolumeTypesAccessTest-1714258647 None] Volume volume-0563ac47-1040-4579-ac64-bfa523c814ee (0563ac47-1040-4579-ac64-bfa523c814ee): created successfully Sep 23 14:40:03 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-1cead2af-c396-4471-90de-909fbd37f4d0 tempest-VolumeTypesAccessTest-1714258647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7bc783e-9c13-4cf5-9bac-60e24fb1372a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:40:03 devstack sudo[96770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-c5e4e422-997a-41ab-b30c-03cdfc9e00bd Sep 23 14:40:03 devstack sudo[96770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:40:03 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-1cead2af-c396-4471-90de-909fbd37f4d0 tempest-VolumeTypesAccessTest-1714258647 None] Flow 'volume_create_manager' (5f7a9005-f8b2-4248-a8e9-c3fda970b200) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:40:03 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-1cead2af-c396-4471-90de-909fbd37f4d0 tempest-VolumeTypesAccessTest-1714258647 None] Created volume successfully. Sep 23 14:40:03 devstack sudo[96768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-91658ecc-b212-4cec-ab79-495726afbe66 Sep 23 14:40:03 devstack sudo[96768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:40:03 devstack sudo[96769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-0f5ce37a-b880-4b13-9175-318cf4de1b01 Sep 23 14:40:03 devstack sudo[96769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:40:03 devstack sudo[96770]: pam_unix(sudo:session): session closed for user root Sep 23 14:40:03 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-2f437b0e-212e-44fd-a047-b3498864dc7d tempest-VolumesActionsTest-987278039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-c5e4e422-997a-41ab-b30c-03cdfc9e00bd" returned: 0 in 0.299s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:40:03 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-2f437b0e-212e-44fd-a047-b3498864dc7d tempest-VolumesActionsTest-987278039 None] Lock "cinder-quobyte-c5e4e422-997a-41ab-b30c-03cdfc9e00bd" released by "delete_volume" :: held 0.797s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:40:03 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-2f437b0e-212e-44fd-a047-b3498864dc7d tempest-VolumesActionsTest-987278039 None] Created reservations ['4c6b9398-35b6-4709-aa9c-4267f448371b', '7eefdccc-8486-4807-bebc-59fc477252ba', '68f74bf4-fdc1-43b0-9429-a6f1d6b2898c', '4e9644c3-0829-41cc-a95b-ce3fa9161298'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:40:03 devstack sudo[96768]: pam_unix(sudo:session): session closed for user root Sep 23 14:40:03 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8682950c-c27e-406b-b5b8-8dcb24a9c668 tempest-VolumesActionsTest-1930790160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-91658ecc-b212-4cec-ab79-495726afbe66" returned: 0 in 0.445s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:40:03 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[262732cb-6898-4fff-aca8-5128f7b77636]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:40:03 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8682950c-c27e-406b-b5b8-8dcb24a9c668 tempest-VolumesActionsTest-1930790160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-91658ecc-b212-4cec-ab79-495726afbe66 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:40:03 devstack sudo[96769]: pam_unix(sudo:session): session closed for user root Sep 23 14:40:03 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [req-24a4db22-420b-4ea6-bf1b-6cf37c9fe3db req-a470b18b-4f04-407f-98fa-eb2ebb2384a2 tempest-VolumesGetTestJSON-1778309354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-0f5ce37a-b880-4b13-9175-318cf4de1b01" returned: 0 in 0.467s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:40:03 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [req-24a4db22-420b-4ea6-bf1b-6cf37c9fe3db req-a470b18b-4f04-407f-98fa-eb2ebb2384a2 tempest-VolumesGetTestJSON-1778309354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-0f5ce37a-b880-4b13-9175-318cf4de1b01 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:40:03 devstack sudo[96782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-0f5ce37a-b880-4b13-9175-318cf4de1b01 Sep 23 14:40:03 devstack sudo[96782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:40:03 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-b72acf8f-edd9-4c47-82e5-aa45837ab0f1 tempest-VolumeTypesAccessTest-1714258647 None] Acquiring lock "cinder-0563ac47-1040-4579-ac64-bfa523c814ee-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:40:03 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-2f437b0e-212e-44fd-a047-b3498864dc7d tempest-VolumesActionsTest-987278039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:40:03 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-2f437b0e-212e-44fd-a047-b3498864dc7d tempest-VolumesActionsTest-987278039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:40:03 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-2f437b0e-212e-44fd-a047-b3498864dc7d tempest-VolumesActionsTest-987278039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:40:03 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-2f437b0e-212e-44fd-a047-b3498864dc7d tempest-VolumesActionsTest-987278039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:40:03 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-2f437b0e-212e-44fd-a047-b3498864dc7d tempest-VolumesActionsTest-987278039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:40:03 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-2f437b0e-212e-44fd-a047-b3498864dc7d tempest-VolumesActionsTest-987278039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:40:03 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-b72acf8f-edd9-4c47-82e5-aa45837ab0f1 tempest-VolumeTypesAccessTest-1714258647 None] Lock "cinder-0563ac47-1040-4579-ac64-bfa523c814ee-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:40:03 devstack sudo[96781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-91658ecc-b212-4cec-ab79-495726afbe66 Sep 23 14:40:03 devstack sudo[96781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:40:03 devstack sudo[96784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:40:03 devstack sudo[96784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:40:03 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-b72acf8f-edd9-4c47-82e5-aa45837ab0f1 tempest-VolumeTypesAccessTest-1714258647 None] Acquiring lock "cinder-quobyte-0563ac47-1040-4579-ac64-bfa523c814ee" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:40:03 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-b72acf8f-edd9-4c47-82e5-aa45837ab0f1 tempest-VolumeTypesAccessTest-1714258647 None] Lock "cinder-quobyte-0563ac47-1040-4579-ac64-bfa523c814ee" acquired by "delete_volume" :: waited 0.021s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:40:03 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5e1063c-9324-41f3-a18e-891830d2d3c3]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:40:03 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-b72acf8f-edd9-4c47-82e5-aa45837ab0f1 tempest-VolumeTypesAccessTest-1714258647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-0563ac47-1040-4579-ac64-bfa523c814ee {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:40:03 devstack sudo[96782]: pam_unix(sudo:session): session closed for user root Sep 23 14:40:03 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [req-24a4db22-420b-4ea6-bf1b-6cf37c9fe3db req-a470b18b-4f04-407f-98fa-eb2ebb2384a2 tempest-VolumesGetTestJSON-1778309354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-0f5ce37a-b880-4b13-9175-318cf4de1b01" returned: 0 in 0.359s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:40:03 devstack cinder-volume[86310]: DEBUG cinder.coordination [req-24a4db22-420b-4ea6-bf1b-6cf37c9fe3db req-a470b18b-4f04-407f-98fa-eb2ebb2384a2 tempest-VolumesGetTestJSON-1778309354 None] Lock "cinder-quobyte-0f5ce37a-b880-4b13-9175-318cf4de1b01" released by "delete_volume" :: held 0.905s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:40:03 devstack sudo[96784]: pam_unix(sudo:session): session closed for user root Sep 23 14:40:03 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-2f437b0e-212e-44fd-a047-b3498864dc7d tempest-VolumesActionsTest-987278039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.353s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:40:03 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-2f437b0e-212e-44fd-a047-b3498864dc7d tempest-VolumesActionsTest-987278039 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:40:04 devstack cinder-volume[86310]: DEBUG cinder.quota [req-24a4db22-420b-4ea6-bf1b-6cf37c9fe3db req-a470b18b-4f04-407f-98fa-eb2ebb2384a2 tempest-VolumesGetTestJSON-1778309354 None] Created reservations ['43c6d958-201e-42ec-9e01-d0617e3af1f4', 'd5cbbf62-4aac-4d56-bf37-653cd5b0772c', '6e9110e2-185f-45c3-9adf-1a2c703c4676', '0d3d6172-339d-4275-9600-f215781a8cc6'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:40:04 devstack sudo[96788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-0563ac47-1040-4579-ac64-bfa523c814ee Sep 23 14:40:04 devstack sudo[96788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:40:04 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-2f437b0e-212e-44fd-a047-b3498864dc7d tempest-VolumesActionsTest-987278039 None] Deleted volume successfully. Sep 23 14:40:04 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-2f437b0e-212e-44fd-a047-b3498864dc7d tempest-VolumesActionsTest-987278039 None] Lock "cinder-c5e4e422-997a-41ab-b30c-03cdfc9e00bd-delete_volume" released by "delete_volume" :: held 1.524s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:40:04 devstack sudo[96781]: pam_unix(sudo:session): session closed for user root Sep 23 14:40:04 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8682950c-c27e-406b-b5b8-8dcb24a9c668 tempest-VolumesActionsTest-1930790160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-91658ecc-b212-4cec-ab79-495726afbe66" returned: 0 in 0.596s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:40:04 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8682950c-c27e-406b-b5b8-8dcb24a9c668 tempest-VolumesActionsTest-1930790160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-91658ecc-b212-4cec-ab79-495726afbe66 /opt/stack/data/cinder/conversion/91658ecc-b212-4cec-ab79-495726afbe66.temp_image.b3eb8602-9f1a-4111-9872-487604de617d1w_6upsl.img {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:40:04 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [req-24a4db22-420b-4ea6-bf1b-6cf37c9fe3db req-a470b18b-4f04-407f-98fa-eb2ebb2384a2 tempest-VolumesGetTestJSON-1778309354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:40:04 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [req-24a4db22-420b-4ea6-bf1b-6cf37c9fe3db req-a470b18b-4f04-407f-98fa-eb2ebb2384a2 tempest-VolumesGetTestJSON-1778309354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:40:04 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [req-24a4db22-420b-4ea6-bf1b-6cf37c9fe3db req-a470b18b-4f04-407f-98fa-eb2ebb2384a2 tempest-VolumesGetTestJSON-1778309354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:40:04 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [req-24a4db22-420b-4ea6-bf1b-6cf37c9fe3db req-a470b18b-4f04-407f-98fa-eb2ebb2384a2 tempest-VolumesGetTestJSON-1778309354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:40:04 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [req-24a4db22-420b-4ea6-bf1b-6cf37c9fe3db req-a470b18b-4f04-407f-98fa-eb2ebb2384a2 tempest-VolumesGetTestJSON-1778309354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:40:04 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [req-24a4db22-420b-4ea6-bf1b-6cf37c9fe3db req-a470b18b-4f04-407f-98fa-eb2ebb2384a2 tempest-VolumesGetTestJSON-1778309354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:40:04 devstack sudo[96794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-91658ecc-b212-4cec-ab79-495726afbe66 /opt/stack/data/cinder/conversion/91658ecc-b212-4cec-ab79-495726afbe66.temp_image.b3eb8602-9f1a-4111-9872-487604de617d1w_6upsl.img Sep 23 14:40:04 devstack sudo[96794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:40:04 devstack sudo[96795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:40:04 devstack sudo[96795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:40:04 devstack sudo[96788]: pam_unix(sudo:session): session closed for user root Sep 23 14:40:04 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-b72acf8f-edd9-4c47-82e5-aa45837ab0f1 tempest-VolumeTypesAccessTest-1714258647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-0563ac47-1040-4579-ac64-bfa523c814ee" returned: 0 in 0.614s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:40:04 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-b72acf8f-edd9-4c47-82e5-aa45837ab0f1 tempest-VolumeTypesAccessTest-1714258647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-0563ac47-1040-4579-ac64-bfa523c814ee {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:40:04 devstack sudo[96802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-0563ac47-1040-4579-ac64-bfa523c814ee Sep 23 14:40:04 devstack sudo[96802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:40:04 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a8b70bf-1865-4625-859b-a40149aadb56 tempest-VolumesActionsTest-190168521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:40:04 devstack sudo[96795]: pam_unix(sudo:session): session closed for user root Sep 23 14:40:04 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-8a8b70bf-1865-4625-859b-a40149aadb56 tempest-VolumesActionsTest-190168521 None] Flow 'volume_create_manager' (ef1dad46-2423-49d9-971b-bf158113d99f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:40:04 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-8a8b70bf-1865-4625-859b-a40149aadb56 tempest-VolumesActionsTest-190168521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2247dd0-6e92-456a-beb2-e4862ccc442d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:40:04 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [req-24a4db22-420b-4ea6-bf1b-6cf37c9fe3db req-a470b18b-4f04-407f-98fa-eb2ebb2384a2 tempest-VolumesGetTestJSON-1778309354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.578s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:40:04 devstack cinder-volume[86310]: DEBUG cinder.manager [req-24a4db22-420b-4ea6-bf1b-6cf37c9fe3db req-a470b18b-4f04-407f-98fa-eb2ebb2384a2 tempest-VolumesGetTestJSON-1778309354 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:40:04 devstack cinder-volume[86310]: INFO cinder.volume.manager [req-24a4db22-420b-4ea6-bf1b-6cf37c9fe3db req-a470b18b-4f04-407f-98fa-eb2ebb2384a2 tempest-VolumesGetTestJSON-1778309354 None] Deleted volume successfully. Sep 23 14:40:04 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-8a8b70bf-1865-4625-859b-a40149aadb56 tempest-VolumesActionsTest-190168521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2247dd0-6e92-456a-beb2-e4862ccc442d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:40:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1723667672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5e070bf-da52-4f38-bf79-0b1eaad06175,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4885c86c91f4245bdc43ff368fc3b8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:40:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:40:05Z,use_quota=True,user_id='fa72e470c3174d72aad0add017605822',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:40:04 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-8a8b70bf-1865-4625-859b-a40149aadb56 tempest-VolumesActionsTest-190168521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eda974d7-f6d3-4af8-b09d-38422d5980c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:40:04 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-8a8b70bf-1865-4625-859b-a40149aadb56 tempest-VolumesActionsTest-190168521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eda974d7-f6d3-4af8-b09d-38422d5980c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:40:04 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-8a8b70bf-1865-4625-859b-a40149aadb56 tempest-VolumesActionsTest-190168521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3c1a832-7c9a-4b71-bd91-fcdd0930cb6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:40:04 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-8a8b70bf-1865-4625-859b-a40149aadb56 tempest-VolumesActionsTest-190168521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3c1a832-7c9a-4b71-bd91-fcdd0930cb6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5e070bf-da52-4f38-bf79-0b1eaad06175', 'volume_name': 'volume-c5e070bf-da52-4f38-bf79-0b1eaad06175', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:40:04 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-8a8b70bf-1865-4625-859b-a40149aadb56 tempest-VolumesActionsTest-190168521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1a3c846-ce53-4c54-94b9-37e23c500008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:40:04 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-8a8b70bf-1865-4625-859b-a40149aadb56 tempest-VolumesActionsTest-190168521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1a3c846-ce53-4c54-94b9-37e23c500008) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:40:04 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-8a8b70bf-1865-4625-859b-a40149aadb56 tempest-VolumesActionsTest-190168521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12fe0499-521b-40fa-813d-a35f85106207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:40:04 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-8a8b70bf-1865-4625-859b-a40149aadb56 tempest-VolumesActionsTest-190168521 None] Volume c5e070bf-da52-4f38-bf79-0b1eaad06175: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5e070bf-da52-4f38-bf79-0b1eaad06175', 'volume_size': 1} Sep 23 14:40:04 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-8a8b70bf-1865-4625-859b-a40149aadb56 tempest-VolumesActionsTest-190168521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:40:04 devstack sudo[96802]: pam_unix(sudo:session): session closed for user root Sep 23 14:40:04 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-b72acf8f-edd9-4c47-82e5-aa45837ab0f1 tempest-VolumeTypesAccessTest-1714258647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-0563ac47-1040-4579-ac64-bfa523c814ee" returned: 0 in 0.449s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:40:04 devstack cinder-volume[86310]: DEBUG cinder.coordination [req-24a4db22-420b-4ea6-bf1b-6cf37c9fe3db req-a470b18b-4f04-407f-98fa-eb2ebb2384a2 tempest-VolumesGetTestJSON-1778309354 None] Lock "cinder-0f5ce37a-b880-4b13-9175-318cf4de1b01-delete_volume" released by "delete_volume" :: held 1.980s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:40:04 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-b72acf8f-edd9-4c47-82e5-aa45837ab0f1 tempest-VolumeTypesAccessTest-1714258647 None] Lock "cinder-quobyte-0563ac47-1040-4579-ac64-bfa523c814ee" released by "delete_volume" :: held 1.156s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:40:04 devstack cinder-volume[86310]: WARNING cinder.quota [None req-b72acf8f-edd9-4c47-82e5-aa45837ab0f1 tempest-VolumeTypesAccessTest-1714258647 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-2125116265 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-2125116265, it is now deprecated. Please use the default quota class for default quota. Sep 23 14:40:04 devstack cinder-volume[86310]: WARNING cinder.quota [None req-b72acf8f-edd9-4c47-82e5-aa45837ab0f1 tempest-VolumeTypesAccessTest-1714258647 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-2125116265 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-2125116265, it is now deprecated. Please use the default quota class for default quota. Sep 23 14:40:05 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-b72acf8f-edd9-4c47-82e5-aa45837ab0f1 tempest-VolumeTypesAccessTest-1714258647 None] Created reservations ['c26c2714-cb6b-4a1a-96ac-53fe8ecb431a', '04f0cdce-4dca-413e-a5ab-f35d22ee06e0', '121e15a6-3d54-49da-a533-20222ca58d7d', '9ca5cae0-c4d2-4dc1-ad0e-7730218409d6'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:40:05 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-b72acf8f-edd9-4c47-82e5-aa45837ab0f1 tempest-VolumeTypesAccessTest-1714258647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:40:05 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-b72acf8f-edd9-4c47-82e5-aa45837ab0f1 tempest-VolumeTypesAccessTest-1714258647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:40:05 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-b72acf8f-edd9-4c47-82e5-aa45837ab0f1 tempest-VolumeTypesAccessTest-1714258647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:40:05 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-b72acf8f-edd9-4c47-82e5-aa45837ab0f1 tempest-VolumeTypesAccessTest-1714258647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:40:05 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-b72acf8f-edd9-4c47-82e5-aa45837ab0f1 tempest-VolumeTypesAccessTest-1714258647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:40:05 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-b72acf8f-edd9-4c47-82e5-aa45837ab0f1 tempest-VolumeTypesAccessTest-1714258647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:40:05 devstack sudo[96815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:40:05 devstack sudo[96815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:40:05 devstack sudo[96815]: pam_unix(sudo:session): session closed for user root Sep 23 14:40:05 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-b72acf8f-edd9-4c47-82e5-aa45837ab0f1 tempest-VolumeTypesAccessTest-1714258647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.576s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:40:05 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-b72acf8f-edd9-4c47-82e5-aa45837ab0f1 tempest-VolumeTypesAccessTest-1714258647 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:40:05 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-b72acf8f-edd9-4c47-82e5-aa45837ab0f1 tempest-VolumeTypesAccessTest-1714258647 None] Deleted volume successfully. Sep 23 14:40:05 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-b72acf8f-edd9-4c47-82e5-aa45837ab0f1 tempest-VolumeTypesAccessTest-1714258647 None] Lock "cinder-0563ac47-1040-4579-ac64-bfa523c814ee-delete_volume" released by "delete_volume" :: held 2.106s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:40:12 devstack sudo[96794]: pam_unix(sudo:session): session closed for user root Sep 23 14:40:12 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8682950c-c27e-406b-b5b8-8dcb24a9c668 tempest-VolumesActionsTest-1930790160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-91658ecc-b212-4cec-ab79-495726afbe66 /opt/stack/data/cinder/conversion/91658ecc-b212-4cec-ab79-495726afbe66.temp_image.b3eb8602-9f1a-4111-9872-487604de617d1w_6upsl.img" returned: 0 in 8.002s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:40:12 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b001f2f-b22e-4242-874b-e5dabdd56813]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:40:12 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8682950c-c27e-406b-b5b8-8dcb24a9c668 tempest-VolumesActionsTest-1930790160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-91658ecc-b212-4cec-ab79-495726afbe66 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:40:12 devstack sudo[96826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-91658ecc-b212-4cec-ab79-495726afbe66 Sep 23 14:40:12 devstack sudo[96826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:40:12 devstack sudo[96826]: pam_unix(sudo:session): session closed for user root Sep 23 14:40:12 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8682950c-c27e-406b-b5b8-8dcb24a9c668 tempest-VolumesActionsTest-1930790160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-91658ecc-b212-4cec-ab79-495726afbe66" returned: 0 in 0.580s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:40:12 devstack cinder-volume[86310]: DEBUG cinder.image.image_utils [None req-8682950c-c27e-406b-b5b8-8dcb24a9c668 tempest-VolumesActionsTest-1930790160 None] Image conversion details: src /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-91658ecc-b212-4cec-ab79-495726afbe66, size 1024.00 MB, duration 8.00 sec, destination /opt/stack/data/cinder/conversion/91658ecc-b212-4cec-ab79-495726afbe66.temp_image.b3eb8602-9f1a-4111-9872-487604de617d1w_6upsl.img {{(pid=86310) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 14:40:12 devstack cinder-volume[86310]: INFO cinder.image.image_utils [None req-8682950c-c27e-406b-b5b8-8dcb24a9c668 tempest-VolumesActionsTest-1930790160 None] Converted 1024.00 MB image at 127.95 MB/s Sep 23 14:40:12 devstack cinder-volume[86310]: DEBUG cinder.image.image_utils [None req-8682950c-c27e-406b-b5b8-8dcb24a9c668 tempest-VolumesActionsTest-1930790160 None] b3eb8602-9f1a-4111-9872-487604de617d was raw, converting to qcow2 {{(pid=86310) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Sep 23 14:40:12 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea32813a-b8f8-476a-9d66-5d1b2fb8ec6b]: (4, 'raw') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:40:12 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8682950c-c27e-406b-b5b8-8dcb24a9c668 tempest-VolumesActionsTest-1930790160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/91658ecc-b212-4cec-ab79-495726afbe66.temp_image.b3eb8602-9f1a-4111-9872-487604de617d1w_6upsl.img {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:40:12 devstack sudo[96832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/91658ecc-b212-4cec-ab79-495726afbe66.temp_image.b3eb8602-9f1a-4111-9872-487604de617d1w_6upsl.img Sep 23 14:40:12 devstack sudo[96832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:40:13 devstack sudo[96832]: pam_unix(sudo:session): session closed for user root Sep 23 14:40:13 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8682950c-c27e-406b-b5b8-8dcb24a9c668 tempest-VolumesActionsTest-1930790160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/91658ecc-b212-4cec-ab79-495726afbe66.temp_image.b3eb8602-9f1a-4111-9872-487604de617d1w_6upsl.img" returned: 0 in 0.376s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:40:13 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8682950c-c27e-406b-b5b8-8dcb24a9c668 tempest-VolumesActionsTest-1930790160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/91658ecc-b212-4cec-ab79-495726afbe66.temp_image.b3eb8602-9f1a-4111-9872-487604de617d1w_6upsl.img {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:40:13 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-32758352-fac3-4dce-8427-d1999ade6b70 tempest-GroupSnapshotsV319Test-1336187296 None] Group tempest-GroupSnapshotsV319Test-Group-1459196396: creating Sep 23 14:40:13 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-32758352-fac3-4dce-8427-d1999ade6b70 tempest-GroupSnapshotsV319Test-1336187296 None] Group tempest-GroupSnapshotsV319Test-Group-1459196396: created successfully Sep 23 14:40:13 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-32758352-fac3-4dce-8427-d1999ade6b70 tempest-GroupSnapshotsV319Test-1336187296 None] Create group completed successfully. Sep 23 14:40:13 devstack sudo[96836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/91658ecc-b212-4cec-ab79-495726afbe66.temp_image.b3eb8602-9f1a-4111-9872-487604de617d1w_6upsl.img Sep 23 14:40:13 devstack sudo[96836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:40:13 devstack sudo[96836]: pam_unix(sudo:session): session closed for user root Sep 23 14:40:13 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8682950c-c27e-406b-b5b8-8dcb24a9c668 tempest-VolumesActionsTest-1930790160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/91658ecc-b212-4cec-ab79-495726afbe66.temp_image.b3eb8602-9f1a-4111-9872-487604de617d1w_6upsl.img" returned: 1 in 0.419s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:40:13 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8682950c-c27e-406b-b5b8-8dcb24a9c668 tempest-VolumesActionsTest-1930790160 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/91658ecc-b212-4cec-ab79-495726afbe66.temp_image.b3eb8602-9f1a-4111-9872-487604de617d1w_6upsl.img' failed. Not Retrying. {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 14:40:13 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8682950c-c27e-406b-b5b8-8dcb24a9c668 tempest-VolumesActionsTest-1930790160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/91658ecc-b212-4cec-ab79-495726afbe66.temp_image.b3eb8602-9f1a-4111-9872-487604de617d1w_6upsl.img /opt/stack/data/cinder/conversion/vol_upload_9gejszaq {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:40:13 devstack sudo[96841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/91658ecc-b212-4cec-ab79-495726afbe66.temp_image.b3eb8602-9f1a-4111-9872-487604de617d1w_6upsl.img /opt/stack/data/cinder/conversion/vol_upload_9gejszaq Sep 23 14:40:13 devstack sudo[96841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:40:13 devstack sudo[96841]: pam_unix(sudo:session): session closed for user root Sep 23 14:40:13 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8682950c-c27e-406b-b5b8-8dcb24a9c668 tempest-VolumesActionsTest-1930790160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/91658ecc-b212-4cec-ab79-495726afbe66.temp_image.b3eb8602-9f1a-4111-9872-487604de617d1w_6upsl.img /opt/stack/data/cinder/conversion/vol_upload_9gejszaq" returned: 0 in 0.267s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:40:13 devstack cinder-volume[86310]: DEBUG cinder.image.image_utils [None req-8682950c-c27e-406b-b5b8-8dcb24a9c668 tempest-VolumesActionsTest-1930790160 None] Image conversion details: src /opt/stack/data/cinder/conversion/91658ecc-b212-4cec-ab79-495726afbe66.temp_image.b3eb8602-9f1a-4111-9872-487604de617d1w_6upsl.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_9gejszaq {{(pid=86310) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 14:40:13 devstack cinder-volume[86310]: INFO cinder.image.image_utils [None req-8682950c-c27e-406b-b5b8-8dcb24a9c668 tempest-VolumesActionsTest-1930790160 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 23 14:40:13 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a02962-5c5d-413d-86a8-6a6e7999745b]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:40:13 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8682950c-c27e-406b-b5b8-8dcb24a9c668 tempest-VolumesActionsTest-1930790160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_9gejszaq {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:40:13 devstack sudo[96846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_9gejszaq Sep 23 14:40:13 devstack sudo[96846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:40:14 devstack sudo[96846]: pam_unix(sudo:session): session closed for user root Sep 23 14:40:14 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8682950c-c27e-406b-b5b8-8dcb24a9c668 tempest-VolumesActionsTest-1930790160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_9gejszaq" returned: 0 in 0.361s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:40:15 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-0539f885-7f91-4e14-af76-a6d6d58a2b6b tempest-GroupSnapshotsV319Test-1336187296 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:40:15 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-0539f885-7f91-4e14-af76-a6d6d58a2b6b tempest-GroupSnapshotsV319Test-1336187296 None] Flow 'volume_create_manager' (86d55510-3995-4d9c-a2fe-56e0da5586c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:40:15 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-0539f885-7f91-4e14-af76-a6d6d58a2b6b tempest-GroupSnapshotsV319Test-1336187296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54aba9f7-9164-43ef-a6ec-730a28c9e8ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:40:15 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-0539f885-7f91-4e14-af76-a6d6d58a2b6b tempest-GroupSnapshotsV319Test-1336187296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54aba9f7-9164-43ef-a6ec-730a28c9e8ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:40:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1543857537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=498d4c72-4503-427f-9f12-2803e2d00610,host='devstack@QuobyteHD#QuobyteHD',id=589e7188-efcd-4661-91c6-ff9f381ae963,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abafe2f8140c46cab011752b931364fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:40:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:40:15Z,use_quota=True,user_id='11747b75be2840e6848a6196af664111',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b5e6685-4d8e-4688-80a6-ccf15954c2ab),volume_type_id=7b5e6685-4d8e-4688-80a6-ccf15954c2ab)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:40:15 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-0539f885-7f91-4e14-af76-a6d6d58a2b6b tempest-GroupSnapshotsV319Test-1336187296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f9fd580-b1f8-4ad6-925c-dba2b3ebe4f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:40:15 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-0539f885-7f91-4e14-af76-a6d6d58a2b6b tempest-GroupSnapshotsV319Test-1336187296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f9fd580-b1f8-4ad6-925c-dba2b3ebe4f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:40:15 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-0539f885-7f91-4e14-af76-a6d6d58a2b6b tempest-GroupSnapshotsV319Test-1336187296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (171e06b0-bd22-4808-a21f-20a4dc1e86ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:40:15 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-0539f885-7f91-4e14-af76-a6d6d58a2b6b tempest-GroupSnapshotsV319Test-1336187296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (171e06b0-bd22-4808-a21f-20a4dc1e86ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '589e7188-efcd-4661-91c6-ff9f381ae963', 'volume_name': 'volume-589e7188-efcd-4661-91c6-ff9f381ae963', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:40:15 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-0539f885-7f91-4e14-af76-a6d6d58a2b6b tempest-GroupSnapshotsV319Test-1336187296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03ed944b-a08d-4b2f-8a19-17d65815d82e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:40:15 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-0539f885-7f91-4e14-af76-a6d6d58a2b6b tempest-GroupSnapshotsV319Test-1336187296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03ed944b-a08d-4b2f-8a19-17d65815d82e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:40:15 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-0539f885-7f91-4e14-af76-a6d6d58a2b6b tempest-GroupSnapshotsV319Test-1336187296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9cd37af-6267-4a92-a5fd-1ce2cf9eb3e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:40:15 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-0539f885-7f91-4e14-af76-a6d6d58a2b6b tempest-GroupSnapshotsV319Test-1336187296 None] Volume 589e7188-efcd-4661-91c6-ff9f381ae963: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-589e7188-efcd-4661-91c6-ff9f381ae963', 'volume_size': 1} Sep 23 14:40:15 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-0539f885-7f91-4e14-af76-a6d6d58a2b6b tempest-GroupSnapshotsV319Test-1336187296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:40:16 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-8682950c-c27e-406b-b5b8-8dcb24a9c668 tempest-VolumesActionsTest-1930790160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 13.062s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:40:16 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-8682950c-c27e-406b-b5b8-8dcb24a9c668 tempest-VolumesActionsTest-1930790160 None] Uploaded volume to glance image-id: b3eb8602-9f1a-4111-9872-487604de617d. {{(pid=86310) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 23 14:40:16 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-8a8b70bf-1865-4625-859b-a40149aadb56 tempest-VolumesActionsTest-190168521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.176s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:40:16 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-8a8b70bf-1865-4625-859b-a40149aadb56 tempest-VolumesActionsTest-190168521 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:40:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1723667672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5e070bf-da52-4f38-bf79-0b1eaad06175,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4885c86c91f4245bdc43ff368fc3b8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:40:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:40:05Z,use_quota=True,user_id='fa72e470c3174d72aad0add017605822',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:40:16 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-8a8b70bf-1865-4625-859b-a40149aadb56 tempest-VolumesActionsTest-190168521 None] Creating volume c5e070bf-da52-4f38-bf79-0b1eaad06175 {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:40:16 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-8a8b70bf-1865-4625-859b-a40149aadb56 tempest-VolumesActionsTest-190168521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:40:16 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-8a8b70bf-1865-4625-859b-a40149aadb56 tempest-VolumesActionsTest-190168521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:40:16 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-8a8b70bf-1865-4625-859b-a40149aadb56 tempest-VolumesActionsTest-190168521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:40:16 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-8a8b70bf-1865-4625-859b-a40149aadb56 tempest-VolumesActionsTest-190168521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:40:16 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-8a8b70bf-1865-4625-859b-a40149aadb56 tempest-VolumesActionsTest-190168521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:40:16 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-8a8b70bf-1865-4625-859b-a40149aadb56 tempest-VolumesActionsTest-190168521 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:40:16 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-8a8b70bf-1865-4625-859b-a40149aadb56 tempest-VolumesActionsTest-190168521 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:40:16 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8a8b70bf-1865-4625-859b-a40149aadb56 tempest-VolumesActionsTest-190168521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-c5e070bf-da52-4f38-bf79-0b1eaad06175 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:40:16 devstack sudo[96852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-c5e070bf-da52-4f38-bf79-0b1eaad06175 1073741824 Sep 23 14:40:16 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-8682950c-c27e-406b-b5b8-8dcb24a9c668 tempest-VolumesActionsTest-1930790160 None] Copy volume to image completed successfully. Sep 23 14:40:16 devstack sudo[96852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:40:16 devstack sudo[96852]: pam_unix(sudo:session): session closed for user root Sep 23 14:40:16 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8a8b70bf-1865-4625-859b-a40149aadb56 tempest-VolumesActionsTest-190168521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-c5e070bf-da52-4f38-bf79-0b1eaad06175 1073741824" returned: 0 in 0.524s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:40:16 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8a8b70bf-1865-4625-859b-a40149aadb56 tempest-VolumesActionsTest-190168521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-c5e070bf-da52-4f38-bf79-0b1eaad06175 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:40:16 devstack sudo[96858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-c5e070bf-da52-4f38-bf79-0b1eaad06175 Sep 23 14:40:16 devstack sudo[96858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:40:16 devstack sudo[96858]: pam_unix(sudo:session): session closed for user root Sep 23 14:40:16 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-1f9f6d08-dd07-4998-a617-ef1aff56d137 tempest-VolumesActionsTest-1930790160 None] Acquiring lock "cinder-91658ecc-b212-4cec-ab79-495726afbe66-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:40:16 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8a8b70bf-1865-4625-859b-a40149aadb56 tempest-VolumesActionsTest-190168521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-c5e070bf-da52-4f38-bf79-0b1eaad06175" returned: 0 in 0.312s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:40:16 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-8a8b70bf-1865-4625-859b-a40149aadb56 tempest-VolumesActionsTest-190168521 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:40:16 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-8a8b70bf-1865-4625-859b-a40149aadb56 tempest-VolumesActionsTest-190168521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:40:16 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-0539f885-7f91-4e14-af76-a6d6d58a2b6b tempest-GroupSnapshotsV319Test-1336187296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.601s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:40:16 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-0539f885-7f91-4e14-af76-a6d6d58a2b6b tempest-GroupSnapshotsV319Test-1336187296 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=498d4c72-4503-427f-9f12-2803e2d00610,created_at=2026-09-23T12:40:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1543857537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=498d4c72-4503-427f-9f12-2803e2d00610,host='devstack@QuobyteHD#QuobyteHD',id=589e7188-efcd-4661-91c6-ff9f381ae963,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abafe2f8140c46cab011752b931364fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:40:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:40:15Z,use_quota=True,user_id='11747b75be2840e6848a6196af664111',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b5e6685-4d8e-4688-80a6-ccf15954c2ab),volume_type_id=7b5e6685-4d8e-4688-80a6-ccf15954c2ab)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:40:16 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-0539f885-7f91-4e14-af76-a6d6d58a2b6b tempest-GroupSnapshotsV319Test-1336187296 None] Creating volume 589e7188-efcd-4661-91c6-ff9f381ae963 {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:40:16 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-0539f885-7f91-4e14-af76-a6d6d58a2b6b tempest-GroupSnapshotsV319Test-1336187296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:40:16 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-0539f885-7f91-4e14-af76-a6d6d58a2b6b tempest-GroupSnapshotsV319Test-1336187296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:40:16 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-0539f885-7f91-4e14-af76-a6d6d58a2b6b tempest-GroupSnapshotsV319Test-1336187296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:40:16 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-0539f885-7f91-4e14-af76-a6d6d58a2b6b tempest-GroupSnapshotsV319Test-1336187296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:40:16 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-0539f885-7f91-4e14-af76-a6d6d58a2b6b tempest-GroupSnapshotsV319Test-1336187296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:40:16 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-0539f885-7f91-4e14-af76-a6d6d58a2b6b tempest-GroupSnapshotsV319Test-1336187296 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:40:16 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-0539f885-7f91-4e14-af76-a6d6d58a2b6b tempest-GroupSnapshotsV319Test-1336187296 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:40:16 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-0539f885-7f91-4e14-af76-a6d6d58a2b6b tempest-GroupSnapshotsV319Test-1336187296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-589e7188-efcd-4661-91c6-ff9f381ae963 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:40:17 devstack sudo[96861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-589e7188-efcd-4661-91c6-ff9f381ae963 1073741824 Sep 23 14:40:17 devstack sudo[96861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:40:17 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-8a8b70bf-1865-4625-859b-a40149aadb56 tempest-VolumesActionsTest-190168521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12fe0499-521b-40fa-813d-a35f85106207) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5e070bf-da52-4f38-bf79-0b1eaad06175', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:40:17 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-8a8b70bf-1865-4625-859b-a40149aadb56 tempest-VolumesActionsTest-190168521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f585d886-5923-4c31-a117-3c968b10797a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:40:17 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-1f9f6d08-dd07-4998-a617-ef1aff56d137 tempest-VolumesActionsTest-1930790160 None] Lock "cinder-91658ecc-b212-4cec-ab79-495726afbe66-delete_volume" acquired by "delete_volume" :: waited 0.112s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:40:17 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-8a8b70bf-1865-4625-859b-a40149aadb56 tempest-VolumesActionsTest-190168521 None] Volume volume-c5e070bf-da52-4f38-bf79-0b1eaad06175 (c5e070bf-da52-4f38-bf79-0b1eaad06175): created successfully Sep 23 14:40:17 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-8a8b70bf-1865-4625-859b-a40149aadb56 tempest-VolumesActionsTest-190168521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f585d886-5923-4c31-a117-3c968b10797a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:40:17 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-8a8b70bf-1865-4625-859b-a40149aadb56 tempest-VolumesActionsTest-190168521 None] Flow 'volume_create_manager' (ef1dad46-2423-49d9-971b-bf158113d99f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:40:17 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-8a8b70bf-1865-4625-859b-a40149aadb56 tempest-VolumesActionsTest-190168521 None] Created volume successfully. Sep 23 14:40:17 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-1f9f6d08-dd07-4998-a617-ef1aff56d137 tempest-VolumesActionsTest-1930790160 None] Acquiring lock "cinder-quobyte-91658ecc-b212-4cec-ab79-495726afbe66" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:40:17 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-1f9f6d08-dd07-4998-a617-ef1aff56d137 tempest-VolumesActionsTest-1930790160 None] Lock "cinder-quobyte-91658ecc-b212-4cec-ab79-495726afbe66" acquired by "delete_volume" :: waited 0.019s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:40:17 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4f04963-db0e-4fc3-8e95-48c65b497fb1]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:40:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-1f9f6d08-dd07-4998-a617-ef1aff56d137 tempest-VolumesActionsTest-1930790160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-91658ecc-b212-4cec-ab79-495726afbe66 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:40:17 devstack sudo[96863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-91658ecc-b212-4cec-ab79-495726afbe66 Sep 23 14:40:17 devstack sudo[96863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:40:17 devstack sudo[96861]: pam_unix(sudo:session): session closed for user root Sep 23 14:40:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-0539f885-7f91-4e14-af76-a6d6d58a2b6b tempest-GroupSnapshotsV319Test-1336187296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-589e7188-efcd-4661-91c6-ff9f381ae963 1073741824" returned: 0 in 0.540s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:40:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-0539f885-7f91-4e14-af76-a6d6d58a2b6b tempest-GroupSnapshotsV319Test-1336187296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-589e7188-efcd-4661-91c6-ff9f381ae963 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:40:17 devstack sudo[96872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-589e7188-efcd-4661-91c6-ff9f381ae963 Sep 23 14:40:17 devstack sudo[96863]: pam_unix(sudo:session): session closed for user root Sep 23 14:40:17 devstack sudo[96872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:40:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-1f9f6d08-dd07-4998-a617-ef1aff56d137 tempest-VolumesActionsTest-1930790160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-91658ecc-b212-4cec-ab79-495726afbe66" returned: 0 in 0.433s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:40:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-1f9f6d08-dd07-4998-a617-ef1aff56d137 tempest-VolumesActionsTest-1930790160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-91658ecc-b212-4cec-ab79-495726afbe66 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:40:17 devstack sudo[96874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-91658ecc-b212-4cec-ab79-495726afbe66 Sep 23 14:40:17 devstack sudo[96874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:40:17 devstack sudo[96872]: pam_unix(sudo:session): session closed for user root Sep 23 14:40:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-0539f885-7f91-4e14-af76-a6d6d58a2b6b tempest-GroupSnapshotsV319Test-1336187296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-589e7188-efcd-4661-91c6-ff9f381ae963" returned: 0 in 0.277s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:40:17 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-0539f885-7f91-4e14-af76-a6d6d58a2b6b tempest-GroupSnapshotsV319Test-1336187296 None] <== create_volume: return (864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:40:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-0539f885-7f91-4e14-af76-a6d6d58a2b6b tempest-GroupSnapshotsV319Test-1336187296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:40:17 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-0539f885-7f91-4e14-af76-a6d6d58a2b6b tempest-GroupSnapshotsV319Test-1336187296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9cd37af-6267-4a92-a5fd-1ce2cf9eb3e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-589e7188-efcd-4661-91c6-ff9f381ae963', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:40:17 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-0539f885-7f91-4e14-af76-a6d6d58a2b6b tempest-GroupSnapshotsV319Test-1336187296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44d5c389-c3f5-4634-8b7b-bb3f9c2824e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:40:17 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-0539f885-7f91-4e14-af76-a6d6d58a2b6b tempest-GroupSnapshotsV319Test-1336187296 None] Volume volume-589e7188-efcd-4661-91c6-ff9f381ae963 (589e7188-efcd-4661-91c6-ff9f381ae963): created successfully Sep 23 14:40:17 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-0539f885-7f91-4e14-af76-a6d6d58a2b6b tempest-GroupSnapshotsV319Test-1336187296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44d5c389-c3f5-4634-8b7b-bb3f9c2824e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:40:17 devstack sudo[96874]: pam_unix(sudo:session): session closed for user root Sep 23 14:40:17 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-0539f885-7f91-4e14-af76-a6d6d58a2b6b tempest-GroupSnapshotsV319Test-1336187296 None] Flow 'volume_create_manager' (86d55510-3995-4d9c-a2fe-56e0da5586c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:40:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-1f9f6d08-dd07-4998-a617-ef1aff56d137 tempest-VolumesActionsTest-1930790160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-91658ecc-b212-4cec-ab79-495726afbe66" returned: 0 in 0.292s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:40:17 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-1f9f6d08-dd07-4998-a617-ef1aff56d137 tempest-VolumesActionsTest-1930790160 None] Lock "cinder-quobyte-91658ecc-b212-4cec-ab79-495726afbe66" released by "delete_volume" :: held 0.779s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:40:17 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-0539f885-7f91-4e14-af76-a6d6d58a2b6b tempest-GroupSnapshotsV319Test-1336187296 None] Created volume successfully. Sep 23 14:40:17 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-1f9f6d08-dd07-4998-a617-ef1aff56d137 tempest-VolumesActionsTest-1930790160 None] Created reservations ['219c373a-8725-49fa-a1ac-f9eeb440bb16', '45e1b469-bbf1-4650-82ce-863b33cf490b', 'b8341535-eec3-4d94-b3e3-89452b27576f', 'c5f976e3-da17-4e2e-a5a3-a1a26e12f7fb'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:40:18 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-1f9f6d08-dd07-4998-a617-ef1aff56d137 tempest-VolumesActionsTest-1930790160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:40:18 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-1f9f6d08-dd07-4998-a617-ef1aff56d137 tempest-VolumesActionsTest-1930790160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:40:18 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-1f9f6d08-dd07-4998-a617-ef1aff56d137 tempest-VolumesActionsTest-1930790160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:40:18 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-1f9f6d08-dd07-4998-a617-ef1aff56d137 tempest-VolumesActionsTest-1930790160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:40:18 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-1f9f6d08-dd07-4998-a617-ef1aff56d137 tempest-VolumesActionsTest-1930790160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:40:18 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-1f9f6d08-dd07-4998-a617-ef1aff56d137 tempest-VolumesActionsTest-1930790160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:40:18 devstack sudo[96878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:40:18 devstack sudo[96878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:40:18 devstack sudo[96878]: pam_unix(sudo:session): session closed for user root Sep 23 14:40:18 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-1f9f6d08-dd07-4998-a617-ef1aff56d137 tempest-VolumesActionsTest-1930790160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.397s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:40:18 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-1f9f6d08-dd07-4998-a617-ef1aff56d137 tempest-VolumesActionsTest-1930790160 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:40:18 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-1f9f6d08-dd07-4998-a617-ef1aff56d137 tempest-VolumesActionsTest-1930790160 None] Deleted volume successfully. Sep 23 14:40:18 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-1f9f6d08-dd07-4998-a617-ef1aff56d137 tempest-VolumesActionsTest-1930790160 None] Lock "cinder-91658ecc-b212-4cec-ab79-495726afbe66-delete_volume" released by "delete_volume" :: held 1.454s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:40:18 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-a302c293-359d-4d31-9426-42952e902264 tempest-VolumesActionsTest-190168521 None] Acquiring lock "cinder-c5e070bf-da52-4f38-bf79-0b1eaad06175-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:40:18 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-a302c293-359d-4d31-9426-42952e902264 tempest-VolumesActionsTest-190168521 None] Lock "cinder-c5e070bf-da52-4f38-bf79-0b1eaad06175-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:40:18 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-a302c293-359d-4d31-9426-42952e902264 tempest-VolumesActionsTest-190168521 None] Acquiring lock "cinder-quobyte-c5e070bf-da52-4f38-bf79-0b1eaad06175" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:40:18 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-a302c293-359d-4d31-9426-42952e902264 tempest-VolumesActionsTest-190168521 None] Lock "cinder-quobyte-c5e070bf-da52-4f38-bf79-0b1eaad06175" acquired by "delete_volume" :: waited 0.033s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:40:18 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-40864855-5e05-4427-833f-65c45ab3c3f4 tempest-GroupSnapshotsV319Test-1336187296 None] GroupSnapshot 1e1595a5-e4f9-4a44-91a9-8cafe9b302e8: creating. Sep 23 14:40:19 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd9b8a53-dbb1-4865-b77a-f6c4c4ecc0b3]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:40:19 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a302c293-359d-4d31-9426-42952e902264 tempest-VolumesActionsTest-190168521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-c5e070bf-da52-4f38-bf79-0b1eaad06175 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:40:19 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-40864855-5e05-4427-833f-65c45ab3c3f4 tempest-GroupSnapshotsV319Test-1336187296 None] Group snapshot 1e1595a5-e4f9-4a44-91a9-8cafe9b302e8: creating. {{(pid=86310) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 23 14:40:19 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-40864855-5e05-4427-833f-65c45ab3c3f4 tempest-GroupSnapshotsV319Test-1336187296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:40:19 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-40864855-5e05-4427-833f-65c45ab3c3f4 tempest-GroupSnapshotsV319Test-1336187296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:40:19 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-40864855-5e05-4427-833f-65c45ab3c3f4 tempest-GroupSnapshotsV319Test-1336187296 None] Creating offline snapshot b8b61f76-f2d9-4332-bbcf-d1ef9923320c of volume 589e7188-efcd-4661-91c6-ff9f381ae963 {{(pid=86310) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 14:40:19 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[51e87665-f5c7-47b4-bc6f-e0543e433af6]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:40:19 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-40864855-5e05-4427-833f-65c45ab3c3f4 tempest-GroupSnapshotsV319Test-1336187296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-589e7188-efcd-4661-91c6-ff9f381ae963 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:40:19 devstack sudo[96917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-c5e070bf-da52-4f38-bf79-0b1eaad06175 Sep 23 14:40:19 devstack sudo[96917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:40:19 devstack sudo[96918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-589e7188-efcd-4661-91c6-ff9f381ae963 Sep 23 14:40:19 devstack sudo[96918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:40:19 devstack sudo[96917]: pam_unix(sudo:session): session closed for user root Sep 23 14:40:19 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a302c293-359d-4d31-9426-42952e902264 tempest-VolumesActionsTest-190168521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-c5e070bf-da52-4f38-bf79-0b1eaad06175" returned: 0 in 0.530s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:40:19 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a302c293-359d-4d31-9426-42952e902264 tempest-VolumesActionsTest-190168521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-c5e070bf-da52-4f38-bf79-0b1eaad06175 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:40:19 devstack sudo[96927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-c5e070bf-da52-4f38-bf79-0b1eaad06175 Sep 23 14:40:19 devstack sudo[96927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:40:19 devstack sudo[96918]: pam_unix(sudo:session): session closed for user root Sep 23 14:40:19 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-40864855-5e05-4427-833f-65c45ab3c3f4 tempest-GroupSnapshotsV319Test-1336187296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-589e7188-efcd-4661-91c6-ff9f381ae963" returned: 0 in 0.508s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:40:19 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-40864855-5e05-4427-833f-65c45ab3c3f4 tempest-GroupSnapshotsV319Test-1336187296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-589e7188-efcd-4661-91c6-ff9f381ae963,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-589e7188-efcd-4661-91c6-ff9f381ae963.b8b61f76-f2d9-4332-bbcf-d1ef9923320c 1G {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:40:19 devstack sudo[96929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-589e7188-efcd-4661-91c6-ff9f381ae963,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-589e7188-efcd-4661-91c6-ff9f381ae963.b8b61f76-f2d9-4332-bbcf-d1ef9923320c 1G Sep 23 14:40:19 devstack sudo[96929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:40:19 devstack sudo[96927]: pam_unix(sudo:session): session closed for user root Sep 23 14:40:19 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a302c293-359d-4d31-9426-42952e902264 tempest-VolumesActionsTest-190168521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-c5e070bf-da52-4f38-bf79-0b1eaad06175" returned: 0 in 0.312s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:40:19 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-a302c293-359d-4d31-9426-42952e902264 tempest-VolumesActionsTest-190168521 None] Lock "cinder-quobyte-c5e070bf-da52-4f38-bf79-0b1eaad06175" released by "delete_volume" :: held 0.931s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:40:19 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-a302c293-359d-4d31-9426-42952e902264 tempest-VolumesActionsTest-190168521 None] Created reservations ['1ee7b582-2958-4f5c-b88b-9748a1e027bb', '22a057d5-1e21-474e-b9e7-678bea4ea4c2', '12e84897-8c66-45d5-ade5-a97a2d3d4c9c', '8d2d79eb-3263-4a5f-bce6-18b5f594784a'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:40:20 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-a302c293-359d-4d31-9426-42952e902264 tempest-VolumesActionsTest-190168521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:40:20 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-a302c293-359d-4d31-9426-42952e902264 tempest-VolumesActionsTest-190168521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:40:20 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-a302c293-359d-4d31-9426-42952e902264 tempest-VolumesActionsTest-190168521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:40:20 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-a302c293-359d-4d31-9426-42952e902264 tempest-VolumesActionsTest-190168521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:40:20 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-a302c293-359d-4d31-9426-42952e902264 tempest-VolumesActionsTest-190168521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:40:20 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a302c293-359d-4d31-9426-42952e902264 tempest-VolumesActionsTest-190168521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:40:20 devstack sudo[96935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:40:20 devstack sudo[96935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:40:20 devstack sudo[96929]: pam_unix(sudo:session): session closed for user root Sep 23 14:40:20 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-40864855-5e05-4427-833f-65c45ab3c3f4 tempest-GroupSnapshotsV319Test-1336187296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-589e7188-efcd-4661-91c6-ff9f381ae963,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-589e7188-efcd-4661-91c6-ff9f381ae963.b8b61f76-f2d9-4332-bbcf-d1ef9923320c 1G" returned: 0 in 0.577s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:40:20 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-40864855-5e05-4427-833f-65c45ab3c3f4 tempest-GroupSnapshotsV319Test-1336187296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-589e7188-efcd-4661-91c6-ff9f381ae963 -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-589e7188-efcd-4661-91c6-ff9f381ae963.b8b61f76-f2d9-4332-bbcf-d1ef9923320c {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:40:20 devstack sudo[96937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-589e7188-efcd-4661-91c6-ff9f381ae963 -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-589e7188-efcd-4661-91c6-ff9f381ae963.b8b61f76-f2d9-4332-bbcf-d1ef9923320c Sep 23 14:40:20 devstack sudo[96937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:40:20 devstack sudo[96935]: pam_unix(sudo:session): session closed for user root Sep 23 14:40:20 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a302c293-359d-4d31-9426-42952e902264 tempest-VolumesActionsTest-190168521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.343s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:40:20 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-a302c293-359d-4d31-9426-42952e902264 tempest-VolumesActionsTest-190168521 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:40:20 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-a302c293-359d-4d31-9426-42952e902264 tempest-VolumesActionsTest-190168521 None] Deleted volume successfully. Sep 23 14:40:20 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-a302c293-359d-4d31-9426-42952e902264 tempest-VolumesActionsTest-190168521 None] Lock "cinder-c5e070bf-da52-4f38-bf79-0b1eaad06175-delete_volume" released by "delete_volume" :: held 1.636s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:40:20 devstack sudo[96937]: pam_unix(sudo:session): session closed for user root Sep 23 14:40:20 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-40864855-5e05-4427-833f-65c45ab3c3f4 tempest-GroupSnapshotsV319Test-1336187296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-589e7188-efcd-4661-91c6-ff9f381ae963 -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-589e7188-efcd-4661-91c6-ff9f381ae963.b8b61f76-f2d9-4332-bbcf-d1ef9923320c" returned: 0 in 0.415s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:40:20 devstack cinder-volume[86310]: WARNING cinder.volume.drivers.remotefs [None req-40864855-5e05-4427-833f-65c45ab3c3f4 tempest-GroupSnapshotsV319Test-1336187296 None] /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-589e7188-efcd-4661-91c6-ff9f381ae963.b8b61f76-f2d9-4332-bbcf-d1ef9923320c is being set with open permissions: ugo+rw: NotImplementedError Sep 23 14:40:20 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-40864855-5e05-4427-833f-65c45ab3c3f4 tempest-GroupSnapshotsV319Test-1336187296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-589e7188-efcd-4661-91c6-ff9f381ae963.b8b61f76-f2d9-4332-bbcf-d1ef9923320c {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:40:20 devstack sudo[96945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-589e7188-efcd-4661-91c6-ff9f381ae963.b8b61f76-f2d9-4332-bbcf-d1ef9923320c Sep 23 14:40:20 devstack sudo[96945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:40:20 devstack sudo[96945]: pam_unix(sudo:session): session closed for user root Sep 23 14:40:20 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-40864855-5e05-4427-833f-65c45ab3c3f4 tempest-GroupSnapshotsV319Test-1336187296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-589e7188-efcd-4661-91c6-ff9f381ae963.b8b61f76-f2d9-4332-bbcf-d1ef9923320c" returned: 0 in 0.263s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:40:20 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-40864855-5e05-4427-833f-65c45ab3c3f4 tempest-GroupSnapshotsV319Test-1336187296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-589e7188-efcd-4661-91c6-ff9f381ae963.info {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:40:20 devstack sudo[96948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-589e7188-efcd-4661-91c6-ff9f381ae963.info Sep 23 14:40:20 devstack sudo[96948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:40:21 devstack sudo[96948]: pam_unix(sudo:session): session closed for user root Sep 23 14:40:21 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-40864855-5e05-4427-833f-65c45ab3c3f4 tempest-GroupSnapshotsV319Test-1336187296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-589e7188-efcd-4661-91c6-ff9f381ae963.info" returned: 0 in 0.291s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:40:21 devstack cinder-volume[86310]: WARNING cinder.volume.drivers.remotefs [None req-40864855-5e05-4427-833f-65c45ab3c3f4 tempest-GroupSnapshotsV319Test-1336187296 None] /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-589e7188-efcd-4661-91c6-ff9f381ae963.info is being set with open permissions: ugo+rw: NotImplementedError Sep 23 14:40:21 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-40864855-5e05-4427-833f-65c45ab3c3f4 tempest-GroupSnapshotsV319Test-1336187296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-589e7188-efcd-4661-91c6-ff9f381ae963.info {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:40:21 devstack sudo[96951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-589e7188-efcd-4661-91c6-ff9f381ae963.info Sep 23 14:40:21 devstack sudo[96951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:40:21 devstack sudo[96951]: pam_unix(sudo:session): session closed for user root Sep 23 14:40:21 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-40864855-5e05-4427-833f-65c45ab3c3f4 tempest-GroupSnapshotsV319Test-1336187296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-589e7188-efcd-4661-91c6-ff9f381ae963.info" returned: 0 in 0.278s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:40:21 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-40864855-5e05-4427-833f-65c45ab3c3f4 tempest-GroupSnapshotsV319Test-1336187296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.432s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:40:21 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-40864855-5e05-4427-833f-65c45ab3c3f4 tempest-GroupSnapshotsV319Test-1336187296 None] group_snapshot 1e1595a5-e4f9-4a44-91a9-8cafe9b302e8: created successfully Sep 23 14:40:22 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-ad344c83-7e0d-4bb5-883b-0340c01aa5d9 tempest-GroupSnapshotsV319Test-1336187296 None] group_snapshot 1e1595a5-e4f9-4a44-91a9-8cafe9b302e8: deleting Sep 23 14:40:22 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-ad344c83-7e0d-4bb5-883b-0340c01aa5d9 tempest-GroupSnapshotsV319Test-1336187296 None] group_snapshot 1e1595a5-e4f9-4a44-91a9-8cafe9b302e8: deleting {{(pid=86310) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 23 14:40:22 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-ad344c83-7e0d-4bb5-883b-0340c01aa5d9 tempest-GroupSnapshotsV319Test-1336187296 None] Acquiring lock "cinder-quobyte-589e7188-efcd-4661-91c6-ff9f381ae963" by "delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:40:22 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-ad344c83-7e0d-4bb5-883b-0340c01aa5d9 tempest-GroupSnapshotsV319Test-1336187296 None] Lock "cinder-quobyte-589e7188-efcd-4661-91c6-ff9f381ae963" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:40:22 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-ad344c83-7e0d-4bb5-883b-0340c01aa5d9 tempest-GroupSnapshotsV319Test-1336187296 None] Acquiring lock "cinder-quobyte-b8b61f76-f2d9-4332-bbcf-d1ef9923320c" by "_delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:40:22 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-ad344c83-7e0d-4bb5-883b-0340c01aa5d9 tempest-GroupSnapshotsV319Test-1336187296 None] Lock "cinder-quobyte-b8b61f76-f2d9-4332-bbcf-d1ef9923320c" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:40:22 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-ad344c83-7e0d-4bb5-883b-0340c01aa5d9 tempest-GroupSnapshotsV319Test-1336187296 None] Deleting offline snapshot b8b61f76-f2d9-4332-bbcf-d1ef9923320c of volume 589e7188-efcd-4661-91c6-ff9f381ae963 {{(pid=86310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 14:40:22 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-ad344c83-7e0d-4bb5-883b-0340c01aa5d9 tempest-GroupSnapshotsV319Test-1336187296 None] snapshot_file for this snap is: volume-589e7188-efcd-4661-91c6-ff9f381ae963.b8b61f76-f2d9-4332-bbcf-d1ef9923320c {{(pid=86310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 14:40:22 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a4e1a9f-ad71-4245-badd-ee3a98865ee9]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:40:22 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ad344c83-7e0d-4bb5-883b-0340c01aa5d9 tempest-GroupSnapshotsV319Test-1336187296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-589e7188-efcd-4661-91c6-ff9f381ae963.b8b61f76-f2d9-4332-bbcf-d1ef9923320c {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:40:23 devstack sudo[96955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-589e7188-efcd-4661-91c6-ff9f381ae963.b8b61f76-f2d9-4332-bbcf-d1ef9923320c Sep 23 14:40:23 devstack sudo[96955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:40:23 devstack sudo[96955]: pam_unix(sudo:session): session closed for user root Sep 23 14:40:23 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ad344c83-7e0d-4bb5-883b-0340c01aa5d9 tempest-GroupSnapshotsV319Test-1336187296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-589e7188-efcd-4661-91c6-ff9f381ae963.b8b61f76-f2d9-4332-bbcf-d1ef9923320c" returned: 0 in 0.474s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:40:23 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-ad344c83-7e0d-4bb5-883b-0340c01aa5d9 tempest-GroupSnapshotsV319Test-1336187296 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-589e7188-efcd-4661-91c6-ff9f381ae963(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 14:40:23 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[b713e710-0de2-42fd-aa91-9b5388b1d215]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:40:23 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ad344c83-7e0d-4bb5-883b-0340c01aa5d9 tempest-GroupSnapshotsV319Test-1336187296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-589e7188-efcd-4661-91c6-ff9f381ae963 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:40:23 devstack sudo[96961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-589e7188-efcd-4661-91c6-ff9f381ae963 Sep 23 14:40:23 devstack sudo[96961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:40:23 devstack sudo[96961]: pam_unix(sudo:session): session closed for user root Sep 23 14:40:23 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ad344c83-7e0d-4bb5-883b-0340c01aa5d9 tempest-GroupSnapshotsV319Test-1336187296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-589e7188-efcd-4661-91c6-ff9f381ae963" returned: 0 in 0.482s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:40:23 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ad344c83-7e0d-4bb5-883b-0340c01aa5d9 tempest-GroupSnapshotsV319Test-1336187296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-589e7188-efcd-4661-91c6-ff9f381ae963.b8b61f76-f2d9-4332-bbcf-d1ef9923320c {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:40:23 devstack sudo[96966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-589e7188-efcd-4661-91c6-ff9f381ae963.b8b61f76-f2d9-4332-bbcf-d1ef9923320c Sep 23 14:40:23 devstack sudo[96966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:40:24 devstack sudo[96966]: pam_unix(sudo:session): session closed for user root Sep 23 14:40:24 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ad344c83-7e0d-4bb5-883b-0340c01aa5d9 tempest-GroupSnapshotsV319Test-1336187296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-589e7188-efcd-4661-91c6-ff9f381ae963.b8b61f76-f2d9-4332-bbcf-d1ef9923320c" returned: 0 in 0.465s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:40:24 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ad344c83-7e0d-4bb5-883b-0340c01aa5d9 tempest-GroupSnapshotsV319Test-1336187296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-589e7188-efcd-4661-91c6-ff9f381ae963.b8b61f76-f2d9-4332-bbcf-d1ef9923320c {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:40:24 devstack sudo[96972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-589e7188-efcd-4661-91c6-ff9f381ae963.b8b61f76-f2d9-4332-bbcf-d1ef9923320c Sep 23 14:40:24 devstack sudo[96972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:40:24 devstack sudo[96972]: pam_unix(sudo:session): session closed for user root Sep 23 14:40:24 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ad344c83-7e0d-4bb5-883b-0340c01aa5d9 tempest-GroupSnapshotsV319Test-1336187296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-589e7188-efcd-4661-91c6-ff9f381ae963.b8b61f76-f2d9-4332-bbcf-d1ef9923320c" returned: 0 in 0.329s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:40:24 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-ad344c83-7e0d-4bb5-883b-0340c01aa5d9 tempest-GroupSnapshotsV319Test-1336187296 None] Lock "cinder-quobyte-b8b61f76-f2d9-4332-bbcf-d1ef9923320c" released by "_delete_snapshot" :: held 1.941s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:40:24 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-ad344c83-7e0d-4bb5-883b-0340c01aa5d9 tempest-GroupSnapshotsV319Test-1336187296 None] Lock "cinder-quobyte-589e7188-efcd-4661-91c6-ff9f381ae963" released by "delete_snapshot" :: held 1.978s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:40:24 devstack cinder-volume[86310]: WARNING cinder.quota [None req-ad344c83-7e0d-4bb5-883b-0340c01aa5d9 tempest-GroupSnapshotsV319Test-1336187296 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1754503776 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1754503776, it is now deprecated. Please use the default quota class for default quota. Sep 23 14:40:24 devstack cinder-volume[86310]: WARNING cinder.quota [None req-ad344c83-7e0d-4bb5-883b-0340c01aa5d9 tempest-GroupSnapshotsV319Test-1336187296 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1754503776 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1754503776, it is now deprecated. Please use the default quota class for default quota. Sep 23 14:40:24 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-ad344c83-7e0d-4bb5-883b-0340c01aa5d9 tempest-GroupSnapshotsV319Test-1336187296 None] Created reservations ['a013201b-9c04-4f89-9154-698cf709b723', 'dee6454b-fe92-48ad-b601-a058c0b8fb7d', 'a9d79b43-aa96-4333-90e2-64a634191c3f', 'a3503591-0d19-4a68-aaea-1f84247c65c9'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:40:24 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-ad344c83-7e0d-4bb5-883b-0340c01aa5d9 tempest-GroupSnapshotsV319Test-1336187296 None] group_snapshot 1e1595a5-e4f9-4a44-91a9-8cafe9b302e8: deleted successfully Sep 23 14:40:25 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-2f4c781c-d5d8-4747-8304-bd7971be3060 tempest-GroupSnapshotsV319Test-1336187296 None] Acquiring lock "cinder-quobyte-589e7188-efcd-4661-91c6-ff9f381ae963" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:40:25 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-2f4c781c-d5d8-4747-8304-bd7971be3060 tempest-GroupSnapshotsV319Test-1336187296 None] Lock "cinder-quobyte-589e7188-efcd-4661-91c6-ff9f381ae963" acquired by "delete_volume" :: waited 0.027s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:40:25 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e18ca3a-b615-4428-9017-37d31bc4ebf7]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:40:25 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-2f4c781c-d5d8-4747-8304-bd7971be3060 tempest-GroupSnapshotsV319Test-1336187296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-589e7188-efcd-4661-91c6-ff9f381ae963 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:40:25 devstack sudo[96976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-589e7188-efcd-4661-91c6-ff9f381ae963 Sep 23 14:40:25 devstack sudo[96976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:40:26 devstack sudo[96976]: pam_unix(sudo:session): session closed for user root Sep 23 14:40:26 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-2f4c781c-d5d8-4747-8304-bd7971be3060 tempest-GroupSnapshotsV319Test-1336187296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-589e7188-efcd-4661-91c6-ff9f381ae963" returned: 0 in 0.456s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:40:26 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-2f4c781c-d5d8-4747-8304-bd7971be3060 tempest-GroupSnapshotsV319Test-1336187296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-589e7188-efcd-4661-91c6-ff9f381ae963 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:40:26 devstack sudo[96981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-589e7188-efcd-4661-91c6-ff9f381ae963 Sep 23 14:40:26 devstack sudo[96981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:40:26 devstack sudo[96981]: pam_unix(sudo:session): session closed for user root Sep 23 14:40:26 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-2f4c781c-d5d8-4747-8304-bd7971be3060 tempest-GroupSnapshotsV319Test-1336187296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-589e7188-efcd-4661-91c6-ff9f381ae963" returned: 0 in 0.345s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:40:26 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-2f4c781c-d5d8-4747-8304-bd7971be3060 tempest-GroupSnapshotsV319Test-1336187296 None] Lock "cinder-quobyte-589e7188-efcd-4661-91c6-ff9f381ae963" released by "delete_volume" :: held 0.897s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:40:26 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-2f4c781c-d5d8-4747-8304-bd7971be3060 tempest-GroupSnapshotsV319Test-1336187296 None] Created reservations ['a3409ba4-37a5-4313-b8a3-b977c605a651'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:40:26 devstack cinder-volume[86310]: WARNING cinder.quota [None req-2f4c781c-d5d8-4747-8304-bd7971be3060 tempest-GroupSnapshotsV319Test-1336187296 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1754503776 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1754503776, it is now deprecated. Please use the default quota class for default quota. Sep 23 14:40:26 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-2f4c781c-d5d8-4747-8304-bd7971be3060 tempest-GroupSnapshotsV319Test-1336187296 None] Created reservations ['ebbab0cc-8ec0-412d-ac4a-28862741f52c', 'bc2cadf2-9fd0-454a-bbcc-d84cb96cb778', 'f7c957ad-4725-4574-881e-1c23a61160bf', 'e9b1fa80-afe1-46b7-8f19-a5bc9b513311'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:40:26 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-2f4c781c-d5d8-4747-8304-bd7971be3060 tempest-GroupSnapshotsV319Test-1336187296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:40:26 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-2f4c781c-d5d8-4747-8304-bd7971be3060 tempest-GroupSnapshotsV319Test-1336187296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:40:26 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-2f4c781c-d5d8-4747-8304-bd7971be3060 tempest-GroupSnapshotsV319Test-1336187296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:40:26 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-2f4c781c-d5d8-4747-8304-bd7971be3060 tempest-GroupSnapshotsV319Test-1336187296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:40:26 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-2f4c781c-d5d8-4747-8304-bd7971be3060 tempest-GroupSnapshotsV319Test-1336187296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:40:26 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-2f4c781c-d5d8-4747-8304-bd7971be3060 tempest-GroupSnapshotsV319Test-1336187296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:40:26 devstack sudo[96986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:40:26 devstack sudo[96986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:40:27 devstack sudo[96986]: pam_unix(sudo:session): session closed for user root Sep 23 14:40:27 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-2f4c781c-d5d8-4747-8304-bd7971be3060 tempest-GroupSnapshotsV319Test-1336187296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.316s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:40:27 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-2f4c781c-d5d8-4747-8304-bd7971be3060 tempest-GroupSnapshotsV319Test-1336187296 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:40:27 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-2f4c781c-d5d8-4747-8304-bd7971be3060 tempest-GroupSnapshotsV319Test-1336187296 None] Delete group completed successfully. Sep 23 14:40:29 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-89602a4d-8afc-4e57-a951-b7acd52beea7 tempest-VolumesCloneNegativeTest-752693927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:40:29 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-89602a4d-8afc-4e57-a951-b7acd52beea7 tempest-VolumesCloneNegativeTest-752693927 None] Flow 'volume_create_manager' (e2e201f2-f498-4d11-a75d-7bbbe9780383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:40:29 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-89602a4d-8afc-4e57-a951-b7acd52beea7 tempest-VolumesCloneNegativeTest-752693927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (608709ad-8f60-4eb6-ad45-2998abf33e2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:40:29 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-89602a4d-8afc-4e57-a951-b7acd52beea7 tempest-VolumesCloneNegativeTest-752693927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (608709ad-8f60-4eb6-ad45-2998abf33e2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:40:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1692064617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=086d40a3-0e2b-4397-be4f-3cb7f61e10f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d97c29c80904e038c0c4c86f2acb31a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:40:30Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:40:30Z,use_quota=True,user_id='fc482e1e7b594fd0bd8408d008147d0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:40:29 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-89602a4d-8afc-4e57-a951-b7acd52beea7 tempest-VolumesCloneNegativeTest-752693927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8115877-8faf-47ee-9b09-41e630d6a7c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:40:29 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-89602a4d-8afc-4e57-a951-b7acd52beea7 tempest-VolumesCloneNegativeTest-752693927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8115877-8faf-47ee-9b09-41e630d6a7c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:40:29 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-89602a4d-8afc-4e57-a951-b7acd52beea7 tempest-VolumesCloneNegativeTest-752693927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34a34c89-11e8-42af-a237-4a12505b405c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:40:29 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-89602a4d-8afc-4e57-a951-b7acd52beea7 tempest-VolumesCloneNegativeTest-752693927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34a34c89-11e8-42af-a237-4a12505b405c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '086d40a3-0e2b-4397-be4f-3cb7f61e10f0', 'volume_name': 'volume-086d40a3-0e2b-4397-be4f-3cb7f61e10f0', 'volume_size': 2}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:40:29 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-89602a4d-8afc-4e57-a951-b7acd52beea7 tempest-VolumesCloneNegativeTest-752693927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cca868b-62d2-4f90-aa2c-ed774d0fb618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:40:29 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-89602a4d-8afc-4e57-a951-b7acd52beea7 tempest-VolumesCloneNegativeTest-752693927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cca868b-62d2-4f90-aa2c-ed774d0fb618) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:40:29 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-89602a4d-8afc-4e57-a951-b7acd52beea7 tempest-VolumesCloneNegativeTest-752693927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bf3ae31-d35e-484d-954f-fae7806af96d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:40:30 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-89602a4d-8afc-4e57-a951-b7acd52beea7 tempest-VolumesCloneNegativeTest-752693927 None] Volume 086d40a3-0e2b-4397-be4f-3cb7f61e10f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-086d40a3-0e2b-4397-be4f-3cb7f61e10f0', 'volume_size': 2} Sep 23 14:40:30 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-89602a4d-8afc-4e57-a951-b7acd52beea7 tempest-VolumesCloneNegativeTest-752693927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:40:30 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-89602a4d-8afc-4e57-a951-b7acd52beea7 tempest-VolumesCloneNegativeTest-752693927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:40:30 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-89602a4d-8afc-4e57-a951-b7acd52beea7 tempest-VolumesCloneNegativeTest-752693927 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:40:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1692064617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=086d40a3-0e2b-4397-be4f-3cb7f61e10f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d97c29c80904e038c0c4c86f2acb31a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:40:30Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:40:30Z,use_quota=True,user_id='fc482e1e7b594fd0bd8408d008147d0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:40:30 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-89602a4d-8afc-4e57-a951-b7acd52beea7 tempest-VolumesCloneNegativeTest-752693927 None] Creating volume 086d40a3-0e2b-4397-be4f-3cb7f61e10f0 {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:40:30 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-89602a4d-8afc-4e57-a951-b7acd52beea7 tempest-VolumesCloneNegativeTest-752693927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:40:30 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-89602a4d-8afc-4e57-a951-b7acd52beea7 tempest-VolumesCloneNegativeTest-752693927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:40:30 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-89602a4d-8afc-4e57-a951-b7acd52beea7 tempest-VolumesCloneNegativeTest-752693927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:40:30 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-89602a4d-8afc-4e57-a951-b7acd52beea7 tempest-VolumesCloneNegativeTest-752693927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:40:30 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-89602a4d-8afc-4e57-a951-b7acd52beea7 tempest-VolumesCloneNegativeTest-752693927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:40:30 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-89602a4d-8afc-4e57-a951-b7acd52beea7 tempest-VolumesCloneNegativeTest-752693927 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:40:30 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-89602a4d-8afc-4e57-a951-b7acd52beea7 tempest-VolumesCloneNegativeTest-752693927 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:40:30 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-89602a4d-8afc-4e57-a951-b7acd52beea7 tempest-VolumesCloneNegativeTest-752693927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-086d40a3-0e2b-4397-be4f-3cb7f61e10f0 2147483648 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:40:30 devstack sudo[96991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-086d40a3-0e2b-4397-be4f-3cb7f61e10f0 2147483648 Sep 23 14:40:30 devstack sudo[96991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:40:30 devstack sudo[96991]: pam_unix(sudo:session): session closed for user root Sep 23 14:40:30 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-89602a4d-8afc-4e57-a951-b7acd52beea7 tempest-VolumesCloneNegativeTest-752693927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-086d40a3-0e2b-4397-be4f-3cb7f61e10f0 2147483648" returned: 0 in 0.598s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:40:30 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-89602a4d-8afc-4e57-a951-b7acd52beea7 tempest-VolumesCloneNegativeTest-752693927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-086d40a3-0e2b-4397-be4f-3cb7f61e10f0 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:40:30 devstack sudo[96997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-086d40a3-0e2b-4397-be4f-3cb7f61e10f0 Sep 23 14:40:30 devstack sudo[96997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:40:30 devstack sudo[96997]: pam_unix(sudo:session): session closed for user root Sep 23 14:40:30 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-89602a4d-8afc-4e57-a951-b7acd52beea7 tempest-VolumesCloneNegativeTest-752693927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-086d40a3-0e2b-4397-be4f-3cb7f61e10f0" returned: 0 in 0.299s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:40:30 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-89602a4d-8afc-4e57-a951-b7acd52beea7 tempest-VolumesCloneNegativeTest-752693927 None] <== create_volume: return (950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:40:30 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-89602a4d-8afc-4e57-a951-b7acd52beea7 tempest-VolumesCloneNegativeTest-752693927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.954s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:40:30 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-89602a4d-8afc-4e57-a951-b7acd52beea7 tempest-VolumesCloneNegativeTest-752693927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bf3ae31-d35e-484d-954f-fae7806af96d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-086d40a3-0e2b-4397-be4f-3cb7f61e10f0', 'volume_size': 2}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:40:30 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-89602a4d-8afc-4e57-a951-b7acd52beea7 tempest-VolumesCloneNegativeTest-752693927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a218d00e-8609-4a68-9c82-2db7fdd590a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:40:30 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-89602a4d-8afc-4e57-a951-b7acd52beea7 tempest-VolumesCloneNegativeTest-752693927 None] Volume volume-086d40a3-0e2b-4397-be4f-3cb7f61e10f0 (086d40a3-0e2b-4397-be4f-3cb7f61e10f0): created successfully Sep 23 14:40:30 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-89602a4d-8afc-4e57-a951-b7acd52beea7 tempest-VolumesCloneNegativeTest-752693927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a218d00e-8609-4a68-9c82-2db7fdd590a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:40:31 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-89602a4d-8afc-4e57-a951-b7acd52beea7 tempest-VolumesCloneNegativeTest-752693927 None] Flow 'volume_create_manager' (e2e201f2-f498-4d11-a75d-7bbbe9780383) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:40:31 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-89602a4d-8afc-4e57-a951-b7acd52beea7 tempest-VolumesCloneNegativeTest-752693927 None] Created volume successfully. Sep 23 14:40:32 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-258618bf-f7a5-4895-a434-3e9f503facef tempest-VolumesCloneNegativeTest-752693927 None] Acquiring lock "cinder-086d40a3-0e2b-4397-be4f-3cb7f61e10f0-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:40:32 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-258618bf-f7a5-4895-a434-3e9f503facef tempest-VolumesCloneNegativeTest-752693927 None] Lock "cinder-086d40a3-0e2b-4397-be4f-3cb7f61e10f0-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:40:32 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-258618bf-f7a5-4895-a434-3e9f503facef tempest-VolumesCloneNegativeTest-752693927 None] Acquiring lock "cinder-quobyte-086d40a3-0e2b-4397-be4f-3cb7f61e10f0" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:40:32 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-258618bf-f7a5-4895-a434-3e9f503facef tempest-VolumesCloneNegativeTest-752693927 None] Lock "cinder-quobyte-086d40a3-0e2b-4397-be4f-3cb7f61e10f0" acquired by "delete_volume" :: waited 0.019s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:40:32 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d44c586-8f3f-4a17-9185-c1152648c8a0]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:40:32 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-258618bf-f7a5-4895-a434-3e9f503facef tempest-VolumesCloneNegativeTest-752693927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-086d40a3-0e2b-4397-be4f-3cb7f61e10f0 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:40:32 devstack sudo[97002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-086d40a3-0e2b-4397-be4f-3cb7f61e10f0 Sep 23 14:40:32 devstack sudo[97002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:40:32 devstack sudo[97002]: pam_unix(sudo:session): session closed for user root Sep 23 14:40:32 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-258618bf-f7a5-4895-a434-3e9f503facef tempest-VolumesCloneNegativeTest-752693927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-086d40a3-0e2b-4397-be4f-3cb7f61e10f0" returned: 0 in 0.567s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:40:32 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-258618bf-f7a5-4895-a434-3e9f503facef tempest-VolumesCloneNegativeTest-752693927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-086d40a3-0e2b-4397-be4f-3cb7f61e10f0 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:40:32 devstack sudo[97008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-086d40a3-0e2b-4397-be4f-3cb7f61e10f0 Sep 23 14:40:32 devstack sudo[97008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:40:33 devstack sudo[97008]: pam_unix(sudo:session): session closed for user root Sep 23 14:40:33 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-258618bf-f7a5-4895-a434-3e9f503facef tempest-VolumesCloneNegativeTest-752693927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-086d40a3-0e2b-4397-be4f-3cb7f61e10f0" returned: 0 in 0.320s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:40:33 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-258618bf-f7a5-4895-a434-3e9f503facef tempest-VolumesCloneNegativeTest-752693927 None] Lock "cinder-quobyte-086d40a3-0e2b-4397-be4f-3cb7f61e10f0" released by "delete_volume" :: held 0.958s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:40:33 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-258618bf-f7a5-4895-a434-3e9f503facef tempest-VolumesCloneNegativeTest-752693927 None] Created reservations ['e3affc4c-0a81-4390-b960-3ac7d0d738e1', 'b0f4c6de-d0a8-4a7d-92f1-2c2c1f43f053', 'e8baed09-1da7-403b-a0e7-ccf3ff73e6ee', 'b59bcd64-43e6-4d3b-b62c-3a7265e54558'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:40:33 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-258618bf-f7a5-4895-a434-3e9f503facef tempest-VolumesCloneNegativeTest-752693927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:40:33 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-258618bf-f7a5-4895-a434-3e9f503facef tempest-VolumesCloneNegativeTest-752693927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:40:33 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-258618bf-f7a5-4895-a434-3e9f503facef tempest-VolumesCloneNegativeTest-752693927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:40:33 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-258618bf-f7a5-4895-a434-3e9f503facef tempest-VolumesCloneNegativeTest-752693927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:40:33 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-258618bf-f7a5-4895-a434-3e9f503facef tempest-VolumesCloneNegativeTest-752693927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:40:33 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-258618bf-f7a5-4895-a434-3e9f503facef tempest-VolumesCloneNegativeTest-752693927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:40:33 devstack sudo[97017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:40:33 devstack sudo[97017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:40:33 devstack sudo[97017]: pam_unix(sudo:session): session closed for user root Sep 23 14:40:33 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-258618bf-f7a5-4895-a434-3e9f503facef tempest-VolumesCloneNegativeTest-752693927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.415s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:40:33 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-258618bf-f7a5-4895-a434-3e9f503facef tempest-VolumesCloneNegativeTest-752693927 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:40:33 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-258618bf-f7a5-4895-a434-3e9f503facef tempest-VolumesCloneNegativeTest-752693927 None] Deleted volume successfully. Sep 23 14:40:33 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-258618bf-f7a5-4895-a434-3e9f503facef tempest-VolumesCloneNegativeTest-752693927 None] Lock "cinder-086d40a3-0e2b-4397-be4f-3cb7f61e10f0-delete_volume" released by "delete_volume" :: held 1.687s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:40:36 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-b66a6865-e36b-48d0-b738-bb4f6244a3b3 tempest-VolumesMetadataTest-670670402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:40:36 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-b66a6865-e36b-48d0-b738-bb4f6244a3b3 tempest-VolumesMetadataTest-670670402 None] Flow 'volume_create_manager' (c44a08f0-393d-49ea-8b23-58c9934fd19f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:40:36 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-b66a6865-e36b-48d0-b738-bb4f6244a3b3 tempest-VolumesMetadataTest-670670402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47262468-0825-4a61-96dc-2ed8a4bf292a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:40:36 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-b66a6865-e36b-48d0-b738-bb4f6244a3b3 tempest-VolumesMetadataTest-670670402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47262468-0825-4a61-96dc-2ed8a4bf292a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:40:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1858461569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffaf0156-df9e-42b0-8379-ea0f3e745dbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ae36130156c4f969c58ef9d427fc1c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:40:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:40:37Z,use_quota=True,user_id='c56922d685fe4d20a8265a5cdb05c64b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:40:36 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-b66a6865-e36b-48d0-b738-bb4f6244a3b3 tempest-VolumesMetadataTest-670670402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2c22b3a-e639-4be4-b507-fc22b7bc1b7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:40:36 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-b66a6865-e36b-48d0-b738-bb4f6244a3b3 tempest-VolumesMetadataTest-670670402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2c22b3a-e639-4be4-b507-fc22b7bc1b7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:40:36 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-b66a6865-e36b-48d0-b738-bb4f6244a3b3 tempest-VolumesMetadataTest-670670402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (caae96ed-1b40-4ef1-8f20-4a4f605b45f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:40:36 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-b66a6865-e36b-48d0-b738-bb4f6244a3b3 tempest-VolumesMetadataTest-670670402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (caae96ed-1b40-4ef1-8f20-4a4f605b45f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ffaf0156-df9e-42b0-8379-ea0f3e745dbe', 'volume_name': 'volume-ffaf0156-df9e-42b0-8379-ea0f3e745dbe', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:40:36 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-b66a6865-e36b-48d0-b738-bb4f6244a3b3 tempest-VolumesMetadataTest-670670402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efb96459-b17e-49d2-ad59-2711dba13d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:40:36 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-b66a6865-e36b-48d0-b738-bb4f6244a3b3 tempest-VolumesMetadataTest-670670402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efb96459-b17e-49d2-ad59-2711dba13d69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:40:36 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-b66a6865-e36b-48d0-b738-bb4f6244a3b3 tempest-VolumesMetadataTest-670670402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70837031-117a-4e98-b7c3-ebfeb2c5ae4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:40:36 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-b66a6865-e36b-48d0-b738-bb4f6244a3b3 tempest-VolumesMetadataTest-670670402 None] Volume ffaf0156-df9e-42b0-8379-ea0f3e745dbe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ffaf0156-df9e-42b0-8379-ea0f3e745dbe', 'volume_size': 1} Sep 23 14:40:36 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-b66a6865-e36b-48d0-b738-bb4f6244a3b3 tempest-VolumesMetadataTest-670670402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:40:36 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-b66a6865-e36b-48d0-b738-bb4f6244a3b3 tempest-VolumesMetadataTest-670670402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:40:36 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-b66a6865-e36b-48d0-b738-bb4f6244a3b3 tempest-VolumesMetadataTest-670670402 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:40:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1858461569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffaf0156-df9e-42b0-8379-ea0f3e745dbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ae36130156c4f969c58ef9d427fc1c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:40:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:40:37Z,use_quota=True,user_id='c56922d685fe4d20a8265a5cdb05c64b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:40:36 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-b66a6865-e36b-48d0-b738-bb4f6244a3b3 tempest-VolumesMetadataTest-670670402 None] Creating volume ffaf0156-df9e-42b0-8379-ea0f3e745dbe {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:40:36 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-b66a6865-e36b-48d0-b738-bb4f6244a3b3 tempest-VolumesMetadataTest-670670402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:40:36 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-b66a6865-e36b-48d0-b738-bb4f6244a3b3 tempest-VolumesMetadataTest-670670402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:40:36 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-b66a6865-e36b-48d0-b738-bb4f6244a3b3 tempest-VolumesMetadataTest-670670402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:40:36 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-b66a6865-e36b-48d0-b738-bb4f6244a3b3 tempest-VolumesMetadataTest-670670402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:40:36 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-b66a6865-e36b-48d0-b738-bb4f6244a3b3 tempest-VolumesMetadataTest-670670402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:40:36 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-b66a6865-e36b-48d0-b738-bb4f6244a3b3 tempest-VolumesMetadataTest-670670402 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:40:36 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-b66a6865-e36b-48d0-b738-bb4f6244a3b3 tempest-VolumesMetadataTest-670670402 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:40:36 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-b66a6865-e36b-48d0-b738-bb4f6244a3b3 tempest-VolumesMetadataTest-670670402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-ffaf0156-df9e-42b0-8379-ea0f3e745dbe 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:40:36 devstack sudo[97021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-ffaf0156-df9e-42b0-8379-ea0f3e745dbe 1073741824 Sep 23 14:40:36 devstack sudo[97021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:40:37 devstack sudo[97021]: pam_unix(sudo:session): session closed for user root Sep 23 14:40:37 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-b66a6865-e36b-48d0-b738-bb4f6244a3b3 tempest-VolumesMetadataTest-670670402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-ffaf0156-df9e-42b0-8379-ea0f3e745dbe 1073741824" returned: 0 in 0.503s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:40:37 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-b66a6865-e36b-48d0-b738-bb4f6244a3b3 tempest-VolumesMetadataTest-670670402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-ffaf0156-df9e-42b0-8379-ea0f3e745dbe {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:40:37 devstack sudo[97027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-ffaf0156-df9e-42b0-8379-ea0f3e745dbe Sep 23 14:40:37 devstack sudo[97027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:40:37 devstack sudo[97027]: pam_unix(sudo:session): session closed for user root Sep 23 14:40:37 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-b66a6865-e36b-48d0-b738-bb4f6244a3b3 tempest-VolumesMetadataTest-670670402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-ffaf0156-df9e-42b0-8379-ea0f3e745dbe" returned: 0 in 0.302s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:40:37 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-b66a6865-e36b-48d0-b738-bb4f6244a3b3 tempest-VolumesMetadataTest-670670402 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:40:37 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-b66a6865-e36b-48d0-b738-bb4f6244a3b3 tempest-VolumesMetadataTest-670670402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:40:37 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-b66a6865-e36b-48d0-b738-bb4f6244a3b3 tempest-VolumesMetadataTest-670670402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70837031-117a-4e98-b7c3-ebfeb2c5ae4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffaf0156-df9e-42b0-8379-ea0f3e745dbe', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:40:37 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-b66a6865-e36b-48d0-b738-bb4f6244a3b3 tempest-VolumesMetadataTest-670670402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7b462f6-7524-4904-b6bd-94a882ecf0ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:40:37 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-b66a6865-e36b-48d0-b738-bb4f6244a3b3 tempest-VolumesMetadataTest-670670402 None] Volume volume-ffaf0156-df9e-42b0-8379-ea0f3e745dbe (ffaf0156-df9e-42b0-8379-ea0f3e745dbe): created successfully Sep 23 14:40:37 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-b66a6865-e36b-48d0-b738-bb4f6244a3b3 tempest-VolumesMetadataTest-670670402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7b462f6-7524-4904-b6bd-94a882ecf0ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:40:37 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-b66a6865-e36b-48d0-b738-bb4f6244a3b3 tempest-VolumesMetadataTest-670670402 None] Flow 'volume_create_manager' (c44a08f0-393d-49ea-8b23-58c9934fd19f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:40:37 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-b66a6865-e36b-48d0-b738-bb4f6244a3b3 tempest-VolumesMetadataTest-670670402 None] Created volume successfully. Sep 23 14:40:38 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-31fdec5e-dfa5-4038-9d3b-144dbd8b8e8b tempest-GroupsV320Test-320043026 None] Group tempest-GroupsV320Test-Group-1563845678: creating Sep 23 14:40:38 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-31fdec5e-dfa5-4038-9d3b-144dbd8b8e8b tempest-GroupsV320Test-320043026 None] Group tempest-GroupsV320Test-Group-1563845678: created successfully Sep 23 14:40:38 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-31fdec5e-dfa5-4038-9d3b-144dbd8b8e8b tempest-GroupsV320Test-320043026 None] Create group completed successfully. Sep 23 14:40:39 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-ad775fb8-3ce2-45be-af03-6afe26f40dd9 tempest-VolumesMetadataTest-670670402 None] Acquiring lock "cinder-ffaf0156-df9e-42b0-8379-ea0f3e745dbe-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:40:39 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-ad775fb8-3ce2-45be-af03-6afe26f40dd9 tempest-VolumesMetadataTest-670670402 None] Lock "cinder-ffaf0156-df9e-42b0-8379-ea0f3e745dbe-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:40:39 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8e0d30a-bb4f-4409-8fba-09f84c7afbf6 tempest-VolumesExtendTest-55461186 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:40:39 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-a8e0d30a-bb4f-4409-8fba-09f84c7afbf6 tempest-VolumesExtendTest-55461186 None] Flow 'volume_create_manager' (05e11d67-c0eb-4186-85fc-84e24103927c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:40:39 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-a8e0d30a-bb4f-4409-8fba-09f84c7afbf6 tempest-VolumesExtendTest-55461186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5916cd21-6548-4e38-b543-5954d70b1854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:40:39 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-a8e0d30a-bb4f-4409-8fba-09f84c7afbf6 tempest-VolumesExtendTest-55461186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5916cd21-6548-4e38-b543-5954d70b1854) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:40:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1746913488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8113c950-1e45-4b31-9242-39d5460689aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='143f6e6225ad432e88fd69978dca8680',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:40:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:40:40Z,use_quota=True,user_id='2ac76f89ed4d42548544535a38674be8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:40:39 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-a8e0d30a-bb4f-4409-8fba-09f84c7afbf6 tempest-VolumesExtendTest-55461186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45d0dab8-3a78-4c97-8a98-1f8520093de1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:40:39 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-a8e0d30a-bb4f-4409-8fba-09f84c7afbf6 tempest-VolumesExtendTest-55461186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45d0dab8-3a78-4c97-8a98-1f8520093de1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:40:39 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-a8e0d30a-bb4f-4409-8fba-09f84c7afbf6 tempest-VolumesExtendTest-55461186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb3b1b41-c5e4-4201-a76f-d19d1603f55f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:40:39 devstack cinder-volume[86310]: DEBUG cinder.image.glance [None req-a8e0d30a-bb4f-4409-8fba-09f84c7afbf6 tempest-VolumesExtendTest-55461186 None] Creating Keystone auth plugin from conf {{(pid=86310) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 23 14:40:39 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-ad775fb8-3ce2-45be-af03-6afe26f40dd9 tempest-VolumesMetadataTest-670670402 None] Acquiring lock "cinder-quobyte-ffaf0156-df9e-42b0-8379-ea0f3e745dbe" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:40:39 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-ad775fb8-3ce2-45be-af03-6afe26f40dd9 tempest-VolumesMetadataTest-670670402 None] Lock "cinder-quobyte-ffaf0156-df9e-42b0-8379-ea0f3e745dbe" acquired by "delete_volume" :: waited 0.021s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:40:39 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[51d99135-fe28-48f8-9b9a-8b83d27fad8c]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:40:39 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ad775fb8-3ce2-45be-af03-6afe26f40dd9 tempest-VolumesMetadataTest-670670402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-ffaf0156-df9e-42b0-8379-ea0f3e745dbe {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:40:39 devstack sudo[97030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-ffaf0156-df9e-42b0-8379-ea0f3e745dbe Sep 23 14:40:39 devstack sudo[97030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:40:40 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-5a823bf9-1efc-4142-9926-35c671e9e712 tempest-GroupsV320Test-320043026 None] Created reservations ['382823f9-ad63-40bb-95b0-fd25d294435d'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:40:40 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-a8e0d30a-bb4f-4409-8fba-09f84c7afbf6 tempest-VolumesExtendTest-55461186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb3b1b41-c5e4-4201-a76f-d19d1603f55f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8113c950-1e45-4b31-9242-39d5460689aa', 'volume_name': 'volume-8113c950-1e45-4b31-9242-39d5460689aa', 'volume_size': 1, 'image_id': '0cd395f9-e766-4e32-94b1-775454bf3449', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0cd395f9-e766-4e32-94b1-775454bf3449', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7fa20aad952548c880b3288dd7d64dbc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0cd395f9-e766-4e32-94b1-775454bf3449', 'created_at': datetime.datetime(2026, 9, 23, 12, 25, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 23, 12, 25, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0cd395f9-e766-4e32-94b1-775454bf3449/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:40:40 devstack sudo[97030]: pam_unix(sudo:session): session closed for user root Sep 23 14:40:40 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-a8e0d30a-bb4f-4409-8fba-09f84c7afbf6 tempest-VolumesExtendTest-55461186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47062470-c153-4bde-807b-fd21f35be32e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:40:40 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-a8e0d30a-bb4f-4409-8fba-09f84c7afbf6 tempest-VolumesExtendTest-55461186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47062470-c153-4bde-807b-fd21f35be32e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:40:40 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-a8e0d30a-bb4f-4409-8fba-09f84c7afbf6 tempest-VolumesExtendTest-55461186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (019bf5c9-7a85-4430-810d-19e9052797da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:40:40 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-a8e0d30a-bb4f-4409-8fba-09f84c7afbf6 tempest-VolumesExtendTest-55461186 None] Volume 8113c950-1e45-4b31-9242-39d5460689aa: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8113c950-1e45-4b31-9242-39d5460689aa', 'volume_size': 1, 'image_id': '0cd395f9-e766-4e32-94b1-775454bf3449', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0cd395f9-e766-4e32-94b1-775454bf3449', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7fa20aad952548c880b3288dd7d64dbc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0cd395f9-e766-4e32-94b1-775454bf3449', 'created_at': datetime.datetime(2026, 9, 23, 12, 25, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 23, 12, 25, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0cd395f9-e766-4e32-94b1-775454bf3449/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 23 14:40:40 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8e0d30a-bb4f-4409-8fba-09f84c7afbf6 tempest-VolumesExtendTest-55461186 None] Trying to clone 8113c950-1e45-4b31-9242-39d5460689aa from image 0cd395f9-e766-4e32-94b1-775454bf3449 at location (None, [{'url': 'file:///opt/stack/data/glance/images/0cd395f9-e766-4e32-94b1-775454bf3449', 'metadata': {}}]). {{(pid=86310) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 23 14:40:40 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ad775fb8-3ce2-45be-af03-6afe26f40dd9 tempest-VolumesMetadataTest-670670402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-ffaf0156-df9e-42b0-8379-ea0f3e745dbe" returned: 0 in 0.469s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:40:40 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ad775fb8-3ce2-45be-af03-6afe26f40dd9 tempest-VolumesMetadataTest-670670402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-ffaf0156-df9e-42b0-8379-ea0f3e745dbe {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:40:40 devstack sudo[97035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-ffaf0156-df9e-42b0-8379-ea0f3e745dbe Sep 23 14:40:40 devstack sudo[97035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:40:40 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-5a823bf9-1efc-4142-9926-35c671e9e712 tempest-GroupsV320Test-320043026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:40:40 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-5a823bf9-1efc-4142-9926-35c671e9e712 tempest-GroupsV320Test-320043026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:40:40 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-5a823bf9-1efc-4142-9926-35c671e9e712 tempest-GroupsV320Test-320043026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:40:40 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-5a823bf9-1efc-4142-9926-35c671e9e712 tempest-GroupsV320Test-320043026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:40:40 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-5a823bf9-1efc-4142-9926-35c671e9e712 tempest-GroupsV320Test-320043026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:40:40 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-5a823bf9-1efc-4142-9926-35c671e9e712 tempest-GroupsV320Test-320043026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:40:40 devstack sudo[97038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:40:40 devstack sudo[97038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:40:40 devstack cinder-volume[86310]: DEBUG cinder.image.image_utils [None req-a8e0d30a-bb4f-4409-8fba-09f84c7afbf6 tempest-VolumesExtendTest-55461186 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0cd395f9-e766-4e32-94b1-775454bf3449_um71ggigdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86310) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 23 14:40:40 devstack cinder-volume[86310]: INFO cinder.image.image_utils [None req-a8e0d30a-bb4f-4409-8fba-09f84c7afbf6 tempest-VolumesExtendTest-55461186 None] Image download 20.69 MB at 20.69 MB/s Sep 23 14:40:40 devstack sudo[97035]: pam_unix(sudo:session): session closed for user root Sep 23 14:40:40 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ad775fb8-3ce2-45be-af03-6afe26f40dd9 tempest-VolumesMetadataTest-670670402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-ffaf0156-df9e-42b0-8379-ea0f3e745dbe" returned: 0 in 0.452s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:40:40 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-ad775fb8-3ce2-45be-af03-6afe26f40dd9 tempest-VolumesMetadataTest-670670402 None] Lock "cinder-quobyte-ffaf0156-df9e-42b0-8379-ea0f3e745dbe" released by "delete_volume" :: held 0.994s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:40:40 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4caaa8a-2692-4817-aaf0-5d8ae129d78b]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:40:40 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a8e0d30a-bb4f-4409-8fba-09f84c7afbf6 tempest-VolumesExtendTest-55461186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0cd395f9-e766-4e32-94b1-775454bf3449_um71ggigdevstack@QuobyteHD {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:40:40 devstack sudo[97038]: pam_unix(sudo:session): session closed for user root Sep 23 14:40:40 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-5a823bf9-1efc-4142-9926-35c671e9e712 tempest-GroupsV320Test-320043026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.436s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:40:40 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-5a823bf9-1efc-4142-9926-35c671e9e712 tempest-GroupsV320Test-320043026 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:40:40 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-5a823bf9-1efc-4142-9926-35c671e9e712 tempest-GroupsV320Test-320043026 None] Delete group completed successfully. Sep 23 14:40:40 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-ad775fb8-3ce2-45be-af03-6afe26f40dd9 tempest-VolumesMetadataTest-670670402 None] Created reservations ['1212849c-7389-4831-94d9-dc14996db1e3', '7185cf23-6ed5-4335-8d52-9d34983036c7', '9da1e583-5aa1-46fa-932b-57d678453dc8', '64f72606-585b-4e19-ad66-63da75946929'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:40:40 devstack sudo[97043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0cd395f9-e766-4e32-94b1-775454bf3449_um71ggigdevstack@QuobyteHD Sep 23 14:40:40 devstack sudo[97043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:40:41 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-ad775fb8-3ce2-45be-af03-6afe26f40dd9 tempest-VolumesMetadataTest-670670402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:40:41 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-ad775fb8-3ce2-45be-af03-6afe26f40dd9 tempest-VolumesMetadataTest-670670402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:40:41 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-ad775fb8-3ce2-45be-af03-6afe26f40dd9 tempest-VolumesMetadataTest-670670402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:40:41 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-ad775fb8-3ce2-45be-af03-6afe26f40dd9 tempest-VolumesMetadataTest-670670402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:40:41 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-ad775fb8-3ce2-45be-af03-6afe26f40dd9 tempest-VolumesMetadataTest-670670402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:40:41 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ad775fb8-3ce2-45be-af03-6afe26f40dd9 tempest-VolumesMetadataTest-670670402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:40:41 devstack sudo[97045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:40:41 devstack sudo[97045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:40:41 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-22197ae7-8c67-4529-bac4-5666c6e9999d tempest-VolumesListAdminTestJSON-58261631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:40:41 devstack sudo[97043]: pam_unix(sudo:session): session closed for user root Sep 23 14:40:41 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-22197ae7-8c67-4529-bac4-5666c6e9999d tempest-VolumesListAdminTestJSON-58261631 None] Flow 'volume_create_manager' (82f9da09-d73e-4c20-94ec-35227f980956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:40:41 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-22197ae7-8c67-4529-bac4-5666c6e9999d tempest-VolumesListAdminTestJSON-58261631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c227a1b-9d41-4bc0-9bb3-af5ae987740a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:40:41 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a8e0d30a-bb4f-4409-8fba-09f84c7afbf6 tempest-VolumesExtendTest-55461186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0cd395f9-e766-4e32-94b1-775454bf3449_um71ggigdevstack@QuobyteHD" returned: 0 in 0.412s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:40:41 devstack cinder-volume[86310]: DEBUG cinder.image.image_utils [None req-a8e0d30a-bb4f-4409-8fba-09f84c7afbf6 tempest-VolumesExtendTest-55461186 None] Temporary image 0cd395f9-e766-4e32-94b1-775454bf3449 is fetched for user 2ac76f89ed4d42548544535a38674be8. {{(pid=86310) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 23 14:40:41 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-22197ae7-8c67-4529-bac4-5666c6e9999d tempest-VolumesListAdminTestJSON-58261631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c227a1b-9d41-4bc0-9bb3-af5ae987740a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:40:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1923020451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d6a7800-34d0-4a97-bb6e-a91fe36bcbef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b3e258667ae42dc8e507cdf67d658a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:40:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:40:41Z,use_quota=True,user_id='3ed812930c2048cd95d63d3e751e3b78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:40:41 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-22197ae7-8c67-4529-bac4-5666c6e9999d tempest-VolumesListAdminTestJSON-58261631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d576a3c3-1b29-494d-bb1a-746010e5e78e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:40:41 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-22197ae7-8c67-4529-bac4-5666c6e9999d tempest-VolumesListAdminTestJSON-58261631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d576a3c3-1b29-494d-bb1a-746010e5e78e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:40:41 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-22197ae7-8c67-4529-bac4-5666c6e9999d tempest-VolumesListAdminTestJSON-58261631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97e7ecf4-ff07-41c5-bb09-4bc71d546028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:40:41 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-22197ae7-8c67-4529-bac4-5666c6e9999d tempest-VolumesListAdminTestJSON-58261631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97e7ecf4-ff07-41c5-bb09-4bc71d546028) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d6a7800-34d0-4a97-bb6e-a91fe36bcbef', 'volume_name': 'volume-7d6a7800-34d0-4a97-bb6e-a91fe36bcbef', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:40:41 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-22197ae7-8c67-4529-bac4-5666c6e9999d tempest-VolumesListAdminTestJSON-58261631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f1dfb97-eb2b-45dd-8e32-005364abf0ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:40:41 devstack sudo[97045]: pam_unix(sudo:session): session closed for user root Sep 23 14:40:41 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-22197ae7-8c67-4529-bac4-5666c6e9999d tempest-VolumesListAdminTestJSON-58261631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f1dfb97-eb2b-45dd-8e32-005364abf0ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:40:41 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-22197ae7-8c67-4529-bac4-5666c6e9999d tempest-VolumesListAdminTestJSON-58261631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebbe6827-8209-41db-8cc5-0baf0cc8993e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:40:41 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-22197ae7-8c67-4529-bac4-5666c6e9999d tempest-VolumesListAdminTestJSON-58261631 None] Volume 7d6a7800-34d0-4a97-bb6e-a91fe36bcbef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d6a7800-34d0-4a97-bb6e-a91fe36bcbef', 'volume_size': 1} Sep 23 14:40:41 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-22197ae7-8c67-4529-bac4-5666c6e9999d tempest-VolumesListAdminTestJSON-58261631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:40:41 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-22197ae7-8c67-4529-bac4-5666c6e9999d tempest-VolumesListAdminTestJSON-58261631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:40:41 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-22197ae7-8c67-4529-bac4-5666c6e9999d tempest-VolumesListAdminTestJSON-58261631 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:40:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1923020451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d6a7800-34d0-4a97-bb6e-a91fe36bcbef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b3e258667ae42dc8e507cdf67d658a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:40:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:40:41Z,use_quota=True,user_id='3ed812930c2048cd95d63d3e751e3b78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:40:41 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-22197ae7-8c67-4529-bac4-5666c6e9999d tempest-VolumesListAdminTestJSON-58261631 None] Creating volume 7d6a7800-34d0-4a97-bb6e-a91fe36bcbef {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:40:41 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-22197ae7-8c67-4529-bac4-5666c6e9999d tempest-VolumesListAdminTestJSON-58261631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:40:41 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-22197ae7-8c67-4529-bac4-5666c6e9999d tempest-VolumesListAdminTestJSON-58261631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:40:41 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-22197ae7-8c67-4529-bac4-5666c6e9999d tempest-VolumesListAdminTestJSON-58261631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:40:41 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-22197ae7-8c67-4529-bac4-5666c6e9999d tempest-VolumesListAdminTestJSON-58261631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:40:41 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-22197ae7-8c67-4529-bac4-5666c6e9999d tempest-VolumesListAdminTestJSON-58261631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:40:41 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-22197ae7-8c67-4529-bac4-5666c6e9999d tempest-VolumesListAdminTestJSON-58261631 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:40:41 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-22197ae7-8c67-4529-bac4-5666c6e9999d tempest-VolumesListAdminTestJSON-58261631 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:40:41 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-22197ae7-8c67-4529-bac4-5666c6e9999d tempest-VolumesListAdminTestJSON-58261631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7d6a7800-34d0-4a97-bb6e-a91fe36bcbef 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:40:41 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ad775fb8-3ce2-45be-af03-6afe26f40dd9 tempest-VolumesMetadataTest-670670402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.317s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:40:41 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-ad775fb8-3ce2-45be-af03-6afe26f40dd9 tempest-VolumesMetadataTest-670670402 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:40:41 devstack sudo[97052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7d6a7800-34d0-4a97-bb6e-a91fe36bcbef 1073741824 Sep 23 14:40:41 devstack sudo[97052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:40:41 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-ad775fb8-3ce2-45be-af03-6afe26f40dd9 tempest-VolumesMetadataTest-670670402 None] Deleted volume successfully. Sep 23 14:40:41 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-ad775fb8-3ce2-45be-af03-6afe26f40dd9 tempest-VolumesMetadataTest-670670402 None] Lock "cinder-ffaf0156-df9e-42b0-8379-ea0f3e745dbe-delete_volume" released by "delete_volume" :: held 1.727s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:40:41 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[82203d75-9ca1-4217-8dae-0e6f334fdffb]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:40:41 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a8e0d30a-bb4f-4409-8fba-09f84c7afbf6 tempest-VolumesExtendTest-55461186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0cd395f9-e766-4e32-94b1-775454bf3449_um71ggigdevstack@QuobyteHD {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:40:41 devstack sudo[97054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0cd395f9-e766-4e32-94b1-775454bf3449_um71ggigdevstack@QuobyteHD Sep 23 14:40:41 devstack sudo[97054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:40:41 devstack sudo[97054]: pam_unix(sudo:session): session closed for user root Sep 23 14:40:41 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a8e0d30a-bb4f-4409-8fba-09f84c7afbf6 tempest-VolumesExtendTest-55461186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0cd395f9-e766-4e32-94b1-775454bf3449_um71ggigdevstack@QuobyteHD" returned: 0 in 0.371s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:40:41 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-a8e0d30a-bb4f-4409-8fba-09f84c7afbf6 tempest-VolumesExtendTest-55461186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:40:41 devstack sudo[97052]: pam_unix(sudo:session): session closed for user root Sep 23 14:40:41 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-22197ae7-8c67-4529-bac4-5666c6e9999d tempest-VolumesListAdminTestJSON-58261631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7d6a7800-34d0-4a97-bb6e-a91fe36bcbef 1073741824" returned: 0 in 0.535s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:40:41 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-22197ae7-8c67-4529-bac4-5666c6e9999d tempest-VolumesListAdminTestJSON-58261631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7d6a7800-34d0-4a97-bb6e-a91fe36bcbef {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:40:41 devstack sudo[97063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7d6a7800-34d0-4a97-bb6e-a91fe36bcbef Sep 23 14:40:41 devstack sudo[97063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:40:42 devstack sudo[97063]: pam_unix(sudo:session): session closed for user root Sep 23 14:40:42 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-22197ae7-8c67-4529-bac4-5666c6e9999d tempest-VolumesListAdminTestJSON-58261631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7d6a7800-34d0-4a97-bb6e-a91fe36bcbef" returned: 0 in 0.291s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:40:42 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-22197ae7-8c67-4529-bac4-5666c6e9999d tempest-VolumesListAdminTestJSON-58261631 None] <== create_volume: return (875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:40:42 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-22197ae7-8c67-4529-bac4-5666c6e9999d tempest-VolumesListAdminTestJSON-58261631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:40:42 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-a8e0d30a-bb4f-4409-8fba-09f84c7afbf6 tempest-VolumesExtendTest-55461186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.411s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:40:42 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-a8e0d30a-bb4f-4409-8fba-09f84c7afbf6 tempest-VolumesExtendTest-55461186 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:40:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1746913488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8113c950-1e45-4b31-9242-39d5460689aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='143f6e6225ad432e88fd69978dca8680',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:40:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:40:40Z,use_quota=True,user_id='2ac76f89ed4d42548544535a38674be8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:40:42 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-a8e0d30a-bb4f-4409-8fba-09f84c7afbf6 tempest-VolumesExtendTest-55461186 None] Creating volume 8113c950-1e45-4b31-9242-39d5460689aa {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:40:42 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-a8e0d30a-bb4f-4409-8fba-09f84c7afbf6 tempest-VolumesExtendTest-55461186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:40:42 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-a8e0d30a-bb4f-4409-8fba-09f84c7afbf6 tempest-VolumesExtendTest-55461186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:40:42 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-a8e0d30a-bb4f-4409-8fba-09f84c7afbf6 tempest-VolumesExtendTest-55461186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:40:42 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-a8e0d30a-bb4f-4409-8fba-09f84c7afbf6 tempest-VolumesExtendTest-55461186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:40:42 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-a8e0d30a-bb4f-4409-8fba-09f84c7afbf6 tempest-VolumesExtendTest-55461186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:40:42 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-a8e0d30a-bb4f-4409-8fba-09f84c7afbf6 tempest-VolumesExtendTest-55461186 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:40:42 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-a8e0d30a-bb4f-4409-8fba-09f84c7afbf6 tempest-VolumesExtendTest-55461186 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:40:42 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a8e0d30a-bb4f-4409-8fba-09f84c7afbf6 tempest-VolumesExtendTest-55461186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8113c950-1e45-4b31-9242-39d5460689aa 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:40:42 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-22197ae7-8c67-4529-bac4-5666c6e9999d tempest-VolumesListAdminTestJSON-58261631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebbe6827-8209-41db-8cc5-0baf0cc8993e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d6a7800-34d0-4a97-bb6e-a91fe36bcbef', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:40:42 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-22197ae7-8c67-4529-bac4-5666c6e9999d tempest-VolumesListAdminTestJSON-58261631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ff1ca69-0b5e-4435-909f-65b3a00c166e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:40:42 devstack sudo[97067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8113c950-1e45-4b31-9242-39d5460689aa 1073741824 Sep 23 14:40:42 devstack sudo[97067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:40:42 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-22197ae7-8c67-4529-bac4-5666c6e9999d tempest-VolumesListAdminTestJSON-58261631 None] Volume volume-7d6a7800-34d0-4a97-bb6e-a91fe36bcbef (7d6a7800-34d0-4a97-bb6e-a91fe36bcbef): created successfully Sep 23 14:40:42 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-22197ae7-8c67-4529-bac4-5666c6e9999d tempest-VolumesListAdminTestJSON-58261631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ff1ca69-0b5e-4435-909f-65b3a00c166e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:40:42 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-22197ae7-8c67-4529-bac4-5666c6e9999d tempest-VolumesListAdminTestJSON-58261631 None] Flow 'volume_create_manager' (82f9da09-d73e-4c20-94ec-35227f980956) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:40:42 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-22197ae7-8c67-4529-bac4-5666c6e9999d tempest-VolumesListAdminTestJSON-58261631 None] Created volume successfully. Sep 23 14:40:42 devstack sudo[97067]: pam_unix(sudo:session): session closed for user root Sep 23 14:40:42 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a8e0d30a-bb4f-4409-8fba-09f84c7afbf6 tempest-VolumesExtendTest-55461186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8113c950-1e45-4b31-9242-39d5460689aa 1073741824" returned: 0 in 0.517s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:40:42 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a8e0d30a-bb4f-4409-8fba-09f84c7afbf6 tempest-VolumesExtendTest-55461186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8113c950-1e45-4b31-9242-39d5460689aa {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:40:42 devstack sudo[97073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8113c950-1e45-4b31-9242-39d5460689aa Sep 23 14:40:42 devstack sudo[97073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:40:43 devstack sudo[97073]: pam_unix(sudo:session): session closed for user root Sep 23 14:40:43 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a8e0d30a-bb4f-4409-8fba-09f84c7afbf6 tempest-VolumesExtendTest-55461186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8113c950-1e45-4b31-9242-39d5460689aa" returned: 0 in 0.296s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:40:43 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-a8e0d30a-bb4f-4409-8fba-09f84c7afbf6 tempest-VolumesExtendTest-55461186 None] <== create_volume: return (862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:40:43 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-a8e0d30a-bb4f-4409-8fba-09f84c7afbf6 tempest-VolumesExtendTest-55461186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:40:43 devstack cinder-volume[86310]: DEBUG cinder.volume.volume_utils [None req-a8e0d30a-bb4f-4409-8fba-09f84c7afbf6 tempest-VolumesExtendTest-55461186 None] Attempting download of 0cd395f9-e766-4e32-94b1-775454bf3449 ((None, [{'url': 'file:///opt/stack/data/glance/images/0cd395f9-e766-4e32-94b1-775454bf3449', 'metadata': {}}])) to volume 8113c950-1e45-4b31-9242-39d5460689aa. {{(pid=86310) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 23 14:40:43 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[61c4f1a5-8abc-45ac-8cdf-1415f559b4a2]: (4, 'raw') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:40:43 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a8e0d30a-bb4f-4409-8fba-09f84c7afbf6 tempest-VolumesExtendTest-55461186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0cd395f9-e766-4e32-94b1-775454bf3449_267vtewb {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:40:43 devstack sudo[97076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0cd395f9-e766-4e32-94b1-775454bf3449_267vtewb Sep 23 14:40:43 devstack sudo[97076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:40:43 devstack sudo[97076]: pam_unix(sudo:session): session closed for user root Sep 23 14:40:43 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a8e0d30a-bb4f-4409-8fba-09f84c7afbf6 tempest-VolumesExtendTest-55461186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0cd395f9-e766-4e32-94b1-775454bf3449_267vtewb" returned: 0 in 0.387s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:40:43 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a8e0d30a-bb4f-4409-8fba-09f84c7afbf6 tempest-VolumesExtendTest-55461186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0cd395f9-e766-4e32-94b1-775454bf3449_267vtewb {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:40:43 devstack sudo[97080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0cd395f9-e766-4e32-94b1-775454bf3449_267vtewb Sep 23 14:40:43 devstack sudo[97080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:40:44 devstack sudo[97080]: pam_unix(sudo:session): session closed for user root Sep 23 14:40:44 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a8e0d30a-bb4f-4409-8fba-09f84c7afbf6 tempest-VolumesExtendTest-55461186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0cd395f9-e766-4e32-94b1-775454bf3449_267vtewb" returned: 1 in 0.478s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:40:44 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a8e0d30a-bb4f-4409-8fba-09f84c7afbf6 tempest-VolumesExtendTest-55461186 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0cd395f9-e766-4e32-94b1-775454bf3449_267vtewb' failed. Not Retrying. {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 14:40:44 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[948d38e7-cd38-4973-8f7c-b2f17a8a7b8e]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:40:44 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a8e0d30a-bb4f-4409-8fba-09f84c7afbf6 tempest-VolumesExtendTest-55461186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0cd395f9-e766-4e32-94b1-775454bf3449_um71ggigdevstack@QuobyteHD {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:40:44 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-fab73f49-ab2c-44d7-883a-35abfb5be627 tempest-VolumesListAdminTestJSON-58261631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:40:44 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-fab73f49-ab2c-44d7-883a-35abfb5be627 tempest-VolumesListAdminTestJSON-58261631 None] Flow 'volume_create_manager' (4e3d5c4c-eeeb-4c53-95b4-40376625bbc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:40:44 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-fab73f49-ab2c-44d7-883a-35abfb5be627 tempest-VolumesListAdminTestJSON-58261631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7240ffe8-5c16-4336-9146-6b83909e2b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:40:44 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-fab73f49-ab2c-44d7-883a-35abfb5be627 tempest-VolumesListAdminTestJSON-58261631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7240ffe8-5c16-4336-9146-6b83909e2b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:40:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1994596941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61a78e18-b781-4473-98d5-73f2f484de5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b3e258667ae42dc8e507cdf67d658a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:40:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:40:44Z,use_quota=True,user_id='3ed812930c2048cd95d63d3e751e3b78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:40:44 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-fab73f49-ab2c-44d7-883a-35abfb5be627 tempest-VolumesListAdminTestJSON-58261631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e96d1c8-54b5-42ed-bb7d-caf974172280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:40:44 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-fab73f49-ab2c-44d7-883a-35abfb5be627 tempest-VolumesListAdminTestJSON-58261631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e96d1c8-54b5-42ed-bb7d-caf974172280) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:40:44 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-fab73f49-ab2c-44d7-883a-35abfb5be627 tempest-VolumesListAdminTestJSON-58261631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0718dcc-f69c-4fa6-86a1-38f43daed30c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:40:44 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-fab73f49-ab2c-44d7-883a-35abfb5be627 tempest-VolumesListAdminTestJSON-58261631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0718dcc-f69c-4fa6-86a1-38f43daed30c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61a78e18-b781-4473-98d5-73f2f484de5f', 'volume_name': 'volume-61a78e18-b781-4473-98d5-73f2f484de5f', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:40:44 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-fab73f49-ab2c-44d7-883a-35abfb5be627 tempest-VolumesListAdminTestJSON-58261631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0790c78-764a-4af3-82f9-0c81c998d2a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:40:44 devstack sudo[97084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0cd395f9-e766-4e32-94b1-775454bf3449_um71ggigdevstack@QuobyteHD Sep 23 14:40:44 devstack sudo[97084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:40:44 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-fab73f49-ab2c-44d7-883a-35abfb5be627 tempest-VolumesListAdminTestJSON-58261631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0790c78-764a-4af3-82f9-0c81c998d2a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:40:44 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-fab73f49-ab2c-44d7-883a-35abfb5be627 tempest-VolumesListAdminTestJSON-58261631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8539d97-3656-48c3-8ba4-b4b2875067ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:40:44 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-fab73f49-ab2c-44d7-883a-35abfb5be627 tempest-VolumesListAdminTestJSON-58261631 None] Volume 61a78e18-b781-4473-98d5-73f2f484de5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61a78e18-b781-4473-98d5-73f2f484de5f', 'volume_size': 1} Sep 23 14:40:44 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-fab73f49-ab2c-44d7-883a-35abfb5be627 tempest-VolumesListAdminTestJSON-58261631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:40:44 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-fab73f49-ab2c-44d7-883a-35abfb5be627 tempest-VolumesListAdminTestJSON-58261631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:40:44 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-fab73f49-ab2c-44d7-883a-35abfb5be627 tempest-VolumesListAdminTestJSON-58261631 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:40:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1994596941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61a78e18-b781-4473-98d5-73f2f484de5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b3e258667ae42dc8e507cdf67d658a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:40:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:40:44Z,use_quota=True,user_id='3ed812930c2048cd95d63d3e751e3b78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:40:44 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-fab73f49-ab2c-44d7-883a-35abfb5be627 tempest-VolumesListAdminTestJSON-58261631 None] Creating volume 61a78e18-b781-4473-98d5-73f2f484de5f {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:40:44 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-fab73f49-ab2c-44d7-883a-35abfb5be627 tempest-VolumesListAdminTestJSON-58261631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:40:44 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-fab73f49-ab2c-44d7-883a-35abfb5be627 tempest-VolumesListAdminTestJSON-58261631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:40:44 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-fab73f49-ab2c-44d7-883a-35abfb5be627 tempest-VolumesListAdminTestJSON-58261631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:40:44 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-fab73f49-ab2c-44d7-883a-35abfb5be627 tempest-VolumesListAdminTestJSON-58261631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:40:44 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-fab73f49-ab2c-44d7-883a-35abfb5be627 tempest-VolumesListAdminTestJSON-58261631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:40:44 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-fab73f49-ab2c-44d7-883a-35abfb5be627 tempest-VolumesListAdminTestJSON-58261631 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:40:44 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-fab73f49-ab2c-44d7-883a-35abfb5be627 tempest-VolumesListAdminTestJSON-58261631 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:40:44 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-fab73f49-ab2c-44d7-883a-35abfb5be627 tempest-VolumesListAdminTestJSON-58261631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-61a78e18-b781-4473-98d5-73f2f484de5f 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:40:44 devstack sudo[97086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-61a78e18-b781-4473-98d5-73f2f484de5f 1073741824 Sep 23 14:40:44 devstack sudo[97086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:40:44 devstack sudo[97084]: pam_unix(sudo:session): session closed for user root Sep 23 14:40:44 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a8e0d30a-bb4f-4409-8fba-09f84c7afbf6 tempest-VolumesExtendTest-55461186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0cd395f9-e766-4e32-94b1-775454bf3449_um71ggigdevstack@QuobyteHD" returned: 0 in 0.412s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:40:44 devstack cinder-volume[86310]: DEBUG cinder.image.image_utils [None req-a8e0d30a-bb4f-4409-8fba-09f84c7afbf6 tempest-VolumesExtendTest-55461186 None] 0cd395f9-e766-4e32-94b1-775454bf3449 was qcow2, converting to qcow2 {{(pid=86310) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 23 14:40:44 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a8e0d30a-bb4f-4409-8fba-09f84c7afbf6 tempest-VolumesExtendTest-55461186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0cd395f9-e766-4e32-94b1-775454bf3449_um71ggigdevstack@QuobyteHD /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8113c950-1e45-4b31-9242-39d5460689aa {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:40:44 devstack sudo[97092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0cd395f9-e766-4e32-94b1-775454bf3449_um71ggigdevstack@QuobyteHD /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8113c950-1e45-4b31-9242-39d5460689aa Sep 23 14:40:44 devstack sudo[97092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:40:44 devstack sudo[97086]: pam_unix(sudo:session): session closed for user root Sep 23 14:40:44 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-fab73f49-ab2c-44d7-883a-35abfb5be627 tempest-VolumesListAdminTestJSON-58261631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-61a78e18-b781-4473-98d5-73f2f484de5f 1073741824" returned: 0 in 0.614s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:40:44 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-fab73f49-ab2c-44d7-883a-35abfb5be627 tempest-VolumesListAdminTestJSON-58261631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-61a78e18-b781-4473-98d5-73f2f484de5f {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:40:44 devstack sudo[97102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-61a78e18-b781-4473-98d5-73f2f484de5f Sep 23 14:40:44 devstack sudo[97102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:40:45 devstack sudo[97102]: pam_unix(sudo:session): session closed for user root Sep 23 14:40:45 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-fab73f49-ab2c-44d7-883a-35abfb5be627 tempest-VolumesListAdminTestJSON-58261631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-61a78e18-b781-4473-98d5-73f2f484de5f" returned: 0 in 0.377s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:40:45 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-fab73f49-ab2c-44d7-883a-35abfb5be627 tempest-VolumesListAdminTestJSON-58261631 None] <== create_volume: return (1069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:40:45 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-fab73f49-ab2c-44d7-883a-35abfb5be627 tempest-VolumesListAdminTestJSON-58261631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.072s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:40:45 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-fab73f49-ab2c-44d7-883a-35abfb5be627 tempest-VolumesListAdminTestJSON-58261631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8539d97-3656-48c3-8ba4-b4b2875067ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61a78e18-b781-4473-98d5-73f2f484de5f', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:40:45 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-fab73f49-ab2c-44d7-883a-35abfb5be627 tempest-VolumesListAdminTestJSON-58261631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3921eca-f29f-454a-948c-a3d7ecc428f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:40:45 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-fab73f49-ab2c-44d7-883a-35abfb5be627 tempest-VolumesListAdminTestJSON-58261631 None] Volume volume-61a78e18-b781-4473-98d5-73f2f484de5f (61a78e18-b781-4473-98d5-73f2f484de5f): created successfully Sep 23 14:40:45 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-fab73f49-ab2c-44d7-883a-35abfb5be627 tempest-VolumesListAdminTestJSON-58261631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3921eca-f29f-454a-948c-a3d7ecc428f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:40:45 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-fab73f49-ab2c-44d7-883a-35abfb5be627 tempest-VolumesListAdminTestJSON-58261631 None] Flow 'volume_create_manager' (4e3d5c4c-eeeb-4c53-95b4-40376625bbc9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:40:45 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-fab73f49-ab2c-44d7-883a-35abfb5be627 tempest-VolumesListAdminTestJSON-58261631 None] Created volume successfully. Sep 23 14:40:46 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-68aba164-e09c-4741-84f9-0d5f7b857daf tempest-VolumesListAdminTestJSON-58261631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:40:46 devstack sudo[97092]: pam_unix(sudo:session): session closed for user root Sep 23 14:40:46 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-68aba164-e09c-4741-84f9-0d5f7b857daf tempest-VolumesListAdminTestJSON-58261631 None] Flow 'volume_create_manager' (ec5776e1-5f12-42b2-ad7a-dd9f54518408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:40:46 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-68aba164-e09c-4741-84f9-0d5f7b857daf tempest-VolumesListAdminTestJSON-58261631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36b4327c-9140-4a8c-93c0-8ae98d4621a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:40:46 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a8e0d30a-bb4f-4409-8fba-09f84c7afbf6 tempest-VolumesExtendTest-55461186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0cd395f9-e766-4e32-94b1-775454bf3449_um71ggigdevstack@QuobyteHD /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8113c950-1e45-4b31-9242-39d5460689aa" returned: 0 in 2.515s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:40:46 devstack cinder-volume[86310]: DEBUG cinder.image.image_utils [None req-a8e0d30a-bb4f-4409-8fba-09f84c7afbf6 tempest-VolumesExtendTest-55461186 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0cd395f9-e766-4e32-94b1-775454bf3449_um71ggigdevstack@QuobyteHD, size 112.00 MB, duration 2.52 sec, destination /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8113c950-1e45-4b31-9242-39d5460689aa {{(pid=86310) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 14:40:46 devstack cinder-volume[86310]: INFO cinder.image.image_utils [None req-a8e0d30a-bb4f-4409-8fba-09f84c7afbf6 tempest-VolumesExtendTest-55461186 None] Converted 112.00 MB image at 44.51 MB/s Sep 23 14:40:46 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a8e0d30a-bb4f-4409-8fba-09f84c7afbf6 tempest-VolumesExtendTest-55461186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8113c950-1e45-4b31-9242-39d5460689aa 1G {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:40:47 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-68aba164-e09c-4741-84f9-0d5f7b857daf tempest-VolumesListAdminTestJSON-58261631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36b4327c-9140-4a8c-93c0-8ae98d4621a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:40:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1161630826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d500ef90-e809-49ca-9cc7-7241ebc99e17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b3e258667ae42dc8e507cdf67d658a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:40:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:40:47Z,use_quota=True,user_id='3ed812930c2048cd95d63d3e751e3b78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:40:47 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-68aba164-e09c-4741-84f9-0d5f7b857daf tempest-VolumesListAdminTestJSON-58261631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18307e8c-dee8-4747-a2b2-44136d77c55c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:40:47 devstack sudo[97106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8113c950-1e45-4b31-9242-39d5460689aa 1G Sep 23 14:40:47 devstack sudo[97106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:40:47 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-68aba164-e09c-4741-84f9-0d5f7b857daf tempest-VolumesListAdminTestJSON-58261631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18307e8c-dee8-4747-a2b2-44136d77c55c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:40:47 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-68aba164-e09c-4741-84f9-0d5f7b857daf tempest-VolumesListAdminTestJSON-58261631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ef7b036-a824-4bdb-badf-5cd3e2198468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:40:47 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-68aba164-e09c-4741-84f9-0d5f7b857daf tempest-VolumesListAdminTestJSON-58261631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ef7b036-a824-4bdb-badf-5cd3e2198468) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd500ef90-e809-49ca-9cc7-7241ebc99e17', 'volume_name': 'volume-d500ef90-e809-49ca-9cc7-7241ebc99e17', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:40:47 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-68aba164-e09c-4741-84f9-0d5f7b857daf tempest-VolumesListAdminTestJSON-58261631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2ca9060-d133-4262-b485-58053a9529e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:40:47 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-68aba164-e09c-4741-84f9-0d5f7b857daf tempest-VolumesListAdminTestJSON-58261631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2ca9060-d133-4262-b485-58053a9529e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:40:47 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-68aba164-e09c-4741-84f9-0d5f7b857daf tempest-VolumesListAdminTestJSON-58261631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6306228c-8e43-46f9-af92-b3bbdd351587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:40:47 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-68aba164-e09c-4741-84f9-0d5f7b857daf tempest-VolumesListAdminTestJSON-58261631 None] Volume d500ef90-e809-49ca-9cc7-7241ebc99e17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d500ef90-e809-49ca-9cc7-7241ebc99e17', 'volume_size': 1} Sep 23 14:40:47 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-68aba164-e09c-4741-84f9-0d5f7b857daf tempest-VolumesListAdminTestJSON-58261631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:40:47 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-68aba164-e09c-4741-84f9-0d5f7b857daf tempest-VolumesListAdminTestJSON-58261631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:40:47 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-68aba164-e09c-4741-84f9-0d5f7b857daf tempest-VolumesListAdminTestJSON-58261631 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:40:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1161630826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d500ef90-e809-49ca-9cc7-7241ebc99e17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b3e258667ae42dc8e507cdf67d658a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:40:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:40:47Z,use_quota=True,user_id='3ed812930c2048cd95d63d3e751e3b78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:40:47 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-68aba164-e09c-4741-84f9-0d5f7b857daf tempest-VolumesListAdminTestJSON-58261631 None] Creating volume d500ef90-e809-49ca-9cc7-7241ebc99e17 {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:40:47 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-68aba164-e09c-4741-84f9-0d5f7b857daf tempest-VolumesListAdminTestJSON-58261631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:40:47 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-68aba164-e09c-4741-84f9-0d5f7b857daf tempest-VolumesListAdminTestJSON-58261631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:40:47 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-68aba164-e09c-4741-84f9-0d5f7b857daf tempest-VolumesListAdminTestJSON-58261631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:40:47 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-68aba164-e09c-4741-84f9-0d5f7b857daf tempest-VolumesListAdminTestJSON-58261631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:40:47 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-68aba164-e09c-4741-84f9-0d5f7b857daf tempest-VolumesListAdminTestJSON-58261631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:40:47 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-68aba164-e09c-4741-84f9-0d5f7b857daf tempest-VolumesListAdminTestJSON-58261631 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:40:47 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-68aba164-e09c-4741-84f9-0d5f7b857daf tempest-VolumesListAdminTestJSON-58261631 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:40:47 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-68aba164-e09c-4741-84f9-0d5f7b857daf tempest-VolumesListAdminTestJSON-58261631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d500ef90-e809-49ca-9cc7-7241ebc99e17 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:40:47 devstack sudo[97108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d500ef90-e809-49ca-9cc7-7241ebc99e17 1073741824 Sep 23 14:40:47 devstack sudo[97108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:40:47 devstack sudo[97106]: pam_unix(sudo:session): session closed for user root Sep 23 14:40:47 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a8e0d30a-bb4f-4409-8fba-09f84c7afbf6 tempest-VolumesExtendTest-55461186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8113c950-1e45-4b31-9242-39d5460689aa 1G" returned: 0 in 0.468s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:40:47 devstack cinder-volume[86310]: DEBUG cinder.volume.volume_utils [None req-a8e0d30a-bb4f-4409-8fba-09f84c7afbf6 tempest-VolumesExtendTest-55461186 None] Downloaded image 0cd395f9-e766-4e32-94b1-775454bf3449 ((None, [{'url': 'file:///opt/stack/data/glance/images/0cd395f9-e766-4e32-94b1-775454bf3449', 'metadata': {}}])) to volume 8113c950-1e45-4b31-9242-39d5460689aa successfully. {{(pid=86310) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 23 14:40:47 devstack cinder-volume[86310]: DEBUG cinder.image.image_utils [None req-a8e0d30a-bb4f-4409-8fba-09f84c7afbf6 tempest-VolumesExtendTest-55461186 None] Temporary image 0cd395f9-e766-4e32-94b1-775454bf3449 for user 2ac76f89ed4d42548544535a38674be8 is deleted. {{(pid=86310) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 23 14:40:47 devstack cinder-volume[86310]: DEBUG cinder.volume.volume_utils [None req-a8e0d30a-bb4f-4409-8fba-09f84c7afbf6 tempest-VolumesExtendTest-55461186 None] Marking volume 8113c950-1e45-4b31-9242-39d5460689aa as bootable. {{(pid=86310) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 23 14:40:47 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8e0d30a-bb4f-4409-8fba-09f84c7afbf6 tempest-VolumesExtendTest-55461186 None] Copying metadata from image 0cd395f9-e766-4e32-94b1-775454bf3449 to 8113c950-1e45-4b31-9242-39d5460689aa. {{(pid=86310) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 23 14:40:47 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8e0d30a-bb4f-4409-8fba-09f84c7afbf6 tempest-VolumesExtendTest-55461186 None] Creating volume glance metadata for volume 8113c950-1e45-4b31-9242-39d5460689aa backed by image 0cd395f9-e766-4e32-94b1-775454bf3449 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0cd395f9-e766-4e32-94b1-775454bf3449', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86310) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 23 14:40:47 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-a8e0d30a-bb4f-4409-8fba-09f84c7afbf6 tempest-VolumesExtendTest-55461186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (019bf5c9-7a85-4430-810d-19e9052797da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8113c950-1e45-4b31-9242-39d5460689aa', 'volume_size': 1, 'image_id': '0cd395f9-e766-4e32-94b1-775454bf3449', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0cd395f9-e766-4e32-94b1-775454bf3449', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7fa20aad952548c880b3288dd7d64dbc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0cd395f9-e766-4e32-94b1-775454bf3449', 'created_at': datetime.datetime(2026, 9, 23, 12, 25, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 23, 12, 25, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0cd395f9-e766-4e32-94b1-775454bf3449/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:40:47 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-a8e0d30a-bb4f-4409-8fba-09f84c7afbf6 tempest-VolumesExtendTest-55461186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b328a3cb-202e-4690-86c7-cd3ab2c72c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:40:47 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-a8e0d30a-bb4f-4409-8fba-09f84c7afbf6 tempest-VolumesExtendTest-55461186 None] Volume volume-8113c950-1e45-4b31-9242-39d5460689aa (8113c950-1e45-4b31-9242-39d5460689aa): created successfully Sep 23 14:40:47 devstack sudo[97108]: pam_unix(sudo:session): session closed for user root Sep 23 14:40:47 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-a8e0d30a-bb4f-4409-8fba-09f84c7afbf6 tempest-VolumesExtendTest-55461186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b328a3cb-202e-4690-86c7-cd3ab2c72c8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:40:47 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-a8e0d30a-bb4f-4409-8fba-09f84c7afbf6 tempest-VolumesExtendTest-55461186 None] Flow 'volume_create_manager' (05e11d67-c0eb-4186-85fc-84e24103927c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:40:47 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-68aba164-e09c-4741-84f9-0d5f7b857daf tempest-VolumesListAdminTestJSON-58261631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d500ef90-e809-49ca-9cc7-7241ebc99e17 1073741824" returned: 0 in 0.562s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:40:47 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-a8e0d30a-bb4f-4409-8fba-09f84c7afbf6 tempest-VolumesExtendTest-55461186 None] Created volume successfully. Sep 23 14:40:47 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-68aba164-e09c-4741-84f9-0d5f7b857daf tempest-VolumesListAdminTestJSON-58261631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d500ef90-e809-49ca-9cc7-7241ebc99e17 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:40:47 devstack sudo[97118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d500ef90-e809-49ca-9cc7-7241ebc99e17 Sep 23 14:40:47 devstack sudo[97118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:40:48 devstack sudo[97118]: pam_unix(sudo:session): session closed for user root Sep 23 14:40:48 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-68aba164-e09c-4741-84f9-0d5f7b857daf tempest-VolumesListAdminTestJSON-58261631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d500ef90-e809-49ca-9cc7-7241ebc99e17" returned: 0 in 0.304s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:40:48 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-68aba164-e09c-4741-84f9-0d5f7b857daf tempest-VolumesListAdminTestJSON-58261631 None] <== create_volume: return (922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:40:48 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-68aba164-e09c-4741-84f9-0d5f7b857daf tempest-VolumesListAdminTestJSON-58261631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:40:48 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-68aba164-e09c-4741-84f9-0d5f7b857daf tempest-VolumesListAdminTestJSON-58261631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6306228c-8e43-46f9-af92-b3bbdd351587) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d500ef90-e809-49ca-9cc7-7241ebc99e17', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:40:48 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-68aba164-e09c-4741-84f9-0d5f7b857daf tempest-VolumesListAdminTestJSON-58261631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (466f46e4-afc2-4404-887b-c424a28656f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:40:48 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-68aba164-e09c-4741-84f9-0d5f7b857daf tempest-VolumesListAdminTestJSON-58261631 None] Volume volume-d500ef90-e809-49ca-9cc7-7241ebc99e17 (d500ef90-e809-49ca-9cc7-7241ebc99e17): created successfully Sep 23 14:40:48 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-68aba164-e09c-4741-84f9-0d5f7b857daf tempest-VolumesListAdminTestJSON-58261631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (466f46e4-afc2-4404-887b-c424a28656f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:40:48 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-68aba164-e09c-4741-84f9-0d5f7b857daf tempest-VolumesListAdminTestJSON-58261631 None] Flow 'volume_create_manager' (ec5776e1-5f12-42b2-ad7a-dd9f54518408) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:40:48 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-68aba164-e09c-4741-84f9-0d5f7b857daf tempest-VolumesListAdminTestJSON-58261631 None] Created volume successfully. Sep 23 14:40:48 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-fda60519-0ca6-4017-9734-29c3ba1983c3 tempest-VolumesExtendTest-55461186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:40:48 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-fda60519-0ca6-4017-9734-29c3ba1983c3 tempest-VolumesExtendTest-55461186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:40:48 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[138a4ce3-7a58-44ca-97d3-30fca281332f]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:40:48 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-fda60519-0ca6-4017-9734-29c3ba1983c3 tempest-VolumesExtendTest-55461186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8113c950-1e45-4b31-9242-39d5460689aa {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:40:48 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-d350327c-688c-478b-af29-e2ebd0642405 tempest-VolumesTransfersTest-1688887858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:40:48 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-d350327c-688c-478b-af29-e2ebd0642405 tempest-VolumesTransfersTest-1688887858 None] Flow 'volume_create_manager' (31191cf1-5245-42af-8015-f07c1df6bd73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:40:48 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-d350327c-688c-478b-af29-e2ebd0642405 tempest-VolumesTransfersTest-1688887858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f716e4f-0a85-49d9-a1a1-a4f6fc0bdca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:40:48 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-d350327c-688c-478b-af29-e2ebd0642405 tempest-VolumesTransfersTest-1688887858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f716e4f-0a85-49d9-a1a1-a4f6fc0bdca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:40:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1745715199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0d9141d-59b0-4ecd-b928-640b39ea4dcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24e90bbf1c474fcabc15baf6be79af41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:40:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:40:49Z,use_quota=True,user_id='41f09c32ecec409d8a596e83a598f41e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:40:48 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-d350327c-688c-478b-af29-e2ebd0642405 tempest-VolumesTransfersTest-1688887858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52fe990b-59cb-4696-bab0-11a8ebf51d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:40:48 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-d350327c-688c-478b-af29-e2ebd0642405 tempest-VolumesTransfersTest-1688887858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52fe990b-59cb-4696-bab0-11a8ebf51d18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:40:48 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-d350327c-688c-478b-af29-e2ebd0642405 tempest-VolumesTransfersTest-1688887858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce5b12f3-e05e-4ab8-880c-1cdcb57b404f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:40:48 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-d350327c-688c-478b-af29-e2ebd0642405 tempest-VolumesTransfersTest-1688887858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce5b12f3-e05e-4ab8-880c-1cdcb57b404f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0d9141d-59b0-4ecd-b928-640b39ea4dcd', 'volume_name': 'volume-b0d9141d-59b0-4ecd-b928-640b39ea4dcd', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:40:48 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-d350327c-688c-478b-af29-e2ebd0642405 tempest-VolumesTransfersTest-1688887858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3495843c-c1f7-4720-a433-69db5580800b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:40:48 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-d350327c-688c-478b-af29-e2ebd0642405 tempest-VolumesTransfersTest-1688887858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3495843c-c1f7-4720-a433-69db5580800b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:40:48 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-d350327c-688c-478b-af29-e2ebd0642405 tempest-VolumesTransfersTest-1688887858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b599759e-b44e-40c1-b2f1-57dc20b39355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:40:48 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-d350327c-688c-478b-af29-e2ebd0642405 tempest-VolumesTransfersTest-1688887858 None] Volume b0d9141d-59b0-4ecd-b928-640b39ea4dcd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0d9141d-59b0-4ecd-b928-640b39ea4dcd', 'volume_size': 1} Sep 23 14:40:48 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-d350327c-688c-478b-af29-e2ebd0642405 tempest-VolumesTransfersTest-1688887858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:40:48 devstack sudo[97122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8113c950-1e45-4b31-9242-39d5460689aa Sep 23 14:40:48 devstack sudo[97122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:40:49 devstack sudo[97122]: pam_unix(sudo:session): session closed for user root Sep 23 14:40:49 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-fda60519-0ca6-4017-9734-29c3ba1983c3 tempest-VolumesExtendTest-55461186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8113c950-1e45-4b31-9242-39d5460689aa" returned: 0 in 0.433s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:40:49 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-fda60519-0ca6-4017-9734-29c3ba1983c3 tempest-VolumesExtendTest-55461186 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8113c950-1e45-4b31-9242-39d5460689aa 2G {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:40:49 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-fda60519-0ca6-4017-9734-29c3ba1983c3 tempest-VolumesExtendTest-55461186 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8113c950-1e45-4b31-9242-39d5460689aa 2G" returned: 0 in 0.139s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:40:49 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-fda60519-0ca6-4017-9734-29c3ba1983c3 tempest-VolumesExtendTest-55461186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.611s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:40:49 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-d350327c-688c-478b-af29-e2ebd0642405 tempest-VolumesTransfersTest-1688887858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.444s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:40:49 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-d350327c-688c-478b-af29-e2ebd0642405 tempest-VolumesTransfersTest-1688887858 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:40:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1745715199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0d9141d-59b0-4ecd-b928-640b39ea4dcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24e90bbf1c474fcabc15baf6be79af41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:40:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:40:49Z,use_quota=True,user_id='41f09c32ecec409d8a596e83a598f41e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:40:49 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-d350327c-688c-478b-af29-e2ebd0642405 tempest-VolumesTransfersTest-1688887858 None] Creating volume b0d9141d-59b0-4ecd-b928-640b39ea4dcd {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:40:49 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-d350327c-688c-478b-af29-e2ebd0642405 tempest-VolumesTransfersTest-1688887858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:40:49 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-d350327c-688c-478b-af29-e2ebd0642405 tempest-VolumesTransfersTest-1688887858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:40:49 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-d350327c-688c-478b-af29-e2ebd0642405 tempest-VolumesTransfersTest-1688887858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:40:49 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-d350327c-688c-478b-af29-e2ebd0642405 tempest-VolumesTransfersTest-1688887858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:40:49 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-d350327c-688c-478b-af29-e2ebd0642405 tempest-VolumesTransfersTest-1688887858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:40:49 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-d350327c-688c-478b-af29-e2ebd0642405 tempest-VolumesTransfersTest-1688887858 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:40:49 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-d350327c-688c-478b-af29-e2ebd0642405 tempest-VolumesTransfersTest-1688887858 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:40:49 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d350327c-688c-478b-af29-e2ebd0642405 tempest-VolumesTransfersTest-1688887858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b0d9141d-59b0-4ecd-b928-640b39ea4dcd 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:40:49 devstack sudo[97131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b0d9141d-59b0-4ecd-b928-640b39ea4dcd 1073741824 Sep 23 14:40:49 devstack sudo[97131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:40:49 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-fda60519-0ca6-4017-9734-29c3ba1983c3 tempest-VolumesExtendTest-55461186 None] Extend volume completed successfully. Sep 23 14:40:49 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f5b1a2f-385a-4beb-9ed8-98ccb644d1d5 tempest-VolumesListAdminTestJSON-1379099564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:40:49 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-8f5b1a2f-385a-4beb-9ed8-98ccb644d1d5 tempest-VolumesListAdminTestJSON-1379099564 None] Flow 'volume_create_manager' (e606956a-9d05-4243-8c19-90f93b5088ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:40:49 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-8f5b1a2f-385a-4beb-9ed8-98ccb644d1d5 tempest-VolumesListAdminTestJSON-1379099564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (582c1dce-83bf-463c-aaa1-1d3d538f1b4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:40:49 devstack sudo[97131]: pam_unix(sudo:session): session closed for user root Sep 23 14:40:49 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-8f5b1a2f-385a-4beb-9ed8-98ccb644d1d5 tempest-VolumesListAdminTestJSON-1379099564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (582c1dce-83bf-463c-aaa1-1d3d538f1b4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:40:49Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7f5eee9-2928-4712-88b8-ed668ccd468f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1142d294117441c597a8fd1159eeb3da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:40:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:40:50Z,use_quota=True,user_id='94216dd7fcaa4663aa807dc082eef47a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:40:49 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-8f5b1a2f-385a-4beb-9ed8-98ccb644d1d5 tempest-VolumesListAdminTestJSON-1379099564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f33f38b-5ff3-43fe-b41d-dc074b953a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:40:49 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-8f5b1a2f-385a-4beb-9ed8-98ccb644d1d5 tempest-VolumesListAdminTestJSON-1379099564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f33f38b-5ff3-43fe-b41d-dc074b953a27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:40:49 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-8f5b1a2f-385a-4beb-9ed8-98ccb644d1d5 tempest-VolumesListAdminTestJSON-1379099564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb6f679c-1d0f-40c8-9101-41b62f3a1e0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:40:49 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-8f5b1a2f-385a-4beb-9ed8-98ccb644d1d5 tempest-VolumesListAdminTestJSON-1379099564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb6f679c-1d0f-40c8-9101-41b62f3a1e0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7f5eee9-2928-4712-88b8-ed668ccd468f', 'volume_name': 'volume-e7f5eee9-2928-4712-88b8-ed668ccd468f', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:40:49 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-8f5b1a2f-385a-4beb-9ed8-98ccb644d1d5 tempest-VolumesListAdminTestJSON-1379099564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e1e6226-7e01-4d24-a91a-63cd1d510b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:40:49 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-8f5b1a2f-385a-4beb-9ed8-98ccb644d1d5 tempest-VolumesListAdminTestJSON-1379099564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e1e6226-7e01-4d24-a91a-63cd1d510b59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:40:49 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-8f5b1a2f-385a-4beb-9ed8-98ccb644d1d5 tempest-VolumesListAdminTestJSON-1379099564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8412e31a-1e94-41d0-b51c-2d408b8e6986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:40:49 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-8f5b1a2f-385a-4beb-9ed8-98ccb644d1d5 tempest-VolumesListAdminTestJSON-1379099564 None] Volume e7f5eee9-2928-4712-88b8-ed668ccd468f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7f5eee9-2928-4712-88b8-ed668ccd468f', 'volume_size': 1} Sep 23 14:40:49 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-8f5b1a2f-385a-4beb-9ed8-98ccb644d1d5 tempest-VolumesListAdminTestJSON-1379099564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:40:49 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d350327c-688c-478b-af29-e2ebd0642405 tempest-VolumesTransfersTest-1688887858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b0d9141d-59b0-4ecd-b928-640b39ea4dcd 1073741824" returned: 0 in 0.611s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:40:50 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d350327c-688c-478b-af29-e2ebd0642405 tempest-VolumesTransfersTest-1688887858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b0d9141d-59b0-4ecd-b928-640b39ea4dcd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:40:50 devstack sudo[97137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b0d9141d-59b0-4ecd-b928-640b39ea4dcd Sep 23 14:40:50 devstack sudo[97137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:40:50 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-fddee887-d73b-4feb-928e-b71bf18f0d42 tempest-VolumesExtendTest-55461186 None] Acquiring lock "cinder-8113c950-1e45-4b31-9242-39d5460689aa-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:40:50 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-fddee887-d73b-4feb-928e-b71bf18f0d42 tempest-VolumesExtendTest-55461186 None] Lock "cinder-8113c950-1e45-4b31-9242-39d5460689aa-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:40:50 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-fddee887-d73b-4feb-928e-b71bf18f0d42 tempest-VolumesExtendTest-55461186 None] Acquiring lock "cinder-quobyte-8113c950-1e45-4b31-9242-39d5460689aa" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:40:50 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-fddee887-d73b-4feb-928e-b71bf18f0d42 tempest-VolumesExtendTest-55461186 None] Lock "cinder-quobyte-8113c950-1e45-4b31-9242-39d5460689aa" acquired by "delete_volume" :: waited 0.018s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:40:50 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[6303781f-12ac-4b69-81cd-ab14ff4cb5ff]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:40:50 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-fddee887-d73b-4feb-928e-b71bf18f0d42 tempest-VolumesExtendTest-55461186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8113c950-1e45-4b31-9242-39d5460689aa {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:40:50 devstack sudo[97137]: pam_unix(sudo:session): session closed for user root Sep 23 14:40:50 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d350327c-688c-478b-af29-e2ebd0642405 tempest-VolumesTransfersTest-1688887858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b0d9141d-59b0-4ecd-b928-640b39ea4dcd" returned: 0 in 0.296s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:40:50 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-d350327c-688c-478b-af29-e2ebd0642405 tempest-VolumesTransfersTest-1688887858 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:40:50 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-d350327c-688c-478b-af29-e2ebd0642405 tempest-VolumesTransfersTest-1688887858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:40:50 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-8f5b1a2f-385a-4beb-9ed8-98ccb644d1d5 tempest-VolumesListAdminTestJSON-1379099564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.351s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:40:50 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-8f5b1a2f-385a-4beb-9ed8-98ccb644d1d5 tempest-VolumesListAdminTestJSON-1379099564 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:40:49Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7f5eee9-2928-4712-88b8-ed668ccd468f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1142d294117441c597a8fd1159eeb3da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:40:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:40:50Z,use_quota=True,user_id='94216dd7fcaa4663aa807dc082eef47a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:40:50 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-8f5b1a2f-385a-4beb-9ed8-98ccb644d1d5 tempest-VolumesListAdminTestJSON-1379099564 None] Creating volume e7f5eee9-2928-4712-88b8-ed668ccd468f {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:40:50 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-8f5b1a2f-385a-4beb-9ed8-98ccb644d1d5 tempest-VolumesListAdminTestJSON-1379099564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:40:50 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-8f5b1a2f-385a-4beb-9ed8-98ccb644d1d5 tempest-VolumesListAdminTestJSON-1379099564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:40:50 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-8f5b1a2f-385a-4beb-9ed8-98ccb644d1d5 tempest-VolumesListAdminTestJSON-1379099564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:40:50 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-8f5b1a2f-385a-4beb-9ed8-98ccb644d1d5 tempest-VolumesListAdminTestJSON-1379099564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:40:50 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-8f5b1a2f-385a-4beb-9ed8-98ccb644d1d5 tempest-VolumesListAdminTestJSON-1379099564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:40:50 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-8f5b1a2f-385a-4beb-9ed8-98ccb644d1d5 tempest-VolumesListAdminTestJSON-1379099564 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:40:50 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-8f5b1a2f-385a-4beb-9ed8-98ccb644d1d5 tempest-VolumesListAdminTestJSON-1379099564 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:40:50 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8f5b1a2f-385a-4beb-9ed8-98ccb644d1d5 tempest-VolumesListAdminTestJSON-1379099564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e7f5eee9-2928-4712-88b8-ed668ccd468f 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:40:50 devstack sudo[97141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e7f5eee9-2928-4712-88b8-ed668ccd468f 1073741824 Sep 23 14:40:50 devstack sudo[97141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:40:50 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-d350327c-688c-478b-af29-e2ebd0642405 tempest-VolumesTransfersTest-1688887858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b599759e-b44e-40c1-b2f1-57dc20b39355) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0d9141d-59b0-4ecd-b928-640b39ea4dcd', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:40:50 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-d350327c-688c-478b-af29-e2ebd0642405 tempest-VolumesTransfersTest-1688887858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a61bf43-795d-4f71-af13-34ff1a2e1a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:40:50 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-d350327c-688c-478b-af29-e2ebd0642405 tempest-VolumesTransfersTest-1688887858 None] Volume volume-b0d9141d-59b0-4ecd-b928-640b39ea4dcd (b0d9141d-59b0-4ecd-b928-640b39ea4dcd): created successfully Sep 23 14:40:50 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-d350327c-688c-478b-af29-e2ebd0642405 tempest-VolumesTransfersTest-1688887858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a61bf43-795d-4f71-af13-34ff1a2e1a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:40:50 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-d350327c-688c-478b-af29-e2ebd0642405 tempest-VolumesTransfersTest-1688887858 None] Flow 'volume_create_manager' (31191cf1-5245-42af-8015-f07c1df6bd73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:40:50 devstack sudo[97140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8113c950-1e45-4b31-9242-39d5460689aa Sep 23 14:40:50 devstack sudo[97140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:40:50 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-d350327c-688c-478b-af29-e2ebd0642405 tempest-VolumesTransfersTest-1688887858 None] Created volume successfully. Sep 23 14:40:50 devstack sudo[97140]: pam_unix(sudo:session): session closed for user root Sep 23 14:40:50 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-fddee887-d73b-4feb-928e-b71bf18f0d42 tempest-VolumesExtendTest-55461186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8113c950-1e45-4b31-9242-39d5460689aa" returned: 0 in 0.445s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:40:50 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-fddee887-d73b-4feb-928e-b71bf18f0d42 tempest-VolumesExtendTest-55461186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8113c950-1e45-4b31-9242-39d5460689aa {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:40:50 devstack sudo[97151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8113c950-1e45-4b31-9242-39d5460689aa Sep 23 14:40:50 devstack sudo[97151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:40:50 devstack sudo[97141]: pam_unix(sudo:session): session closed for user root Sep 23 14:40:50 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8f5b1a2f-385a-4beb-9ed8-98ccb644d1d5 tempest-VolumesListAdminTestJSON-1379099564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e7f5eee9-2928-4712-88b8-ed668ccd468f 1073741824" returned: 0 in 0.587s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:40:50 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8f5b1a2f-385a-4beb-9ed8-98ccb644d1d5 tempest-VolumesListAdminTestJSON-1379099564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e7f5eee9-2928-4712-88b8-ed668ccd468f {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:40:51 devstack sudo[97154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e7f5eee9-2928-4712-88b8-ed668ccd468f Sep 23 14:40:51 devstack sudo[97154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:40:51 devstack sudo[97151]: pam_unix(sudo:session): session closed for user root Sep 23 14:40:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-fddee887-d73b-4feb-928e-b71bf18f0d42 tempest-VolumesExtendTest-55461186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8113c950-1e45-4b31-9242-39d5460689aa" returned: 0 in 0.392s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:40:51 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-fddee887-d73b-4feb-928e-b71bf18f0d42 tempest-VolumesExtendTest-55461186 None] Lock "cinder-quobyte-8113c950-1e45-4b31-9242-39d5460689aa" released by "delete_volume" :: held 0.889s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:40:51 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-fddee887-d73b-4feb-928e-b71bf18f0d42 tempest-VolumesExtendTest-55461186 None] Created reservations ['d49e7d09-b73f-43df-ace7-b714700a389a', 'bc264571-1f2d-4e1c-9b7d-056fd010922a', 'b889d3e8-55e1-46ae-9b4b-9fa6539180eb', '504c9e85-8d73-4770-b86e-5e0268101e96'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:40:51 devstack sudo[97154]: pam_unix(sudo:session): session closed for user root Sep 23 14:40:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8f5b1a2f-385a-4beb-9ed8-98ccb644d1d5 tempest-VolumesListAdminTestJSON-1379099564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e7f5eee9-2928-4712-88b8-ed668ccd468f" returned: 0 in 0.283s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:40:51 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-8f5b1a2f-385a-4beb-9ed8-98ccb644d1d5 tempest-VolumesListAdminTestJSON-1379099564 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:40:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-8f5b1a2f-385a-4beb-9ed8-98ccb644d1d5 tempest-VolumesListAdminTestJSON-1379099564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:40:51 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-8f5b1a2f-385a-4beb-9ed8-98ccb644d1d5 tempest-VolumesListAdminTestJSON-1379099564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8412e31a-1e94-41d0-b51c-2d408b8e6986) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7f5eee9-2928-4712-88b8-ed668ccd468f', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:40:51 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-8f5b1a2f-385a-4beb-9ed8-98ccb644d1d5 tempest-VolumesListAdminTestJSON-1379099564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc68d76f-07d2-4a0a-9c0d-d6d8c12cdec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:40:51 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-8f5b1a2f-385a-4beb-9ed8-98ccb644d1d5 tempest-VolumesListAdminTestJSON-1379099564 None] Volume volume-e7f5eee9-2928-4712-88b8-ed668ccd468f (e7f5eee9-2928-4712-88b8-ed668ccd468f): created successfully Sep 23 14:40:51 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-8f5b1a2f-385a-4beb-9ed8-98ccb644d1d5 tempest-VolumesListAdminTestJSON-1379099564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc68d76f-07d2-4a0a-9c0d-d6d8c12cdec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:40:51 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-8f5b1a2f-385a-4beb-9ed8-98ccb644d1d5 tempest-VolumesListAdminTestJSON-1379099564 None] Flow 'volume_create_manager' (e606956a-9d05-4243-8c19-90f93b5088ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:40:51 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-8f5b1a2f-385a-4beb-9ed8-98ccb644d1d5 tempest-VolumesListAdminTestJSON-1379099564 None] Created volume successfully. Sep 23 14:40:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-fddee887-d73b-4feb-928e-b71bf18f0d42 tempest-VolumesExtendTest-55461186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:40:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-fddee887-d73b-4feb-928e-b71bf18f0d42 tempest-VolumesExtendTest-55461186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:40:51 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-fddee887-d73b-4feb-928e-b71bf18f0d42 tempest-VolumesExtendTest-55461186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:40:51 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-fddee887-d73b-4feb-928e-b71bf18f0d42 tempest-VolumesExtendTest-55461186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:40:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-fddee887-d73b-4feb-928e-b71bf18f0d42 tempest-VolumesExtendTest-55461186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:40:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-fddee887-d73b-4feb-928e-b71bf18f0d42 tempest-VolumesExtendTest-55461186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:40:51 devstack cinder-volume[86310]: DEBUG oslo_service.periodic_task [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86310) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 14:40:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:40:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:40:51 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:40:51 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:40:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:40:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:40:51 devstack sudo[97158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:40:51 devstack sudo[97158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:40:51 devstack sudo[97160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:40:51 devstack sudo[97160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:40:51 devstack sudo[97158]: pam_unix(sudo:session): session closed for user root Sep 23 14:40:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-fddee887-d73b-4feb-928e-b71bf18f0d42 tempest-VolumesExtendTest-55461186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.341s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:40:51 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-fddee887-d73b-4feb-928e-b71bf18f0d42 tempest-VolumesExtendTest-55461186 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:40:51 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-fddee887-d73b-4feb-928e-b71bf18f0d42 tempest-VolumesExtendTest-55461186 None] Deleted volume successfully. Sep 23 14:40:51 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-fddee887-d73b-4feb-928e-b71bf18f0d42 tempest-VolumesExtendTest-55461186 None] Lock "cinder-8113c950-1e45-4b31-9242-39d5460689aa-delete_volume" released by "delete_volume" :: held 1.612s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:40:51 devstack sudo[97160]: pam_unix(sudo:session): session closed for user root Sep 23 14:40:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.411s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:40:51 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:40:51 devstack cinder-volume[86310]: DEBUG oslo_service.periodic_task [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Running periodic task VolumeManager._thread_info {{(pid=86310) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 14:40:51 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] thread count: 28 {{(pid=86310) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 14:40:51 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] thread info: [<_MainThread(MainThread, started 128854208852096)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86310) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 14:40:52 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-e99d1674-f41e-4081-b9a0-4f24f906ed70 tempest-VolumesExtendTest-55461186 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:40:52 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-e99d1674-f41e-4081-b9a0-4f24f906ed70 tempest-VolumesExtendTest-55461186 None] Flow 'volume_create_manager' (9b86acad-da29-4a12-98de-a1bd0700a49b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:40:52 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-e99d1674-f41e-4081-b9a0-4f24f906ed70 tempest-VolumesExtendTest-55461186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (178da5a9-617e-4ee0-be39-b284331c7067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:40:52 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-e99d1674-f41e-4081-b9a0-4f24f906ed70 tempest-VolumesExtendTest-55461186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (178da5a9-617e-4ee0-be39-b284331c7067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:40:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1349604795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bd765ab-755c-47ae-a016-c58b58e17f53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='143f6e6225ad432e88fd69978dca8680',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:40:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:40:52Z,use_quota=True,user_id='2ac76f89ed4d42548544535a38674be8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:40:52 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-e99d1674-f41e-4081-b9a0-4f24f906ed70 tempest-VolumesExtendTest-55461186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f63ebec8-b72d-4444-b149-aa89b16f2a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:40:52 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-e99d1674-f41e-4081-b9a0-4f24f906ed70 tempest-VolumesExtendTest-55461186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f63ebec8-b72d-4444-b149-aa89b16f2a12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:40:52 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-e99d1674-f41e-4081-b9a0-4f24f906ed70 tempest-VolumesExtendTest-55461186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6e7cdca-c84b-4193-a58b-d51d3cf34896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:40:52 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-e99d1674-f41e-4081-b9a0-4f24f906ed70 tempest-VolumesExtendTest-55461186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6e7cdca-c84b-4193-a58b-d51d3cf34896) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bd765ab-755c-47ae-a016-c58b58e17f53', 'volume_name': 'volume-3bd765ab-755c-47ae-a016-c58b58e17f53', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:40:52 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-e99d1674-f41e-4081-b9a0-4f24f906ed70 tempest-VolumesExtendTest-55461186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f17e4b1-9029-45ff-a32b-b02568f99bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:40:52 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-e99d1674-f41e-4081-b9a0-4f24f906ed70 tempest-VolumesExtendTest-55461186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f17e4b1-9029-45ff-a32b-b02568f99bb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:40:52 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-e99d1674-f41e-4081-b9a0-4f24f906ed70 tempest-VolumesExtendTest-55461186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1e8f5d4-82dd-49b3-9943-054e02b7aaa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:40:52 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-e99d1674-f41e-4081-b9a0-4f24f906ed70 tempest-VolumesExtendTest-55461186 None] Volume 3bd765ab-755c-47ae-a016-c58b58e17f53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bd765ab-755c-47ae-a016-c58b58e17f53', 'volume_size': 1} Sep 23 14:40:52 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-e99d1674-f41e-4081-b9a0-4f24f906ed70 tempest-VolumesExtendTest-55461186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:40:52 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-e99d1674-f41e-4081-b9a0-4f24f906ed70 tempest-VolumesExtendTest-55461186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:40:52 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-e99d1674-f41e-4081-b9a0-4f24f906ed70 tempest-VolumesExtendTest-55461186 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:40:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1349604795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bd765ab-755c-47ae-a016-c58b58e17f53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='143f6e6225ad432e88fd69978dca8680',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:40:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:40:52Z,use_quota=True,user_id='2ac76f89ed4d42548544535a38674be8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:40:52 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-e99d1674-f41e-4081-b9a0-4f24f906ed70 tempest-VolumesExtendTest-55461186 None] Creating volume 3bd765ab-755c-47ae-a016-c58b58e17f53 {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:40:52 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-e99d1674-f41e-4081-b9a0-4f24f906ed70 tempest-VolumesExtendTest-55461186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:40:52 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-e99d1674-f41e-4081-b9a0-4f24f906ed70 tempest-VolumesExtendTest-55461186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:40:52 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-e99d1674-f41e-4081-b9a0-4f24f906ed70 tempest-VolumesExtendTest-55461186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:40:52 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-e99d1674-f41e-4081-b9a0-4f24f906ed70 tempest-VolumesExtendTest-55461186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:40:52 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-e99d1674-f41e-4081-b9a0-4f24f906ed70 tempest-VolumesExtendTest-55461186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:40:52 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-e99d1674-f41e-4081-b9a0-4f24f906ed70 tempest-VolumesExtendTest-55461186 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:40:52 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-e99d1674-f41e-4081-b9a0-4f24f906ed70 tempest-VolumesExtendTest-55461186 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:40:52 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-e99d1674-f41e-4081-b9a0-4f24f906ed70 tempest-VolumesExtendTest-55461186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-3bd765ab-755c-47ae-a016-c58b58e17f53 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:40:52 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-2090f1cd-c0a4-4270-93a8-657473f31ef2 tempest-VolumesListAdminTestJSON-1379099564 None] Acquiring lock "cinder-e7f5eee9-2928-4712-88b8-ed668ccd468f-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:40:52 devstack sudo[97165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-3bd765ab-755c-47ae-a016-c58b58e17f53 1073741824 Sep 23 14:40:52 devstack sudo[97165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:40:52 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-2090f1cd-c0a4-4270-93a8-657473f31ef2 tempest-VolumesListAdminTestJSON-1379099564 None] Lock "cinder-e7f5eee9-2928-4712-88b8-ed668ccd468f-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:40:52 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-4f66bb73-0161-4336-be90-a81793a76376 tempest-VolumesTransfersTest-1380794414 None] Transfer volume completed successfully. Sep 23 14:40:52 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-2090f1cd-c0a4-4270-93a8-657473f31ef2 tempest-VolumesListAdminTestJSON-1379099564 None] Acquiring lock "cinder-quobyte-e7f5eee9-2928-4712-88b8-ed668ccd468f" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:40:52 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-2090f1cd-c0a4-4270-93a8-657473f31ef2 tempest-VolumesListAdminTestJSON-1379099564 None] Lock "cinder-quobyte-e7f5eee9-2928-4712-88b8-ed668ccd468f" acquired by "delete_volume" :: waited 0.019s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:40:52 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-0f06e858-e92a-4518-b57a-b5dca949c982 tempest-VolumesListAdminTestJSON-58261631 None] Acquiring lock "cinder-d500ef90-e809-49ca-9cc7-7241ebc99e17-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:40:52 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd1e3b05-c625-4447-9720-0b45f147c95f]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:40:52 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-2090f1cd-c0a4-4270-93a8-657473f31ef2 tempest-VolumesListAdminTestJSON-1379099564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e7f5eee9-2928-4712-88b8-ed668ccd468f {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:40:52 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-0f06e858-e92a-4518-b57a-b5dca949c982 tempest-VolumesListAdminTestJSON-58261631 None] Lock "cinder-d500ef90-e809-49ca-9cc7-7241ebc99e17-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:40:52 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-0f06e858-e92a-4518-b57a-b5dca949c982 tempest-VolumesListAdminTestJSON-58261631 None] Acquiring lock "cinder-quobyte-d500ef90-e809-49ca-9cc7-7241ebc99e17" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:40:52 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-0f06e858-e92a-4518-b57a-b5dca949c982 tempest-VolumesListAdminTestJSON-58261631 None] Lock "cinder-quobyte-d500ef90-e809-49ca-9cc7-7241ebc99e17" acquired by "delete_volume" :: waited 0.019s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:40:52 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[31eb37ec-0910-408d-bda6-b8506db13cee]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:40:52 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-0f06e858-e92a-4518-b57a-b5dca949c982 tempest-VolumesListAdminTestJSON-58261631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d500ef90-e809-49ca-9cc7-7241ebc99e17 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:40:52 devstack sudo[97167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e7f5eee9-2928-4712-88b8-ed668ccd468f Sep 23 14:40:52 devstack sudo[97167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:40:52 devstack sudo[97168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d500ef90-e809-49ca-9cc7-7241ebc99e17 Sep 23 14:40:52 devstack sudo[97168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:40:53 devstack sudo[97167]: pam_unix(sudo:session): session closed for user root Sep 23 14:40:53 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-2090f1cd-c0a4-4270-93a8-657473f31ef2 tempest-VolumesListAdminTestJSON-1379099564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e7f5eee9-2928-4712-88b8-ed668ccd468f" returned: 0 in 0.631s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:40:53 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-2090f1cd-c0a4-4270-93a8-657473f31ef2 tempest-VolumesListAdminTestJSON-1379099564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e7f5eee9-2928-4712-88b8-ed668ccd468f {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:40:53 devstack sudo[97165]: pam_unix(sudo:session): session closed for user root Sep 23 14:40:53 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-e99d1674-f41e-4081-b9a0-4f24f906ed70 tempest-VolumesExtendTest-55461186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-3bd765ab-755c-47ae-a016-c58b58e17f53 1073741824" returned: 0 in 0.859s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:40:53 devstack sudo[97180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e7f5eee9-2928-4712-88b8-ed668ccd468f Sep 23 14:40:53 devstack sudo[97180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:40:53 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-e99d1674-f41e-4081-b9a0-4f24f906ed70 tempest-VolumesExtendTest-55461186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-3bd765ab-755c-47ae-a016-c58b58e17f53 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:40:53 devstack sudo[97183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-3bd765ab-755c-47ae-a016-c58b58e17f53 Sep 23 14:40:53 devstack sudo[97183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:40:53 devstack sudo[97168]: pam_unix(sudo:session): session closed for user root Sep 23 14:40:53 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-0f06e858-e92a-4518-b57a-b5dca949c982 tempest-VolumesListAdminTestJSON-58261631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d500ef90-e809-49ca-9cc7-7241ebc99e17" returned: 0 in 0.590s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:40:53 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-0f06e858-e92a-4518-b57a-b5dca949c982 tempest-VolumesListAdminTestJSON-58261631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d500ef90-e809-49ca-9cc7-7241ebc99e17 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:40:53 devstack sudo[97185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d500ef90-e809-49ca-9cc7-7241ebc99e17 Sep 23 14:40:53 devstack sudo[97185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:40:53 devstack sudo[97180]: pam_unix(sudo:session): session closed for user root Sep 23 14:40:53 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-2090f1cd-c0a4-4270-93a8-657473f31ef2 tempest-VolumesListAdminTestJSON-1379099564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e7f5eee9-2928-4712-88b8-ed668ccd468f" returned: 0 in 0.346s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:40:53 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-e38d3d41-0f49-4094-8f7c-02628c47b6a5 tempest-VolumesTransfersTest-122064480 None] Acquiring lock "cinder-b0d9141d-59b0-4ecd-b928-640b39ea4dcd-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:40:53 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-2090f1cd-c0a4-4270-93a8-657473f31ef2 tempest-VolumesListAdminTestJSON-1379099564 None] Lock "cinder-quobyte-e7f5eee9-2928-4712-88b8-ed668ccd468f" released by "delete_volume" :: held 1.074s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:40:53 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-e38d3d41-0f49-4094-8f7c-02628c47b6a5 tempest-VolumesTransfersTest-122064480 None] Lock "cinder-b0d9141d-59b0-4ecd-b928-640b39ea4dcd-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:40:53 devstack sudo[97183]: pam_unix(sudo:session): session closed for user root Sep 23 14:40:53 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-e99d1674-f41e-4081-b9a0-4f24f906ed70 tempest-VolumesExtendTest-55461186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-3bd765ab-755c-47ae-a016-c58b58e17f53" returned: 0 in 0.417s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:40:53 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-e99d1674-f41e-4081-b9a0-4f24f906ed70 tempest-VolumesExtendTest-55461186 None] <== create_volume: return (1337ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:40:53 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-e99d1674-f41e-4081-b9a0-4f24f906ed70 tempest-VolumesExtendTest-55461186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.341s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:40:53 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-e38d3d41-0f49-4094-8f7c-02628c47b6a5 tempest-VolumesTransfersTest-122064480 None] Acquiring lock "cinder-quobyte-b0d9141d-59b0-4ecd-b928-640b39ea4dcd" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:40:53 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-e99d1674-f41e-4081-b9a0-4f24f906ed70 tempest-VolumesExtendTest-55461186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1e8f5d4-82dd-49b3-9943-054e02b7aaa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bd765ab-755c-47ae-a016-c58b58e17f53', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:40:53 devstack sudo[97185]: pam_unix(sudo:session): session closed for user root Sep 23 14:40:53 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-e99d1674-f41e-4081-b9a0-4f24f906ed70 tempest-VolumesExtendTest-55461186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b60c5ee2-c7fe-478f-9610-df372f71872e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:40:53 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-2090f1cd-c0a4-4270-93a8-657473f31ef2 tempest-VolumesListAdminTestJSON-1379099564 None] Created reservations ['a0fd6909-6c87-4f54-bf58-8d2eac5e16d1', '7eea8caa-42fb-493c-9346-be42c12d57b1', '1501c9d2-af81-4091-ba0a-a37ea4fe24fd', '21fa6f37-9d10-4ea2-9c43-7b96745f243f'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:40:53 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-0f06e858-e92a-4518-b57a-b5dca949c982 tempest-VolumesListAdminTestJSON-58261631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d500ef90-e809-49ca-9cc7-7241ebc99e17" returned: 0 in 0.406s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:40:53 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-e99d1674-f41e-4081-b9a0-4f24f906ed70 tempest-VolumesExtendTest-55461186 None] Volume volume-3bd765ab-755c-47ae-a016-c58b58e17f53 (3bd765ab-755c-47ae-a016-c58b58e17f53): created successfully Sep 23 14:40:53 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-e99d1674-f41e-4081-b9a0-4f24f906ed70 tempest-VolumesExtendTest-55461186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b60c5ee2-c7fe-478f-9610-df372f71872e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:40:53 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-e99d1674-f41e-4081-b9a0-4f24f906ed70 tempest-VolumesExtendTest-55461186 None] Flow 'volume_create_manager' (9b86acad-da29-4a12-98de-a1bd0700a49b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:40:53 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-0f06e858-e92a-4518-b57a-b5dca949c982 tempest-VolumesListAdminTestJSON-58261631 None] Lock "cinder-quobyte-d500ef90-e809-49ca-9cc7-7241ebc99e17" released by "delete_volume" :: held 1.095s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:40:53 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-e38d3d41-0f49-4094-8f7c-02628c47b6a5 tempest-VolumesTransfersTest-122064480 None] Lock "cinder-quobyte-b0d9141d-59b0-4ecd-b928-640b39ea4dcd" acquired by "delete_volume" :: waited 0.062s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:40:53 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[e288efed-d141-481e-b864-bafb3de01cc5]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:40:53 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-e38d3d41-0f49-4094-8f7c-02628c47b6a5 tempest-VolumesTransfersTest-122064480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b0d9141d-59b0-4ecd-b928-640b39ea4dcd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:40:53 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-e99d1674-f41e-4081-b9a0-4f24f906ed70 tempest-VolumesExtendTest-55461186 None] Created volume successfully. Sep 23 14:40:53 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-2090f1cd-c0a4-4270-93a8-657473f31ef2 tempest-VolumesListAdminTestJSON-1379099564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:40:53 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-2090f1cd-c0a4-4270-93a8-657473f31ef2 tempest-VolumesListAdminTestJSON-1379099564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:40:53 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-2090f1cd-c0a4-4270-93a8-657473f31ef2 tempest-VolumesListAdminTestJSON-1379099564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:40:53 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-2090f1cd-c0a4-4270-93a8-657473f31ef2 tempest-VolumesListAdminTestJSON-1379099564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:40:53 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-2090f1cd-c0a4-4270-93a8-657473f31ef2 tempest-VolumesListAdminTestJSON-1379099564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:40:53 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-2090f1cd-c0a4-4270-93a8-657473f31ef2 tempest-VolumesListAdminTestJSON-1379099564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:40:53 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-0f06e858-e92a-4518-b57a-b5dca949c982 tempest-VolumesListAdminTestJSON-58261631 None] Created reservations ['6f2debf1-b7d5-483e-933d-db5a468742c6', '316f42d3-524a-41d5-9edf-e6818f5f2331', '7a206bf0-393d-43e0-a207-303ded4b863d', 'df45fec3-1435-4228-9cfa-f0dc4fd51f5d'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:40:53 devstack sudo[97191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:40:53 devstack sudo[97191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:40:53 devstack sudo[97190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b0d9141d-59b0-4ecd-b928-640b39ea4dcd Sep 23 14:40:53 devstack sudo[97190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:40:53 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-0f06e858-e92a-4518-b57a-b5dca949c982 tempest-VolumesListAdminTestJSON-58261631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:40:53 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-0f06e858-e92a-4518-b57a-b5dca949c982 tempest-VolumesListAdminTestJSON-58261631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:40:53 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-0f06e858-e92a-4518-b57a-b5dca949c982 tempest-VolumesListAdminTestJSON-58261631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:40:53 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-0f06e858-e92a-4518-b57a-b5dca949c982 tempest-VolumesListAdminTestJSON-58261631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:40:53 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-0f06e858-e92a-4518-b57a-b5dca949c982 tempest-VolumesListAdminTestJSON-58261631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:40:53 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-0f06e858-e92a-4518-b57a-b5dca949c982 tempest-VolumesListAdminTestJSON-58261631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:40:53 devstack sudo[97194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:40:53 devstack sudo[97194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:40:54 devstack sudo[97191]: pam_unix(sudo:session): session closed for user root Sep 23 14:40:54 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-2090f1cd-c0a4-4270-93a8-657473f31ef2 tempest-VolumesListAdminTestJSON-1379099564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.273s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:40:54 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-2090f1cd-c0a4-4270-93a8-657473f31ef2 tempest-VolumesListAdminTestJSON-1379099564 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:40:54 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-2090f1cd-c0a4-4270-93a8-657473f31ef2 tempest-VolumesListAdminTestJSON-1379099564 None] Deleted volume successfully. Sep 23 14:40:54 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-2090f1cd-c0a4-4270-93a8-657473f31ef2 tempest-VolumesListAdminTestJSON-1379099564 None] Lock "cinder-e7f5eee9-2928-4712-88b8-ed668ccd468f-delete_volume" released by "delete_volume" :: held 1.771s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:40:54 devstack sudo[97190]: pam_unix(sudo:session): session closed for user root Sep 23 14:40:54 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-e38d3d41-0f49-4094-8f7c-02628c47b6a5 tempest-VolumesTransfersTest-122064480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b0d9141d-59b0-4ecd-b928-640b39ea4dcd" returned: 0 in 0.466s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:40:54 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-e38d3d41-0f49-4094-8f7c-02628c47b6a5 tempest-VolumesTransfersTest-122064480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b0d9141d-59b0-4ecd-b928-640b39ea4dcd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:40:54 devstack sudo[97201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b0d9141d-59b0-4ecd-b928-640b39ea4dcd Sep 23 14:40:54 devstack sudo[97201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:40:54 devstack sudo[97194]: pam_unix(sudo:session): session closed for user root Sep 23 14:40:54 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-0f06e858-e92a-4518-b57a-b5dca949c982 tempest-VolumesListAdminTestJSON-58261631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.346s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:40:54 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-0f06e858-e92a-4518-b57a-b5dca949c982 tempest-VolumesListAdminTestJSON-58261631 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:40:54 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-0f06e858-e92a-4518-b57a-b5dca949c982 tempest-VolumesListAdminTestJSON-58261631 None] Deleted volume successfully. Sep 23 14:40:54 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-0f06e858-e92a-4518-b57a-b5dca949c982 tempest-VolumesListAdminTestJSON-58261631 None] Lock "cinder-d500ef90-e809-49ca-9cc7-7241ebc99e17-delete_volume" released by "delete_volume" :: held 1.785s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:40:54 devstack sudo[97201]: pam_unix(sudo:session): session closed for user root Sep 23 14:40:54 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-e38d3d41-0f49-4094-8f7c-02628c47b6a5 tempest-VolumesTransfersTest-122064480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b0d9141d-59b0-4ecd-b928-640b39ea4dcd" returned: 0 in 0.308s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:40:54 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-e38d3d41-0f49-4094-8f7c-02628c47b6a5 tempest-VolumesTransfersTest-122064480 None] Lock "cinder-quobyte-b0d9141d-59b0-4ecd-b928-640b39ea4dcd" released by "delete_volume" :: held 0.817s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:40:54 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-70af834c-7e08-45f1-92a2-26f0bc45130b tempest-VolumesExtendTest-55461186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:40:54 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-70af834c-7e08-45f1-92a2-26f0bc45130b tempest-VolumesExtendTest-55461186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:40:54 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-70af834c-7e08-45f1-92a2-26f0bc45130b tempest-VolumesExtendTest-55461186 None] Creating offline snapshot 5b7092fb-177d-4828-a069-824c2aff8a06 of volume 3bd765ab-755c-47ae-a016-c58b58e17f53 {{(pid=86310) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 14:40:54 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b5f172c-9ddc-44eb-8e5b-41ac7d98456f]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:40:54 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-70af834c-7e08-45f1-92a2-26f0bc45130b tempest-VolumesExtendTest-55461186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-3bd765ab-755c-47ae-a016-c58b58e17f53 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:40:54 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-e38d3d41-0f49-4094-8f7c-02628c47b6a5 tempest-VolumesTransfersTest-122064480 None] Created reservations ['ce2bb729-468c-4aca-b72e-0f8b3333c346', '4110a3b4-a553-46d5-8f34-f27c14b8cda2', '21ba46b9-19b5-44bd-9f6f-25aae4bb328a', '0259ffc8-2a93-4c46-a201-086aea59040a'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:40:54 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-e38d3d41-0f49-4094-8f7c-02628c47b6a5 tempest-VolumesTransfersTest-122064480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:40:54 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-e38d3d41-0f49-4094-8f7c-02628c47b6a5 tempest-VolumesTransfersTest-122064480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:40:54 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-e38d3d41-0f49-4094-8f7c-02628c47b6a5 tempest-VolumesTransfersTest-122064480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:40:54 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-e38d3d41-0f49-4094-8f7c-02628c47b6a5 tempest-VolumesTransfersTest-122064480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:40:54 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-e38d3d41-0f49-4094-8f7c-02628c47b6a5 tempest-VolumesTransfersTest-122064480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:40:54 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-e38d3d41-0f49-4094-8f7c-02628c47b6a5 tempest-VolumesTransfersTest-122064480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:40:54 devstack sudo[97204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-3bd765ab-755c-47ae-a016-c58b58e17f53 Sep 23 14:40:54 devstack sudo[97204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:40:54 devstack sudo[97205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:40:54 devstack sudo[97205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:40:54 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-9f7f8775-a57a-4286-ac20-fe6e80205ac2 tempest-VolumesListAdminTestJSON-58261631 None] Acquiring lock "cinder-61a78e18-b781-4473-98d5-73f2f484de5f-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:40:54 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-9f7f8775-a57a-4286-ac20-fe6e80205ac2 tempest-VolumesListAdminTestJSON-58261631 None] Lock "cinder-61a78e18-b781-4473-98d5-73f2f484de5f-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:40:55 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-9f7f8775-a57a-4286-ac20-fe6e80205ac2 tempest-VolumesListAdminTestJSON-58261631 None] Acquiring lock "cinder-quobyte-61a78e18-b781-4473-98d5-73f2f484de5f" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:40:55 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-9f7f8775-a57a-4286-ac20-fe6e80205ac2 tempest-VolumesListAdminTestJSON-58261631 None] Lock "cinder-quobyte-61a78e18-b781-4473-98d5-73f2f484de5f" acquired by "delete_volume" :: waited 0.025s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:40:55 devstack sudo[97205]: pam_unix(sudo:session): session closed for user root Sep 23 14:40:55 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-e38d3d41-0f49-4094-8f7c-02628c47b6a5 tempest-VolumesTransfersTest-122064480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.386s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:40:55 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-e38d3d41-0f49-4094-8f7c-02628c47b6a5 tempest-VolumesTransfersTest-122064480 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:40:55 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-e38d3d41-0f49-4094-8f7c-02628c47b6a5 tempest-VolumesTransfersTest-122064480 None] Deleted volume successfully. Sep 23 14:40:55 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[3053c688-9684-4663-982f-7ca06ea5cfca]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:40:55 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-9f7f8775-a57a-4286-ac20-fe6e80205ac2 tempest-VolumesListAdminTestJSON-58261631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-61a78e18-b781-4473-98d5-73f2f484de5f {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:40:55 devstack sudo[97204]: pam_unix(sudo:session): session closed for user root Sep 23 14:40:55 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-e38d3d41-0f49-4094-8f7c-02628c47b6a5 tempest-VolumesTransfersTest-122064480 None] Lock "cinder-b0d9141d-59b0-4ecd-b928-640b39ea4dcd-delete_volume" released by "delete_volume" :: held 1.578s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:40:55 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-70af834c-7e08-45f1-92a2-26f0bc45130b tempest-VolumesExtendTest-55461186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-3bd765ab-755c-47ae-a016-c58b58e17f53" returned: 0 in 0.578s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:40:55 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-70af834c-7e08-45f1-92a2-26f0bc45130b tempest-VolumesExtendTest-55461186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-3bd765ab-755c-47ae-a016-c58b58e17f53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-3bd765ab-755c-47ae-a016-c58b58e17f53.5b7092fb-177d-4828-a069-824c2aff8a06 1G {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:40:55 devstack sudo[97213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-3bd765ab-755c-47ae-a016-c58b58e17f53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-3bd765ab-755c-47ae-a016-c58b58e17f53.5b7092fb-177d-4828-a069-824c2aff8a06 1G Sep 23 14:40:55 devstack sudo[97213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:40:55 devstack sudo[97212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-61a78e18-b781-4473-98d5-73f2f484de5f Sep 23 14:40:55 devstack sudo[97212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:40:55 devstack cinder-volume[86310]: DEBUG dbcounter [-] [86310] Writing DB stats cinder:UPDATE=155,cinder:SELECT=122,cinder:INSERT=37,cinder:DELETE=12 {{(pid=86310) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 14:40:55 devstack cinder-volume[86310]: DEBUG dbcounter [-] [86310] Writing DB stats cinder:SELECT=126,cinder:INSERT=45,cinder:UPDATE=163,cinder:DELETE=13 {{(pid=86310) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 14:40:55 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-7feeebdd-7aca-4364-9f70-fd8f31662990 tempest-VolumesTransfersTest-1688887858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:40:55 devstack sudo[97212]: pam_unix(sudo:session): session closed for user root Sep 23 14:40:55 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-7feeebdd-7aca-4364-9f70-fd8f31662990 tempest-VolumesTransfersTest-1688887858 None] Flow 'volume_create_manager' (4b2edf9c-49b7-4659-b4e2-4abcd2ceb09c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:40:55 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-7feeebdd-7aca-4364-9f70-fd8f31662990 tempest-VolumesTransfersTest-1688887858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e7e4089-dc79-41bd-a343-0652d814f400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:40:55 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-9f7f8775-a57a-4286-ac20-fe6e80205ac2 tempest-VolumesListAdminTestJSON-58261631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-61a78e18-b781-4473-98d5-73f2f484de5f" returned: 0 in 0.578s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:40:55 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-9f7f8775-a57a-4286-ac20-fe6e80205ac2 tempest-VolumesListAdminTestJSON-58261631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-61a78e18-b781-4473-98d5-73f2f484de5f {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:40:55 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-7feeebdd-7aca-4364-9f70-fd8f31662990 tempest-VolumesTransfersTest-1688887858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e7e4089-dc79-41bd-a343-0652d814f400) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:40:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-841381801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60d5760a-8bd8-48e1-813a-2a2084ff185f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24e90bbf1c474fcabc15baf6be79af41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:40:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:40:55Z,use_quota=True,user_id='41f09c32ecec409d8a596e83a598f41e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:40:55 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-7feeebdd-7aca-4364-9f70-fd8f31662990 tempest-VolumesTransfersTest-1688887858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7451c8d9-d5d4-4608-9e6d-e4c1a2516c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:40:55 devstack sudo[97222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-61a78e18-b781-4473-98d5-73f2f484de5f Sep 23 14:40:55 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-7feeebdd-7aca-4364-9f70-fd8f31662990 tempest-VolumesTransfersTest-1688887858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7451c8d9-d5d4-4608-9e6d-e4c1a2516c97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:40:55 devstack sudo[97222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:40:55 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-7feeebdd-7aca-4364-9f70-fd8f31662990 tempest-VolumesTransfersTest-1688887858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c84e3b18-0b39-4b2d-a361-6b1c89b80f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:40:55 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-7feeebdd-7aca-4364-9f70-fd8f31662990 tempest-VolumesTransfersTest-1688887858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c84e3b18-0b39-4b2d-a361-6b1c89b80f86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60d5760a-8bd8-48e1-813a-2a2084ff185f', 'volume_name': 'volume-60d5760a-8bd8-48e1-813a-2a2084ff185f', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:40:55 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-7feeebdd-7aca-4364-9f70-fd8f31662990 tempest-VolumesTransfersTest-1688887858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3cfe1ab-64fb-4520-9225-ef0deb00a874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:40:55 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-7feeebdd-7aca-4364-9f70-fd8f31662990 tempest-VolumesTransfersTest-1688887858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3cfe1ab-64fb-4520-9225-ef0deb00a874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:40:55 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-7feeebdd-7aca-4364-9f70-fd8f31662990 tempest-VolumesTransfersTest-1688887858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1fbf23f-5716-4178-90eb-88c5f3b76056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:40:55 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-7feeebdd-7aca-4364-9f70-fd8f31662990 tempest-VolumesTransfersTest-1688887858 None] Volume 60d5760a-8bd8-48e1-813a-2a2084ff185f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60d5760a-8bd8-48e1-813a-2a2084ff185f', 'volume_size': 1} Sep 23 14:40:55 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-7feeebdd-7aca-4364-9f70-fd8f31662990 tempest-VolumesTransfersTest-1688887858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:40:55 devstack sudo[97213]: pam_unix(sudo:session): session closed for user root Sep 23 14:40:55 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-70af834c-7e08-45f1-92a2-26f0bc45130b tempest-VolumesExtendTest-55461186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-3bd765ab-755c-47ae-a016-c58b58e17f53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-3bd765ab-755c-47ae-a016-c58b58e17f53.5b7092fb-177d-4828-a069-824c2aff8a06 1G" returned: 0 in 0.616s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:40:55 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-70af834c-7e08-45f1-92a2-26f0bc45130b tempest-VolumesExtendTest-55461186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3bd765ab-755c-47ae-a016-c58b58e17f53 -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-3bd765ab-755c-47ae-a016-c58b58e17f53.5b7092fb-177d-4828-a069-824c2aff8a06 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:40:55 devstack sudo[97224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3bd765ab-755c-47ae-a016-c58b58e17f53 -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-3bd765ab-755c-47ae-a016-c58b58e17f53.5b7092fb-177d-4828-a069-824c2aff8a06 Sep 23 14:40:55 devstack sudo[97224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:40:55 devstack sudo[97222]: pam_unix(sudo:session): session closed for user root Sep 23 14:40:55 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-9f7f8775-a57a-4286-ac20-fe6e80205ac2 tempest-VolumesListAdminTestJSON-58261631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-61a78e18-b781-4473-98d5-73f2f484de5f" returned: 0 in 0.269s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:40:55 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-9f7f8775-a57a-4286-ac20-fe6e80205ac2 tempest-VolumesListAdminTestJSON-58261631 None] Lock "cinder-quobyte-61a78e18-b781-4473-98d5-73f2f484de5f" released by "delete_volume" :: held 0.928s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:40:56 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-9f7f8775-a57a-4286-ac20-fe6e80205ac2 tempest-VolumesListAdminTestJSON-58261631 None] Created reservations ['81829d36-1df5-4a9e-81e4-d64523dbf31c', '0f0609d8-922e-496b-bc9a-5a2b03056430', '1cc0a34c-ebf7-4cd2-95f5-94d0ce8f9929', 'ac2a321a-b0c0-460d-a60f-e6c66307332b'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:40:56 devstack sudo[97224]: pam_unix(sudo:session): session closed for user root Sep 23 14:40:56 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-70af834c-7e08-45f1-92a2-26f0bc45130b tempest-VolumesExtendTest-55461186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3bd765ab-755c-47ae-a016-c58b58e17f53 -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-3bd765ab-755c-47ae-a016-c58b58e17f53.5b7092fb-177d-4828-a069-824c2aff8a06" returned: 0 in 0.353s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:40:56 devstack cinder-volume[86310]: WARNING cinder.volume.drivers.remotefs [None req-70af834c-7e08-45f1-92a2-26f0bc45130b tempest-VolumesExtendTest-55461186 None] /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-3bd765ab-755c-47ae-a016-c58b58e17f53.5b7092fb-177d-4828-a069-824c2aff8a06 is being set with open permissions: ugo+rw Sep 23 14:40:56 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-70af834c-7e08-45f1-92a2-26f0bc45130b tempest-VolumesExtendTest-55461186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-3bd765ab-755c-47ae-a016-c58b58e17f53.5b7092fb-177d-4828-a069-824c2aff8a06 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:40:56 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-9f7f8775-a57a-4286-ac20-fe6e80205ac2 tempest-VolumesListAdminTestJSON-58261631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:40:56 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-9f7f8775-a57a-4286-ac20-fe6e80205ac2 tempest-VolumesListAdminTestJSON-58261631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:40:56 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-9f7f8775-a57a-4286-ac20-fe6e80205ac2 tempest-VolumesListAdminTestJSON-58261631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:40:56 devstack sudo[97232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-3bd765ab-755c-47ae-a016-c58b58e17f53.5b7092fb-177d-4828-a069-824c2aff8a06 Sep 23 14:40:56 devstack sudo[97232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:40:56 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-9f7f8775-a57a-4286-ac20-fe6e80205ac2 tempest-VolumesListAdminTestJSON-58261631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:40:56 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-9f7f8775-a57a-4286-ac20-fe6e80205ac2 tempest-VolumesListAdminTestJSON-58261631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:40:56 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-9f7f8775-a57a-4286-ac20-fe6e80205ac2 tempest-VolumesListAdminTestJSON-58261631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:40:56 devstack sudo[97234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:40:56 devstack sudo[97234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:40:56 devstack sudo[97232]: pam_unix(sudo:session): session closed for user root Sep 23 14:40:56 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-70af834c-7e08-45f1-92a2-26f0bc45130b tempest-VolumesExtendTest-55461186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-3bd765ab-755c-47ae-a016-c58b58e17f53.5b7092fb-177d-4828-a069-824c2aff8a06" returned: 0 in 0.280s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:40:56 devstack sudo[97234]: pam_unix(sudo:session): session closed for user root Sep 23 14:40:56 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-9f7f8775-a57a-4286-ac20-fe6e80205ac2 tempest-VolumesListAdminTestJSON-58261631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.252s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:40:56 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-9f7f8775-a57a-4286-ac20-fe6e80205ac2 tempest-VolumesListAdminTestJSON-58261631 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:40:56 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-9f7f8775-a57a-4286-ac20-fe6e80205ac2 tempest-VolumesListAdminTestJSON-58261631 None] Deleted volume successfully. Sep 23 14:40:56 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-9f7f8775-a57a-4286-ac20-fe6e80205ac2 tempest-VolumesListAdminTestJSON-58261631 None] Lock "cinder-61a78e18-b781-4473-98d5-73f2f484de5f-delete_volume" released by "delete_volume" :: held 1.504s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:40:56 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-70af834c-7e08-45f1-92a2-26f0bc45130b tempest-VolumesExtendTest-55461186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-3bd765ab-755c-47ae-a016-c58b58e17f53.info {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:40:56 devstack sudo[97238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-3bd765ab-755c-47ae-a016-c58b58e17f53.info Sep 23 14:40:56 devstack sudo[97238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:40:56 devstack sudo[97238]: pam_unix(sudo:session): session closed for user root Sep 23 14:40:56 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-70af834c-7e08-45f1-92a2-26f0bc45130b tempest-VolumesExtendTest-55461186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-3bd765ab-755c-47ae-a016-c58b58e17f53.info" returned: 0 in 0.265s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:40:56 devstack cinder-volume[86310]: WARNING cinder.volume.drivers.remotefs [None req-70af834c-7e08-45f1-92a2-26f0bc45130b tempest-VolumesExtendTest-55461186 None] /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-3bd765ab-755c-47ae-a016-c58b58e17f53.info is being set with open permissions: ugo+rw Sep 23 14:40:56 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-70af834c-7e08-45f1-92a2-26f0bc45130b tempest-VolumesExtendTest-55461186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-3bd765ab-755c-47ae-a016-c58b58e17f53.info {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:40:56 devstack sudo[97241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-3bd765ab-755c-47ae-a016-c58b58e17f53.info Sep 23 14:40:56 devstack sudo[97241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:40:56 devstack sudo[97241]: pam_unix(sudo:session): session closed for user root Sep 23 14:40:56 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-70af834c-7e08-45f1-92a2-26f0bc45130b tempest-VolumesExtendTest-55461186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-3bd765ab-755c-47ae-a016-c58b58e17f53.info" returned: 0 in 0.253s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:40:56 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-70af834c-7e08-45f1-92a2-26f0bc45130b tempest-VolumesExtendTest-55461186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.469s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:40:56 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-7feeebdd-7aca-4364-9f70-fd8f31662990 tempest-VolumesTransfersTest-1688887858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.248s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:40:56 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-7feeebdd-7aca-4364-9f70-fd8f31662990 tempest-VolumesTransfersTest-1688887858 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:40:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-841381801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60d5760a-8bd8-48e1-813a-2a2084ff185f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24e90bbf1c474fcabc15baf6be79af41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:40:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:40:55Z,use_quota=True,user_id='41f09c32ecec409d8a596e83a598f41e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:40:56 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-7feeebdd-7aca-4364-9f70-fd8f31662990 tempest-VolumesTransfersTest-1688887858 None] Creating volume 60d5760a-8bd8-48e1-813a-2a2084ff185f {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:40:56 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-7feeebdd-7aca-4364-9f70-fd8f31662990 tempest-VolumesTransfersTest-1688887858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:40:56 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-7feeebdd-7aca-4364-9f70-fd8f31662990 tempest-VolumesTransfersTest-1688887858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:40:56 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-7feeebdd-7aca-4364-9f70-fd8f31662990 tempest-VolumesTransfersTest-1688887858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:40:56 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-7feeebdd-7aca-4364-9f70-fd8f31662990 tempest-VolumesTransfersTest-1688887858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:40:56 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-7feeebdd-7aca-4364-9f70-fd8f31662990 tempest-VolumesTransfersTest-1688887858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:40:56 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-7feeebdd-7aca-4364-9f70-fd8f31662990 tempest-VolumesTransfersTest-1688887858 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:40:56 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-7feeebdd-7aca-4364-9f70-fd8f31662990 tempest-VolumesTransfersTest-1688887858 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:40:56 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-7feeebdd-7aca-4364-9f70-fd8f31662990 tempest-VolumesTransfersTest-1688887858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-60d5760a-8bd8-48e1-813a-2a2084ff185f 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:40:57 devstack sudo[97244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-60d5760a-8bd8-48e1-813a-2a2084ff185f 1073741824 Sep 23 14:40:57 devstack sudo[97244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:40:57 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-70af834c-7e08-45f1-92a2-26f0bc45130b tempest-VolumesExtendTest-55461186 None] Create snapshot completed successfully Sep 23 14:40:57 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-3a46d9e7-4da6-4477-ae83-a6e10d980fd6 tempest-VolumesListAdminTestJSON-58261631 None] Acquiring lock "cinder-7d6a7800-34d0-4a97-bb6e-a91fe36bcbef-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:40:57 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-3a46d9e7-4da6-4477-ae83-a6e10d980fd6 tempest-VolumesListAdminTestJSON-58261631 None] Lock "cinder-7d6a7800-34d0-4a97-bb6e-a91fe36bcbef-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:40:57 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-3a46d9e7-4da6-4477-ae83-a6e10d980fd6 tempest-VolumesListAdminTestJSON-58261631 None] Acquiring lock "cinder-quobyte-7d6a7800-34d0-4a97-bb6e-a91fe36bcbef" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:40:57 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-3a46d9e7-4da6-4477-ae83-a6e10d980fd6 tempest-VolumesListAdminTestJSON-58261631 None] Lock "cinder-quobyte-7d6a7800-34d0-4a97-bb6e-a91fe36bcbef" acquired by "delete_volume" :: waited 0.021s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:40:57 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[824cc2f3-6669-44e1-9363-484c0eeffd2d]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:40:57 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-3a46d9e7-4da6-4477-ae83-a6e10d980fd6 tempest-VolumesListAdminTestJSON-58261631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7d6a7800-34d0-4a97-bb6e-a91fe36bcbef {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:40:57 devstack sudo[97249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7d6a7800-34d0-4a97-bb6e-a91fe36bcbef Sep 23 14:40:57 devstack sudo[97249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:40:57 devstack sudo[97244]: pam_unix(sudo:session): session closed for user root Sep 23 14:40:57 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-7feeebdd-7aca-4364-9f70-fd8f31662990 tempest-VolumesTransfersTest-1688887858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-60d5760a-8bd8-48e1-813a-2a2084ff185f 1073741824" returned: 0 in 0.531s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:40:57 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-7feeebdd-7aca-4364-9f70-fd8f31662990 tempest-VolumesTransfersTest-1688887858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-60d5760a-8bd8-48e1-813a-2a2084ff185f {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:40:57 devstack sudo[97252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-60d5760a-8bd8-48e1-813a-2a2084ff185f Sep 23 14:40:57 devstack sudo[97252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:40:57 devstack sudo[97249]: pam_unix(sudo:session): session closed for user root Sep 23 14:40:57 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-3a46d9e7-4da6-4477-ae83-a6e10d980fd6 tempest-VolumesListAdminTestJSON-58261631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7d6a7800-34d0-4a97-bb6e-a91fe36bcbef" returned: 0 in 0.467s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:40:57 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-3a46d9e7-4da6-4477-ae83-a6e10d980fd6 tempest-VolumesListAdminTestJSON-58261631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7d6a7800-34d0-4a97-bb6e-a91fe36bcbef {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:40:57 devstack sudo[97257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7d6a7800-34d0-4a97-bb6e-a91fe36bcbef Sep 23 14:40:57 devstack sudo[97257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:40:57 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-425ce3b7-5851-4c31-a405-f19d9c959521 tempest-VolumesExtendTest-55461186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:40:57 devstack sudo[97252]: pam_unix(sudo:session): session closed for user root Sep 23 14:40:57 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-7feeebdd-7aca-4364-9f70-fd8f31662990 tempest-VolumesTransfersTest-1688887858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-60d5760a-8bd8-48e1-813a-2a2084ff185f" returned: 0 in 0.289s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:40:57 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-7feeebdd-7aca-4364-9f70-fd8f31662990 tempest-VolumesTransfersTest-1688887858 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:40:57 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-7feeebdd-7aca-4364-9f70-fd8f31662990 tempest-VolumesTransfersTest-1688887858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:40:57 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-425ce3b7-5851-4c31-a405-f19d9c959521 tempest-VolumesExtendTest-55461186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.045s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:40:57 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-7feeebdd-7aca-4364-9f70-fd8f31662990 tempest-VolumesTransfersTest-1688887858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1fbf23f-5716-4178-90eb-88c5f3b76056) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60d5760a-8bd8-48e1-813a-2a2084ff185f', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:40:57 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-7feeebdd-7aca-4364-9f70-fd8f31662990 tempest-VolumesTransfersTest-1688887858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26fb9b77-9f42-458f-9813-6e28bc2c0441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:40:57 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[1555d43f-9b64-4079-b899-deecce614a3f]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:40:57 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-425ce3b7-5851-4c31-a405-f19d9c959521 tempest-VolumesExtendTest-55461186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-3bd765ab-755c-47ae-a016-c58b58e17f53 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:40:57 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-7feeebdd-7aca-4364-9f70-fd8f31662990 tempest-VolumesTransfersTest-1688887858 None] Volume volume-60d5760a-8bd8-48e1-813a-2a2084ff185f (60d5760a-8bd8-48e1-813a-2a2084ff185f): created successfully Sep 23 14:40:57 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-7feeebdd-7aca-4364-9f70-fd8f31662990 tempest-VolumesTransfersTest-1688887858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26fb9b77-9f42-458f-9813-6e28bc2c0441) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:40:57 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-7feeebdd-7aca-4364-9f70-fd8f31662990 tempest-VolumesTransfersTest-1688887858 None] Flow 'volume_create_manager' (4b2edf9c-49b7-4659-b4e2-4abcd2ceb09c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:40:57 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-7feeebdd-7aca-4364-9f70-fd8f31662990 tempest-VolumesTransfersTest-1688887858 None] Created volume successfully. Sep 23 14:40:58 devstack sudo[97260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-3bd765ab-755c-47ae-a016-c58b58e17f53 Sep 23 14:40:58 devstack sudo[97260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:40:58 devstack sudo[97257]: pam_unix(sudo:session): session closed for user root Sep 23 14:40:58 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-3a46d9e7-4da6-4477-ae83-a6e10d980fd6 tempest-VolumesListAdminTestJSON-58261631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7d6a7800-34d0-4a97-bb6e-a91fe36bcbef" returned: 0 in 0.309s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:40:58 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-3a46d9e7-4da6-4477-ae83-a6e10d980fd6 tempest-VolumesListAdminTestJSON-58261631 None] Lock "cinder-quobyte-7d6a7800-34d0-4a97-bb6e-a91fe36bcbef" released by "delete_volume" :: held 0.837s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:40:58 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-3a46d9e7-4da6-4477-ae83-a6e10d980fd6 tempest-VolumesListAdminTestJSON-58261631 None] Created reservations ['5f25a7c5-34c2-4259-ba6c-95ec41d5819f', 'cef0a37f-4421-43cf-84b0-4ab96ae975bc', '260dc173-d955-40cd-9eaa-36732606f627', '45506ca5-7d77-44ca-a28d-e429841e6b17'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:40:58 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-3a46d9e7-4da6-4477-ae83-a6e10d980fd6 tempest-VolumesListAdminTestJSON-58261631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:40:58 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-3a46d9e7-4da6-4477-ae83-a6e10d980fd6 tempest-VolumesListAdminTestJSON-58261631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:40:58 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-3a46d9e7-4da6-4477-ae83-a6e10d980fd6 tempest-VolumesListAdminTestJSON-58261631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:40:58 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-3a46d9e7-4da6-4477-ae83-a6e10d980fd6 tempest-VolumesListAdminTestJSON-58261631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:40:58 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-3a46d9e7-4da6-4477-ae83-a6e10d980fd6 tempest-VolumesListAdminTestJSON-58261631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:40:58 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-3a46d9e7-4da6-4477-ae83-a6e10d980fd6 tempest-VolumesListAdminTestJSON-58261631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:40:58 devstack sudo[97263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:40:58 devstack sudo[97263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:40:58 devstack sudo[97260]: pam_unix(sudo:session): session closed for user root Sep 23 14:40:58 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-425ce3b7-5851-4c31-a405-f19d9c959521 tempest-VolumesExtendTest-55461186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-3bd765ab-755c-47ae-a016-c58b58e17f53" returned: 0 in 0.482s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:40:58 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-425ce3b7-5851-4c31-a405-f19d9c959521 tempest-VolumesExtendTest-55461186 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-3bd765ab-755c-47ae-a016-c58b58e17f53.5b7092fb-177d-4828-a069-824c2aff8a06 2G {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:40:58 devstack sudo[97263]: pam_unix(sudo:session): session closed for user root Sep 23 14:40:58 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-3a46d9e7-4da6-4477-ae83-a6e10d980fd6 tempest-VolumesListAdminTestJSON-58261631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.368s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:40:58 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-3a46d9e7-4da6-4477-ae83-a6e10d980fd6 tempest-VolumesListAdminTestJSON-58261631 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:40:58 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-3a46d9e7-4da6-4477-ae83-a6e10d980fd6 tempest-VolumesListAdminTestJSON-58261631 None] Deleted volume successfully. Sep 23 14:40:58 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-425ce3b7-5851-4c31-a405-f19d9c959521 tempest-VolumesExtendTest-55461186 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-3bd765ab-755c-47ae-a016-c58b58e17f53.5b7092fb-177d-4828-a069-824c2aff8a06 2G" returned: 0 in 0.210s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:40:58 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-425ce3b7-5851-4c31-a405-f19d9c959521 tempest-VolumesExtendTest-55461186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.758s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:40:58 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-3a46d9e7-4da6-4477-ae83-a6e10d980fd6 tempest-VolumesListAdminTestJSON-58261631 None] Lock "cinder-7d6a7800-34d0-4a97-bb6e-a91fe36bcbef-delete_volume" released by "delete_volume" :: held 1.468s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:40:58 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-425ce3b7-5851-4c31-a405-f19d9c959521 tempest-VolumesExtendTest-55461186 None] Extend volume completed successfully. Sep 23 14:40:59 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-5970c162-0a12-42ef-a6e4-e7b68bc8ded4 tempest-VolumesTransfersTest-122064480 None] Acquiring lock "cinder-60d5760a-8bd8-48e1-813a-2a2084ff185f-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:40:59 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-f903f822-eb9b-459f-a0b5-5184e6cd95ec tempest-VolumesExtendTest-55461186 None] Acquiring lock "cinder-5b7092fb-177d-4828-a069-824c2aff8a06-delete_snapshot" by "delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:40:59 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-5970c162-0a12-42ef-a6e4-e7b68bc8ded4 tempest-VolumesTransfersTest-122064480 None] Lock "cinder-60d5760a-8bd8-48e1-813a-2a2084ff185f-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:40:59 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-f903f822-eb9b-459f-a0b5-5184e6cd95ec tempest-VolumesExtendTest-55461186 None] Lock "cinder-5b7092fb-177d-4828-a069-824c2aff8a06-delete_snapshot" acquired by "delete_snapshot" :: waited 0.054s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:40:59 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-f903f822-eb9b-459f-a0b5-5184e6cd95ec tempest-VolumesExtendTest-55461186 None] Acquiring lock "cinder-quobyte-3bd765ab-755c-47ae-a016-c58b58e17f53" by "delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:40:59 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-f903f822-eb9b-459f-a0b5-5184e6cd95ec tempest-VolumesExtendTest-55461186 None] Lock "cinder-quobyte-3bd765ab-755c-47ae-a016-c58b58e17f53" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:40:59 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-f903f822-eb9b-459f-a0b5-5184e6cd95ec tempest-VolumesExtendTest-55461186 None] Acquiring lock "cinder-quobyte-5b7092fb-177d-4828-a069-824c2aff8a06" by "_delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:40:59 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-5970c162-0a12-42ef-a6e4-e7b68bc8ded4 tempest-VolumesTransfersTest-122064480 None] Acquiring lock "cinder-quobyte-60d5760a-8bd8-48e1-813a-2a2084ff185f" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:40:59 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-5970c162-0a12-42ef-a6e4-e7b68bc8ded4 tempest-VolumesTransfersTest-122064480 None] Lock "cinder-quobyte-60d5760a-8bd8-48e1-813a-2a2084ff185f" acquired by "delete_volume" :: waited 0.017s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:40:59 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-f903f822-eb9b-459f-a0b5-5184e6cd95ec tempest-VolumesExtendTest-55461186 None] Lock "cinder-quobyte-5b7092fb-177d-4828-a069-824c2aff8a06" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:40:59 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-f903f822-eb9b-459f-a0b5-5184e6cd95ec tempest-VolumesExtendTest-55461186 None] Deleting offline snapshot 5b7092fb-177d-4828-a069-824c2aff8a06 of volume 3bd765ab-755c-47ae-a016-c58b58e17f53 {{(pid=86310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 14:40:59 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-f903f822-eb9b-459f-a0b5-5184e6cd95ec tempest-VolumesExtendTest-55461186 None] snapshot_file for this snap is: volume-3bd765ab-755c-47ae-a016-c58b58e17f53.5b7092fb-177d-4828-a069-824c2aff8a06 {{(pid=86310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 14:40:59 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eadf4d8-1a88-43ae-9b2d-66b95bd662c4]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:40:59 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-5970c162-0a12-42ef-a6e4-e7b68bc8ded4 tempest-VolumesTransfersTest-122064480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-60d5760a-8bd8-48e1-813a-2a2084ff185f {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:40:59 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[e29cccf3-9349-4693-8ef3-3bdc98759ffd]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:40:59 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-f903f822-eb9b-459f-a0b5-5184e6cd95ec tempest-VolumesExtendTest-55461186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-3bd765ab-755c-47ae-a016-c58b58e17f53.5b7092fb-177d-4828-a069-824c2aff8a06 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:40:59 devstack sudo[97274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-60d5760a-8bd8-48e1-813a-2a2084ff185f Sep 23 14:40:59 devstack sudo[97274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:40:59 devstack sudo[97275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-3bd765ab-755c-47ae-a016-c58b58e17f53.5b7092fb-177d-4828-a069-824c2aff8a06 Sep 23 14:40:59 devstack sudo[97275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:40:59 devstack sudo[97274]: pam_unix(sudo:session): session closed for user root Sep 23 14:40:59 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-5970c162-0a12-42ef-a6e4-e7b68bc8ded4 tempest-VolumesTransfersTest-122064480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-60d5760a-8bd8-48e1-813a-2a2084ff185f" returned: 0 in 0.471s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:40:59 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-5970c162-0a12-42ef-a6e4-e7b68bc8ded4 tempest-VolumesTransfersTest-122064480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-60d5760a-8bd8-48e1-813a-2a2084ff185f {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:40:59 devstack sudo[97275]: pam_unix(sudo:session): session closed for user root Sep 23 14:40:59 devstack sudo[97284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-60d5760a-8bd8-48e1-813a-2a2084ff185f Sep 23 14:40:59 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-f903f822-eb9b-459f-a0b5-5184e6cd95ec tempest-VolumesExtendTest-55461186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-3bd765ab-755c-47ae-a016-c58b58e17f53.5b7092fb-177d-4828-a069-824c2aff8a06" returned: 0 in 0.485s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:40:59 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-f903f822-eb9b-459f-a0b5-5184e6cd95ec tempest-VolumesExtendTest-55461186 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3bd765ab-755c-47ae-a016-c58b58e17f53(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 14:40:59 devstack sudo[97284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:40:59 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[50dfe31f-cf4a-41f4-bd3f-f31b181d455d]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:40:59 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-f903f822-eb9b-459f-a0b5-5184e6cd95ec tempest-VolumesExtendTest-55461186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-3bd765ab-755c-47ae-a016-c58b58e17f53 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:40:59 devstack sudo[97286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-3bd765ab-755c-47ae-a016-c58b58e17f53 Sep 23 14:40:59 devstack sudo[97286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:41:00 devstack sudo[97284]: pam_unix(sudo:session): session closed for user root Sep 23 14:41:00 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-5970c162-0a12-42ef-a6e4-e7b68bc8ded4 tempest-VolumesTransfersTest-122064480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-60d5760a-8bd8-48e1-813a-2a2084ff185f" returned: 0 in 0.343s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:41:00 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-5970c162-0a12-42ef-a6e4-e7b68bc8ded4 tempest-VolumesTransfersTest-122064480 None] Lock "cinder-quobyte-60d5760a-8bd8-48e1-813a-2a2084ff185f" released by "delete_volume" :: held 0.889s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:41:00 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-5970c162-0a12-42ef-a6e4-e7b68bc8ded4 tempest-VolumesTransfersTest-122064480 None] Created reservations ['68e2bf0a-b54c-4a81-a4ff-1b9ac02dfb8c', '3fd62a57-4b30-4a1d-88c7-3e7f6f559f5b', 'bb823a71-479c-4c3f-8c5d-6721bec310f7', '5e8c3759-377b-4650-b375-6c9f5b10e6cb'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:41:00 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-5970c162-0a12-42ef-a6e4-e7b68bc8ded4 tempest-VolumesTransfersTest-122064480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:41:00 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-5970c162-0a12-42ef-a6e4-e7b68bc8ded4 tempest-VolumesTransfersTest-122064480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:41:00 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-5970c162-0a12-42ef-a6e4-e7b68bc8ded4 tempest-VolumesTransfersTest-122064480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:41:00 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-5970c162-0a12-42ef-a6e4-e7b68bc8ded4 tempest-VolumesTransfersTest-122064480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:41:00 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-5970c162-0a12-42ef-a6e4-e7b68bc8ded4 tempest-VolumesTransfersTest-122064480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:41:00 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-5970c162-0a12-42ef-a6e4-e7b68bc8ded4 tempest-VolumesTransfersTest-122064480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:41:00 devstack sudo[97292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:41:00 devstack sudo[97292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:41:00 devstack sudo[97286]: pam_unix(sudo:session): session closed for user root Sep 23 14:41:00 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-f903f822-eb9b-459f-a0b5-5184e6cd95ec tempest-VolumesExtendTest-55461186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-3bd765ab-755c-47ae-a016-c58b58e17f53" returned: 0 in 0.591s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:41:00 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-f903f822-eb9b-459f-a0b5-5184e6cd95ec tempest-VolumesExtendTest-55461186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-3bd765ab-755c-47ae-a016-c58b58e17f53.5b7092fb-177d-4828-a069-824c2aff8a06 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:41:00 devstack sudo[97294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-3bd765ab-755c-47ae-a016-c58b58e17f53.5b7092fb-177d-4828-a069-824c2aff8a06 Sep 23 14:41:00 devstack sudo[97294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:41:00 devstack sudo[97292]: pam_unix(sudo:session): session closed for user root Sep 23 14:41:00 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-5970c162-0a12-42ef-a6e4-e7b68bc8ded4 tempest-VolumesTransfersTest-122064480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.364s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:41:00 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-5970c162-0a12-42ef-a6e4-e7b68bc8ded4 tempest-VolumesTransfersTest-122064480 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:41:00 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-5970c162-0a12-42ef-a6e4-e7b68bc8ded4 tempest-VolumesTransfersTest-122064480 None] Deleted volume successfully. Sep 23 14:41:00 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-5970c162-0a12-42ef-a6e4-e7b68bc8ded4 tempest-VolumesTransfersTest-122064480 None] Lock "cinder-60d5760a-8bd8-48e1-813a-2a2084ff185f-delete_volume" released by "delete_volume" :: held 1.646s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:41:00 devstack sudo[97294]: pam_unix(sudo:session): session closed for user root Sep 23 14:41:00 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-f903f822-eb9b-459f-a0b5-5184e6cd95ec tempest-VolumesExtendTest-55461186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-3bd765ab-755c-47ae-a016-c58b58e17f53.5b7092fb-177d-4828-a069-824c2aff8a06" returned: 0 in 0.517s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:41:00 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-f903f822-eb9b-459f-a0b5-5184e6cd95ec tempest-VolumesExtendTest-55461186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-3bd765ab-755c-47ae-a016-c58b58e17f53.5b7092fb-177d-4828-a069-824c2aff8a06 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:41:00 devstack sudo[97301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-3bd765ab-755c-47ae-a016-c58b58e17f53.5b7092fb-177d-4828-a069-824c2aff8a06 Sep 23 14:41:00 devstack sudo[97301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:41:01 devstack sudo[97301]: pam_unix(sudo:session): session closed for user root Sep 23 14:41:01 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-f903f822-eb9b-459f-a0b5-5184e6cd95ec tempest-VolumesExtendTest-55461186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-3bd765ab-755c-47ae-a016-c58b58e17f53.5b7092fb-177d-4828-a069-824c2aff8a06" returned: 0 in 0.276s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:41:01 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-f903f822-eb9b-459f-a0b5-5184e6cd95ec tempest-VolumesExtendTest-55461186 None] Lock "cinder-quobyte-5b7092fb-177d-4828-a069-824c2aff8a06" released by "_delete_snapshot" :: held 2.032s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:41:01 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-f903f822-eb9b-459f-a0b5-5184e6cd95ec tempest-VolumesExtendTest-55461186 None] Lock "cinder-quobyte-3bd765ab-755c-47ae-a016-c58b58e17f53" released by "delete_snapshot" :: held 2.084s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:41:01 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-f903f822-eb9b-459f-a0b5-5184e6cd95ec tempest-VolumesExtendTest-55461186 None] Created reservations ['c3693bec-57a3-42e7-aafb-5ed6b5d05e92', '6a12f3bd-e9e5-4311-a117-62dc6ea91822', '6fab9750-8e95-49df-9c1d-66b62e1c7ce2', '315096a3-f3d6-4cd4-81d9-7f9b82158203'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:41:01 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-f903f822-eb9b-459f-a0b5-5184e6cd95ec tempest-VolumesExtendTest-55461186 None] Delete snapshot completed successfully. Sep 23 14:41:01 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-f903f822-eb9b-459f-a0b5-5184e6cd95ec tempest-VolumesExtendTest-55461186 None] Lock "cinder-5b7092fb-177d-4828-a069-824c2aff8a06-delete_snapshot" released by "delete_snapshot" :: held 2.305s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:41:02 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-0e9124f1-144a-4d48-b8ce-b5f86d8da1e7 tempest-VolumesExtendTest-55461186 None] Acquiring lock "cinder-3bd765ab-755c-47ae-a016-c58b58e17f53-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:41:02 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-0e9124f1-144a-4d48-b8ce-b5f86d8da1e7 tempest-VolumesExtendTest-55461186 None] Lock "cinder-3bd765ab-755c-47ae-a016-c58b58e17f53-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:41:02 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-0e9124f1-144a-4d48-b8ce-b5f86d8da1e7 tempest-VolumesExtendTest-55461186 None] Acquiring lock "cinder-quobyte-3bd765ab-755c-47ae-a016-c58b58e17f53" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:41:02 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-0e9124f1-144a-4d48-b8ce-b5f86d8da1e7 tempest-VolumesExtendTest-55461186 None] Lock "cinder-quobyte-3bd765ab-755c-47ae-a016-c58b58e17f53" acquired by "delete_volume" :: waited 0.018s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:41:02 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[279c6a26-bf3f-44a4-814e-321ee5f32dd8]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:41:02 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-0e9124f1-144a-4d48-b8ce-b5f86d8da1e7 tempest-VolumesExtendTest-55461186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-3bd765ab-755c-47ae-a016-c58b58e17f53 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:41:02 devstack sudo[97305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-3bd765ab-755c-47ae-a016-c58b58e17f53 Sep 23 14:41:02 devstack sudo[97305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:41:03 devstack sudo[97305]: pam_unix(sudo:session): session closed for user root Sep 23 14:41:03 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-0e9124f1-144a-4d48-b8ce-b5f86d8da1e7 tempest-VolumesExtendTest-55461186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-3bd765ab-755c-47ae-a016-c58b58e17f53" returned: 0 in 0.375s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:41:03 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-0e9124f1-144a-4d48-b8ce-b5f86d8da1e7 tempest-VolumesExtendTest-55461186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-3bd765ab-755c-47ae-a016-c58b58e17f53 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:41:03 devstack sudo[97311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-3bd765ab-755c-47ae-a016-c58b58e17f53 Sep 23 14:41:03 devstack sudo[97311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:41:03 devstack sudo[97311]: pam_unix(sudo:session): session closed for user root Sep 23 14:41:03 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-0e9124f1-144a-4d48-b8ce-b5f86d8da1e7 tempest-VolumesExtendTest-55461186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-3bd765ab-755c-47ae-a016-c58b58e17f53" returned: 0 in 0.263s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:41:03 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-0e9124f1-144a-4d48-b8ce-b5f86d8da1e7 tempest-VolumesExtendTest-55461186 None] Lock "cinder-quobyte-3bd765ab-755c-47ae-a016-c58b58e17f53" released by "delete_volume" :: held 0.706s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:41:03 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-0e9124f1-144a-4d48-b8ce-b5f86d8da1e7 tempest-VolumesExtendTest-55461186 None] Created reservations ['044d7c0d-0861-4b79-a018-7beb3af11111', '8c4b26c6-3fda-432f-af86-27aea5cb0696', '2df45513-1ebe-4349-a668-5c840f93c3ee', 'b3530ffe-96e6-4600-81c7-ac1d88c0440d'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:41:03 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-0e9124f1-144a-4d48-b8ce-b5f86d8da1e7 tempest-VolumesExtendTest-55461186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:41:03 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-0e9124f1-144a-4d48-b8ce-b5f86d8da1e7 tempest-VolumesExtendTest-55461186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:41:03 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-0e9124f1-144a-4d48-b8ce-b5f86d8da1e7 tempest-VolumesExtendTest-55461186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:41:03 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-0e9124f1-144a-4d48-b8ce-b5f86d8da1e7 tempest-VolumesExtendTest-55461186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:41:03 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-0e9124f1-144a-4d48-b8ce-b5f86d8da1e7 tempest-VolumesExtendTest-55461186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:41:03 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-0e9124f1-144a-4d48-b8ce-b5f86d8da1e7 tempest-VolumesExtendTest-55461186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:41:03 devstack sudo[97314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:41:03 devstack sudo[97314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:41:03 devstack sudo[97314]: pam_unix(sudo:session): session closed for user root Sep 23 14:41:03 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-0e9124f1-144a-4d48-b8ce-b5f86d8da1e7 tempest-VolumesExtendTest-55461186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.339s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:41:03 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-0e9124f1-144a-4d48-b8ce-b5f86d8da1e7 tempest-VolumesExtendTest-55461186 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:41:03 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-0e9124f1-144a-4d48-b8ce-b5f86d8da1e7 tempest-VolumesExtendTest-55461186 None] Deleted volume successfully. Sep 23 14:41:03 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-0e9124f1-144a-4d48-b8ce-b5f86d8da1e7 tempest-VolumesExtendTest-55461186 None] Lock "cinder-3bd765ab-755c-47ae-a016-c58b58e17f53-delete_volume" released by "delete_volume" :: held 1.318s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:41:06 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-02bf8237-e45b-45c8-b0da-a01848d1b61c tempest-VolumeQuotasNegativeTestJSON-134074940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:41:06 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-02bf8237-e45b-45c8-b0da-a01848d1b61c tempest-VolumeQuotasNegativeTestJSON-134074940 None] Flow 'volume_create_manager' (bbcab68c-3b15-45c7-8b6c-673443f549b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:41:06 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-02bf8237-e45b-45c8-b0da-a01848d1b61c tempest-VolumeQuotasNegativeTestJSON-134074940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b3addba-77e0-42d8-8b94-28baa56051a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:41:06 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-02bf8237-e45b-45c8-b0da-a01848d1b61c tempest-VolumeQuotasNegativeTestJSON-134074940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b3addba-77e0-42d8-8b94-28baa56051a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:41:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1042256892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e82845d-e881-4b13-b904-dd8109ec225a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fc57715894b493cac2575484e7ac469',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:41:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:41:06Z,use_quota=True,user_id='220d542fa44e4aab822d6e265c14e0d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:41:06 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-02bf8237-e45b-45c8-b0da-a01848d1b61c tempest-VolumeQuotasNegativeTestJSON-134074940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fbd9c61-5243-4dc8-80c9-0341153b84ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:41:06 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-02bf8237-e45b-45c8-b0da-a01848d1b61c tempest-VolumeQuotasNegativeTestJSON-134074940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fbd9c61-5243-4dc8-80c9-0341153b84ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:41:06 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-02bf8237-e45b-45c8-b0da-a01848d1b61c tempest-VolumeQuotasNegativeTestJSON-134074940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eec5ddcf-b836-4088-8c68-ec1f513c7f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:41:06 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-02bf8237-e45b-45c8-b0da-a01848d1b61c tempest-VolumeQuotasNegativeTestJSON-134074940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eec5ddcf-b836-4088-8c68-ec1f513c7f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e82845d-e881-4b13-b904-dd8109ec225a', 'volume_name': 'volume-1e82845d-e881-4b13-b904-dd8109ec225a', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:41:06 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-02bf8237-e45b-45c8-b0da-a01848d1b61c tempest-VolumeQuotasNegativeTestJSON-134074940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c50310f-69ff-4f06-8bb2-4ef5a4ee4e55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:41:06 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-02bf8237-e45b-45c8-b0da-a01848d1b61c tempest-VolumeQuotasNegativeTestJSON-134074940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c50310f-69ff-4f06-8bb2-4ef5a4ee4e55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:41:06 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-02bf8237-e45b-45c8-b0da-a01848d1b61c tempest-VolumeQuotasNegativeTestJSON-134074940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12925029-47c1-42de-8928-be4980037de2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:41:06 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-02bf8237-e45b-45c8-b0da-a01848d1b61c tempest-VolumeQuotasNegativeTestJSON-134074940 None] Volume 1e82845d-e881-4b13-b904-dd8109ec225a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e82845d-e881-4b13-b904-dd8109ec225a', 'volume_size': 1} Sep 23 14:41:06 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-02bf8237-e45b-45c8-b0da-a01848d1b61c tempest-VolumeQuotasNegativeTestJSON-134074940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:41:06 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-02bf8237-e45b-45c8-b0da-a01848d1b61c tempest-VolumeQuotasNegativeTestJSON-134074940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:41:06 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-02bf8237-e45b-45c8-b0da-a01848d1b61c tempest-VolumeQuotasNegativeTestJSON-134074940 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:41:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1042256892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e82845d-e881-4b13-b904-dd8109ec225a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fc57715894b493cac2575484e7ac469',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:41:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:41:06Z,use_quota=True,user_id='220d542fa44e4aab822d6e265c14e0d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:41:06 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-02bf8237-e45b-45c8-b0da-a01848d1b61c tempest-VolumeQuotasNegativeTestJSON-134074940 None] Creating volume 1e82845d-e881-4b13-b904-dd8109ec225a {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:41:06 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-02bf8237-e45b-45c8-b0da-a01848d1b61c tempest-VolumeQuotasNegativeTestJSON-134074940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:41:06 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-02bf8237-e45b-45c8-b0da-a01848d1b61c tempest-VolumeQuotasNegativeTestJSON-134074940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:41:06 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-02bf8237-e45b-45c8-b0da-a01848d1b61c tempest-VolumeQuotasNegativeTestJSON-134074940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:41:06 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-02bf8237-e45b-45c8-b0da-a01848d1b61c tempest-VolumeQuotasNegativeTestJSON-134074940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:41:06 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-02bf8237-e45b-45c8-b0da-a01848d1b61c tempest-VolumeQuotasNegativeTestJSON-134074940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:41:06 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-02bf8237-e45b-45c8-b0da-a01848d1b61c tempest-VolumeQuotasNegativeTestJSON-134074940 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:41:06 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-02bf8237-e45b-45c8-b0da-a01848d1b61c tempest-VolumeQuotasNegativeTestJSON-134074940 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:41:06 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-02bf8237-e45b-45c8-b0da-a01848d1b61c tempest-VolumeQuotasNegativeTestJSON-134074940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-1e82845d-e881-4b13-b904-dd8109ec225a 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:41:06 devstack sudo[97317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-1e82845d-e881-4b13-b904-dd8109ec225a 1073741824 Sep 23 14:41:06 devstack sudo[97317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:41:07 devstack sudo[97317]: pam_unix(sudo:session): session closed for user root Sep 23 14:41:07 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-02bf8237-e45b-45c8-b0da-a01848d1b61c tempest-VolumeQuotasNegativeTestJSON-134074940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-1e82845d-e881-4b13-b904-dd8109ec225a 1073741824" returned: 0 in 0.699s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:41:07 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-02bf8237-e45b-45c8-b0da-a01848d1b61c tempest-VolumeQuotasNegativeTestJSON-134074940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-1e82845d-e881-4b13-b904-dd8109ec225a {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:41:07 devstack sudo[97324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-1e82845d-e881-4b13-b904-dd8109ec225a Sep 23 14:41:07 devstack sudo[97324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:41:07 devstack sudo[97324]: pam_unix(sudo:session): session closed for user root Sep 23 14:41:07 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-02bf8237-e45b-45c8-b0da-a01848d1b61c tempest-VolumeQuotasNegativeTestJSON-134074940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-1e82845d-e881-4b13-b904-dd8109ec225a" returned: 0 in 0.339s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:41:07 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-02bf8237-e45b-45c8-b0da-a01848d1b61c tempest-VolumeQuotasNegativeTestJSON-134074940 None] <== create_volume: return (1111ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:41:07 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-02bf8237-e45b-45c8-b0da-a01848d1b61c tempest-VolumeQuotasNegativeTestJSON-134074940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.116s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:41:07 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-02bf8237-e45b-45c8-b0da-a01848d1b61c tempest-VolumeQuotasNegativeTestJSON-134074940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12925029-47c1-42de-8928-be4980037de2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e82845d-e881-4b13-b904-dd8109ec225a', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:41:07 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-02bf8237-e45b-45c8-b0da-a01848d1b61c tempest-VolumeQuotasNegativeTestJSON-134074940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7620f236-da60-46a0-9ce4-9c4b3450960d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:41:07 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-02bf8237-e45b-45c8-b0da-a01848d1b61c tempest-VolumeQuotasNegativeTestJSON-134074940 None] Volume volume-1e82845d-e881-4b13-b904-dd8109ec225a (1e82845d-e881-4b13-b904-dd8109ec225a): created successfully Sep 23 14:41:07 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-02bf8237-e45b-45c8-b0da-a01848d1b61c tempest-VolumeQuotasNegativeTestJSON-134074940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7620f236-da60-46a0-9ce4-9c4b3450960d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:41:07 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-02bf8237-e45b-45c8-b0da-a01848d1b61c tempest-VolumeQuotasNegativeTestJSON-134074940 None] Flow 'volume_create_manager' (bbcab68c-3b15-45c7-8b6c-673443f549b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:41:07 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-02bf8237-e45b-45c8-b0da-a01848d1b61c tempest-VolumeQuotasNegativeTestJSON-134074940 None] Created volume successfully. Sep 23 14:41:09 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-b01d28e4-a7d8-4f83-b23b-9e9f4c6e2ffc tempest-VolumesNegativeTest-1045013219 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:41:09 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-b01d28e4-a7d8-4f83-b23b-9e9f4c6e2ffc tempest-VolumesNegativeTest-1045013219 None] Flow 'volume_create_manager' (2e3f45e6-2b42-4e5d-8c37-97904608e132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:41:09 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-b01d28e4-a7d8-4f83-b23b-9e9f4c6e2ffc tempest-VolumesNegativeTest-1045013219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (261d61a0-55dd-42ad-8e96-10838ef5603a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:41:09 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-b01d28e4-a7d8-4f83-b23b-9e9f4c6e2ffc tempest-VolumesNegativeTest-1045013219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (261d61a0-55dd-42ad-8e96-10838ef5603a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:41:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1903797345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80d8668d-7747-471f-b26c-68006ca71a50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a750930658584588b05a08f8a6229dd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:41:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:41:09Z,use_quota=True,user_id='4fbf8ce4ddfb4f38ba6bae059b732b6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:41:09 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-b01d28e4-a7d8-4f83-b23b-9e9f4c6e2ffc tempest-VolumesNegativeTest-1045013219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f02a064-8988-43c1-917e-6dcb5ec59a35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:41:09 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-b01d28e4-a7d8-4f83-b23b-9e9f4c6e2ffc tempest-VolumesNegativeTest-1045013219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f02a064-8988-43c1-917e-6dcb5ec59a35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:41:09 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-b01d28e4-a7d8-4f83-b23b-9e9f4c6e2ffc tempest-VolumesNegativeTest-1045013219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (664a4b9f-202c-4ef5-ab51-15e5202d9381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:41:09 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-b01d28e4-a7d8-4f83-b23b-9e9f4c6e2ffc tempest-VolumesNegativeTest-1045013219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (664a4b9f-202c-4ef5-ab51-15e5202d9381) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80d8668d-7747-471f-b26c-68006ca71a50', 'volume_name': 'volume-80d8668d-7747-471f-b26c-68006ca71a50', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:41:09 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-b01d28e4-a7d8-4f83-b23b-9e9f4c6e2ffc tempest-VolumesNegativeTest-1045013219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d6aefa6-1347-4a2e-b3cd-009be694b3e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:41:09 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-b01d28e4-a7d8-4f83-b23b-9e9f4c6e2ffc tempest-VolumesNegativeTest-1045013219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d6aefa6-1347-4a2e-b3cd-009be694b3e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:41:09 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-b01d28e4-a7d8-4f83-b23b-9e9f4c6e2ffc tempest-VolumesNegativeTest-1045013219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6a1b5fc-ec77-49d7-a4d9-eeb8d1f5aee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:41:09 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-b01d28e4-a7d8-4f83-b23b-9e9f4c6e2ffc tempest-VolumesNegativeTest-1045013219 None] Volume 80d8668d-7747-471f-b26c-68006ca71a50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80d8668d-7747-471f-b26c-68006ca71a50', 'volume_size': 1} Sep 23 14:41:09 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-b01d28e4-a7d8-4f83-b23b-9e9f4c6e2ffc tempest-VolumesNegativeTest-1045013219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:41:09 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-b01d28e4-a7d8-4f83-b23b-9e9f4c6e2ffc tempest-VolumesNegativeTest-1045013219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:41:09 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-b01d28e4-a7d8-4f83-b23b-9e9f4c6e2ffc tempest-VolumesNegativeTest-1045013219 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:41:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1903797345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80d8668d-7747-471f-b26c-68006ca71a50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a750930658584588b05a08f8a6229dd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:41:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:41:09Z,use_quota=True,user_id='4fbf8ce4ddfb4f38ba6bae059b732b6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:41:09 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-b01d28e4-a7d8-4f83-b23b-9e9f4c6e2ffc tempest-VolumesNegativeTest-1045013219 None] Creating volume 80d8668d-7747-471f-b26c-68006ca71a50 {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:41:09 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-b01d28e4-a7d8-4f83-b23b-9e9f4c6e2ffc tempest-VolumesNegativeTest-1045013219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:41:09 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-b01d28e4-a7d8-4f83-b23b-9e9f4c6e2ffc tempest-VolumesNegativeTest-1045013219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:41:09 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-b01d28e4-a7d8-4f83-b23b-9e9f4c6e2ffc tempest-VolumesNegativeTest-1045013219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:41:09 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-b01d28e4-a7d8-4f83-b23b-9e9f4c6e2ffc tempest-VolumesNegativeTest-1045013219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:41:09 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-b01d28e4-a7d8-4f83-b23b-9e9f4c6e2ffc tempest-VolumesNegativeTest-1045013219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:41:09 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-b01d28e4-a7d8-4f83-b23b-9e9f4c6e2ffc tempest-VolumesNegativeTest-1045013219 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:41:09 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-b01d28e4-a7d8-4f83-b23b-9e9f4c6e2ffc tempest-VolumesNegativeTest-1045013219 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:41:09 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-b01d28e4-a7d8-4f83-b23b-9e9f4c6e2ffc tempest-VolumesNegativeTest-1045013219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-80d8668d-7747-471f-b26c-68006ca71a50 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:41:09 devstack sudo[97328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-80d8668d-7747-471f-b26c-68006ca71a50 1073741824 Sep 23 14:41:09 devstack sudo[97328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:41:09 devstack sudo[97328]: pam_unix(sudo:session): session closed for user root Sep 23 14:41:09 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-79abfc6c-9998-4131-bd13-d20a9d60bf73 tempest-VolumeQuotasNegativeTestJSON-134074940 None] Acquiring lock "cinder-1e82845d-e881-4b13-b904-dd8109ec225a-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:41:09 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-b01d28e4-a7d8-4f83-b23b-9e9f4c6e2ffc tempest-VolumesNegativeTest-1045013219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-80d8668d-7747-471f-b26c-68006ca71a50 1073741824" returned: 0 in 0.630s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:41:09 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-79abfc6c-9998-4131-bd13-d20a9d60bf73 tempest-VolumeQuotasNegativeTestJSON-134074940 None] Lock "cinder-1e82845d-e881-4b13-b904-dd8109ec225a-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:41:09 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-b01d28e4-a7d8-4f83-b23b-9e9f4c6e2ffc tempest-VolumesNegativeTest-1045013219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-80d8668d-7747-471f-b26c-68006ca71a50 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:41:09 devstack sudo[97334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-80d8668d-7747-471f-b26c-68006ca71a50 Sep 23 14:41:09 devstack sudo[97334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:41:09 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-79abfc6c-9998-4131-bd13-d20a9d60bf73 tempest-VolumeQuotasNegativeTestJSON-134074940 None] Acquiring lock "cinder-quobyte-1e82845d-e881-4b13-b904-dd8109ec225a" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:41:09 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-79abfc6c-9998-4131-bd13-d20a9d60bf73 tempest-VolumeQuotasNegativeTestJSON-134074940 None] Lock "cinder-quobyte-1e82845d-e881-4b13-b904-dd8109ec225a" acquired by "delete_volume" :: waited 0.015s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:41:10 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[6863123b-4c9f-4f5c-bf82-8990189a2cbc]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:41:10 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-79abfc6c-9998-4131-bd13-d20a9d60bf73 tempest-VolumeQuotasNegativeTestJSON-134074940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-1e82845d-e881-4b13-b904-dd8109ec225a {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:41:10 devstack sudo[97336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-1e82845d-e881-4b13-b904-dd8109ec225a Sep 23 14:41:10 devstack sudo[97336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:41:10 devstack sudo[97334]: pam_unix(sudo:session): session closed for user root Sep 23 14:41:10 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-b01d28e4-a7d8-4f83-b23b-9e9f4c6e2ffc tempest-VolumesNegativeTest-1045013219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-80d8668d-7747-471f-b26c-68006ca71a50" returned: 0 in 0.364s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:41:10 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-b01d28e4-a7d8-4f83-b23b-9e9f4c6e2ffc tempest-VolumesNegativeTest-1045013219 None] <== create_volume: return (1082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:41:10 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-b01d28e4-a7d8-4f83-b23b-9e9f4c6e2ffc tempest-VolumesNegativeTest-1045013219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.087s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:41:10 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-b01d28e4-a7d8-4f83-b23b-9e9f4c6e2ffc tempest-VolumesNegativeTest-1045013219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6a1b5fc-ec77-49d7-a4d9-eeb8d1f5aee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80d8668d-7747-471f-b26c-68006ca71a50', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:41:10 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-b01d28e4-a7d8-4f83-b23b-9e9f4c6e2ffc tempest-VolumesNegativeTest-1045013219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43048a0b-e4db-4d23-b0b0-6a681ee304e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:41:10 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-b01d28e4-a7d8-4f83-b23b-9e9f4c6e2ffc tempest-VolumesNegativeTest-1045013219 None] Volume volume-80d8668d-7747-471f-b26c-68006ca71a50 (80d8668d-7747-471f-b26c-68006ca71a50): created successfully Sep 23 14:41:10 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-b01d28e4-a7d8-4f83-b23b-9e9f4c6e2ffc tempest-VolumesNegativeTest-1045013219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43048a0b-e4db-4d23-b0b0-6a681ee304e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:41:10 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-b01d28e4-a7d8-4f83-b23b-9e9f4c6e2ffc tempest-VolumesNegativeTest-1045013219 None] Flow 'volume_create_manager' (2e3f45e6-2b42-4e5d-8c37-97904608e132) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:41:10 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-b01d28e4-a7d8-4f83-b23b-9e9f4c6e2ffc tempest-VolumesNegativeTest-1045013219 None] Created volume successfully. Sep 23 14:41:10 devstack sudo[97336]: pam_unix(sudo:session): session closed for user root Sep 23 14:41:10 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-79abfc6c-9998-4131-bd13-d20a9d60bf73 tempest-VolumeQuotasNegativeTestJSON-134074940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-1e82845d-e881-4b13-b904-dd8109ec225a" returned: 0 in 0.471s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:41:10 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-79abfc6c-9998-4131-bd13-d20a9d60bf73 tempest-VolumeQuotasNegativeTestJSON-134074940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-1e82845d-e881-4b13-b904-dd8109ec225a {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:41:10 devstack sudo[97343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-1e82845d-e881-4b13-b904-dd8109ec225a Sep 23 14:41:10 devstack sudo[97343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:41:10 devstack sudo[97343]: pam_unix(sudo:session): session closed for user root Sep 23 14:41:10 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-79abfc6c-9998-4131-bd13-d20a9d60bf73 tempest-VolumeQuotasNegativeTestJSON-134074940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-1e82845d-e881-4b13-b904-dd8109ec225a" returned: 0 in 0.317s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:41:10 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-79abfc6c-9998-4131-bd13-d20a9d60bf73 tempest-VolumeQuotasNegativeTestJSON-134074940 None] Lock "cinder-quobyte-1e82845d-e881-4b13-b904-dd8109ec225a" released by "delete_volume" :: held 0.865s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:41:10 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-79abfc6c-9998-4131-bd13-d20a9d60bf73 tempest-VolumeQuotasNegativeTestJSON-134074940 None] Created reservations ['92a9286f-d771-4e2d-a1a7-2176a85b2b3e', '8603b56a-6d3a-4b8f-95dd-733309e859e0', 'ffe5aa7a-16cf-4a4c-a109-369886815c3d', '5866fb7d-1eb8-4b16-b842-60de51926914'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:41:10 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-79abfc6c-9998-4131-bd13-d20a9d60bf73 tempest-VolumeQuotasNegativeTestJSON-134074940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:41:10 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-79abfc6c-9998-4131-bd13-d20a9d60bf73 tempest-VolumeQuotasNegativeTestJSON-134074940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:41:10 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-79abfc6c-9998-4131-bd13-d20a9d60bf73 tempest-VolumeQuotasNegativeTestJSON-134074940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:41:11 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-79abfc6c-9998-4131-bd13-d20a9d60bf73 tempest-VolumeQuotasNegativeTestJSON-134074940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:41:11 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-79abfc6c-9998-4131-bd13-d20a9d60bf73 tempest-VolumeQuotasNegativeTestJSON-134074940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:41:11 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-79abfc6c-9998-4131-bd13-d20a9d60bf73 tempest-VolumeQuotasNegativeTestJSON-134074940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:41:11 devstack sudo[97348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:41:11 devstack sudo[97348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:41:11 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c880355-4657-468d-9702-cde12b985f98 tempest-VolumesSnapshotNegativeTestJSON-1336612574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:41:11 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-7c880355-4657-468d-9702-cde12b985f98 tempest-VolumesSnapshotNegativeTestJSON-1336612574 None] Flow 'volume_create_manager' (e69296dc-7862-4966-8c05-e386f1c109fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:41:11 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-7c880355-4657-468d-9702-cde12b985f98 tempest-VolumesSnapshotNegativeTestJSON-1336612574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13c63628-39da-431f-90d2-8efcd54daaa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:41:11 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-7c880355-4657-468d-9702-cde12b985f98 tempest-VolumesSnapshotNegativeTestJSON-1336612574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13c63628-39da-431f-90d2-8efcd54daaa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:41:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1421108916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c5bcc4c-a196-4aa2-aadc-2a3249f773b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e42f912a825f4f1db6a4125035a511ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:41:11Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:41:11Z,use_quota=True,user_id='cbd41f85e4714fd5b303692a978bdd27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:41:11 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-7c880355-4657-468d-9702-cde12b985f98 tempest-VolumesSnapshotNegativeTestJSON-1336612574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb81fdf6-c79b-45eb-842a-fbab07919cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:41:11 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-7c880355-4657-468d-9702-cde12b985f98 tempest-VolumesSnapshotNegativeTestJSON-1336612574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb81fdf6-c79b-45eb-842a-fbab07919cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:41:11 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-7c880355-4657-468d-9702-cde12b985f98 tempest-VolumesSnapshotNegativeTestJSON-1336612574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9da14fe3-d342-4b0b-b71d-56fa2e6dc611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:41:11 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-7c880355-4657-468d-9702-cde12b985f98 tempest-VolumesSnapshotNegativeTestJSON-1336612574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9da14fe3-d342-4b0b-b71d-56fa2e6dc611) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c5bcc4c-a196-4aa2-aadc-2a3249f773b1', 'volume_name': 'volume-2c5bcc4c-a196-4aa2-aadc-2a3249f773b1', 'volume_size': 2}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:41:11 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-7c880355-4657-468d-9702-cde12b985f98 tempest-VolumesSnapshotNegativeTestJSON-1336612574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92bbe8b9-ad9c-4fcc-99da-53df084912fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:41:11 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-7c880355-4657-468d-9702-cde12b985f98 tempest-VolumesSnapshotNegativeTestJSON-1336612574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92bbe8b9-ad9c-4fcc-99da-53df084912fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:41:11 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-7c880355-4657-468d-9702-cde12b985f98 tempest-VolumesSnapshotNegativeTestJSON-1336612574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42ccd706-09af-4b2e-98a1-6f9bae3586ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:41:11 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-7c880355-4657-468d-9702-cde12b985f98 tempest-VolumesSnapshotNegativeTestJSON-1336612574 None] Volume 2c5bcc4c-a196-4aa2-aadc-2a3249f773b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c5bcc4c-a196-4aa2-aadc-2a3249f773b1', 'volume_size': 2} Sep 23 14:41:11 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-7c880355-4657-468d-9702-cde12b985f98 tempest-VolumesSnapshotNegativeTestJSON-1336612574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:41:11 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-7c880355-4657-468d-9702-cde12b985f98 tempest-VolumesSnapshotNegativeTestJSON-1336612574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:41:11 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-7c880355-4657-468d-9702-cde12b985f98 tempest-VolumesSnapshotNegativeTestJSON-1336612574 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:41:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1421108916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c5bcc4c-a196-4aa2-aadc-2a3249f773b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e42f912a825f4f1db6a4125035a511ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:41:11Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:41:11Z,use_quota=True,user_id='cbd41f85e4714fd5b303692a978bdd27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:41:11 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-7c880355-4657-468d-9702-cde12b985f98 tempest-VolumesSnapshotNegativeTestJSON-1336612574 None] Creating volume 2c5bcc4c-a196-4aa2-aadc-2a3249f773b1 {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:41:11 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-7c880355-4657-468d-9702-cde12b985f98 tempest-VolumesSnapshotNegativeTestJSON-1336612574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:41:11 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-7c880355-4657-468d-9702-cde12b985f98 tempest-VolumesSnapshotNegativeTestJSON-1336612574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:41:11 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-7c880355-4657-468d-9702-cde12b985f98 tempest-VolumesSnapshotNegativeTestJSON-1336612574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:41:11 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-7c880355-4657-468d-9702-cde12b985f98 tempest-VolumesSnapshotNegativeTestJSON-1336612574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:41:11 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-7c880355-4657-468d-9702-cde12b985f98 tempest-VolumesSnapshotNegativeTestJSON-1336612574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:41:11 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-7c880355-4657-468d-9702-cde12b985f98 tempest-VolumesSnapshotNegativeTestJSON-1336612574 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:41:11 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-7c880355-4657-468d-9702-cde12b985f98 tempest-VolumesSnapshotNegativeTestJSON-1336612574 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:41:11 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-7c880355-4657-468d-9702-cde12b985f98 tempest-VolumesSnapshotNegativeTestJSON-1336612574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2c5bcc4c-a196-4aa2-aadc-2a3249f773b1 2147483648 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:41:11 devstack sudo[97350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2c5bcc4c-a196-4aa2-aadc-2a3249f773b1 2147483648 Sep 23 14:41:11 devstack sudo[97350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:41:11 devstack sudo[97348]: pam_unix(sudo:session): session closed for user root Sep 23 14:41:11 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-79abfc6c-9998-4131-bd13-d20a9d60bf73 tempest-VolumeQuotasNegativeTestJSON-134074940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.332s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:41:11 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-79abfc6c-9998-4131-bd13-d20a9d60bf73 tempest-VolumeQuotasNegativeTestJSON-134074940 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:41:11 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-79abfc6c-9998-4131-bd13-d20a9d60bf73 tempest-VolumeQuotasNegativeTestJSON-134074940 None] Deleted volume successfully. Sep 23 14:41:11 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-79abfc6c-9998-4131-bd13-d20a9d60bf73 tempest-VolumeQuotasNegativeTestJSON-134074940 None] Lock "cinder-1e82845d-e881-4b13-b904-dd8109ec225a-delete_volume" released by "delete_volume" :: held 1.504s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:41:11 devstack sudo[97350]: pam_unix(sudo:session): session closed for user root Sep 23 14:41:11 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-7c880355-4657-468d-9702-cde12b985f98 tempest-VolumesSnapshotNegativeTestJSON-1336612574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2c5bcc4c-a196-4aa2-aadc-2a3249f773b1 2147483648" returned: 0 in 0.572s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:41:11 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-7c880355-4657-468d-9702-cde12b985f98 tempest-VolumesSnapshotNegativeTestJSON-1336612574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2c5bcc4c-a196-4aa2-aadc-2a3249f773b1 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:41:11 devstack sudo[97357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2c5bcc4c-a196-4aa2-aadc-2a3249f773b1 Sep 23 14:41:11 devstack sudo[97357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:41:12 devstack sudo[97357]: pam_unix(sudo:session): session closed for user root Sep 23 14:41:12 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-7c880355-4657-468d-9702-cde12b985f98 tempest-VolumesSnapshotNegativeTestJSON-1336612574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2c5bcc4c-a196-4aa2-aadc-2a3249f773b1" returned: 0 in 0.297s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:41:12 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-7c880355-4657-468d-9702-cde12b985f98 tempest-VolumesSnapshotNegativeTestJSON-1336612574 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:41:12 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-7c880355-4657-468d-9702-cde12b985f98 tempest-VolumesSnapshotNegativeTestJSON-1336612574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:41:12 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-7c880355-4657-468d-9702-cde12b985f98 tempest-VolumesSnapshotNegativeTestJSON-1336612574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42ccd706-09af-4b2e-98a1-6f9bae3586ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c5bcc4c-a196-4aa2-aadc-2a3249f773b1', 'volume_size': 2}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:41:12 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-7c880355-4657-468d-9702-cde12b985f98 tempest-VolumesSnapshotNegativeTestJSON-1336612574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0803747e-e145-4fd8-8f38-010c361db783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:41:12 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-7c880355-4657-468d-9702-cde12b985f98 tempest-VolumesSnapshotNegativeTestJSON-1336612574 None] Volume volume-2c5bcc4c-a196-4aa2-aadc-2a3249f773b1 (2c5bcc4c-a196-4aa2-aadc-2a3249f773b1): created successfully Sep 23 14:41:12 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-7c880355-4657-468d-9702-cde12b985f98 tempest-VolumesSnapshotNegativeTestJSON-1336612574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0803747e-e145-4fd8-8f38-010c361db783) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:41:12 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-7c880355-4657-468d-9702-cde12b985f98 tempest-VolumesSnapshotNegativeTestJSON-1336612574 None] Flow 'volume_create_manager' (e69296dc-7862-4966-8c05-e386f1c109fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:41:12 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-7c880355-4657-468d-9702-cde12b985f98 tempest-VolumesSnapshotNegativeTestJSON-1336612574 None] Created volume successfully. Sep 23 14:41:12 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-40407d2f-9cd5-41fd-8236-e7212e586d8d tempest-VolumesTransfersV355Test-1700483037 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:41:12 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-40407d2f-9cd5-41fd-8236-e7212e586d8d tempest-VolumesTransfersV355Test-1700483037 None] Flow 'volume_create_manager' (82d55491-00b6-4519-8db8-06f1df40b35f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:41:12 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-40407d2f-9cd5-41fd-8236-e7212e586d8d tempest-VolumesTransfersV355Test-1700483037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dcca84a-84e5-471b-a18c-0a1ba40d7adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:41:12 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-40407d2f-9cd5-41fd-8236-e7212e586d8d tempest-VolumesTransfersV355Test-1700483037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dcca84a-84e5-471b-a18c-0a1ba40d7adf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:41:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-376207077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63b29cff-f6a8-4175-a016-a166ce9e9bdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a56048f92d3b408c9a6756504e805c4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:41:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:41:12Z,use_quota=True,user_id='cd9f9afd800f41f88c018ae4773a04d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:41:12 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-40407d2f-9cd5-41fd-8236-e7212e586d8d tempest-VolumesTransfersV355Test-1700483037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b93313a6-f0ec-4807-bd76-e9d35a890cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:41:12 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-40407d2f-9cd5-41fd-8236-e7212e586d8d tempest-VolumesTransfersV355Test-1700483037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b93313a6-f0ec-4807-bd76-e9d35a890cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:41:12 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-40407d2f-9cd5-41fd-8236-e7212e586d8d tempest-VolumesTransfersV355Test-1700483037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09c4132c-4362-4faa-827e-3be2782c0e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:41:12 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-40407d2f-9cd5-41fd-8236-e7212e586d8d tempest-VolumesTransfersV355Test-1700483037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09c4132c-4362-4faa-827e-3be2782c0e9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63b29cff-f6a8-4175-a016-a166ce9e9bdc', 'volume_name': 'volume-63b29cff-f6a8-4175-a016-a166ce9e9bdc', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:41:12 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-40407d2f-9cd5-41fd-8236-e7212e586d8d tempest-VolumesTransfersV355Test-1700483037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c45c9ff-2d40-4938-a732-88025bd8d2e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:41:12 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-40407d2f-9cd5-41fd-8236-e7212e586d8d tempest-VolumesTransfersV355Test-1700483037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c45c9ff-2d40-4938-a732-88025bd8d2e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:41:12 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-40407d2f-9cd5-41fd-8236-e7212e586d8d tempest-VolumesTransfersV355Test-1700483037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32289513-9427-4196-9e2d-1266c9408116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:41:12 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-40407d2f-9cd5-41fd-8236-e7212e586d8d tempest-VolumesTransfersV355Test-1700483037 None] Volume 63b29cff-f6a8-4175-a016-a166ce9e9bdc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63b29cff-f6a8-4175-a016-a166ce9e9bdc', 'volume_size': 1} Sep 23 14:41:12 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-40407d2f-9cd5-41fd-8236-e7212e586d8d tempest-VolumesTransfersV355Test-1700483037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:41:12 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-40407d2f-9cd5-41fd-8236-e7212e586d8d tempest-VolumesTransfersV355Test-1700483037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:41:12 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-40407d2f-9cd5-41fd-8236-e7212e586d8d tempest-VolumesTransfersV355Test-1700483037 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:41:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-376207077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63b29cff-f6a8-4175-a016-a166ce9e9bdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a56048f92d3b408c9a6756504e805c4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:41:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:41:12Z,use_quota=True,user_id='cd9f9afd800f41f88c018ae4773a04d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:41:12 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-40407d2f-9cd5-41fd-8236-e7212e586d8d tempest-VolumesTransfersV355Test-1700483037 None] Creating volume 63b29cff-f6a8-4175-a016-a166ce9e9bdc {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:41:12 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-40407d2f-9cd5-41fd-8236-e7212e586d8d tempest-VolumesTransfersV355Test-1700483037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:41:12 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-40407d2f-9cd5-41fd-8236-e7212e586d8d tempest-VolumesTransfersV355Test-1700483037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:41:12 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-40407d2f-9cd5-41fd-8236-e7212e586d8d tempest-VolumesTransfersV355Test-1700483037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:41:12 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-40407d2f-9cd5-41fd-8236-e7212e586d8d tempest-VolumesTransfersV355Test-1700483037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:41:12 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-40407d2f-9cd5-41fd-8236-e7212e586d8d tempest-VolumesTransfersV355Test-1700483037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:41:12 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-40407d2f-9cd5-41fd-8236-e7212e586d8d tempest-VolumesTransfersV355Test-1700483037 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:41:12 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-40407d2f-9cd5-41fd-8236-e7212e586d8d tempest-VolumesTransfersV355Test-1700483037 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:41:12 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-40407d2f-9cd5-41fd-8236-e7212e586d8d tempest-VolumesTransfersV355Test-1700483037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-63b29cff-f6a8-4175-a016-a166ce9e9bdc 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:41:12 devstack sudo[97364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-63b29cff-f6a8-4175-a016-a166ce9e9bdc 1073741824 Sep 23 14:41:12 devstack sudo[97364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:41:13 devstack sudo[97364]: pam_unix(sudo:session): session closed for user root Sep 23 14:41:13 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-40407d2f-9cd5-41fd-8236-e7212e586d8d tempest-VolumesTransfersV355Test-1700483037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-63b29cff-f6a8-4175-a016-a166ce9e9bdc 1073741824" returned: 0 in 0.586s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:41:13 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-40407d2f-9cd5-41fd-8236-e7212e586d8d tempest-VolumesTransfersV355Test-1700483037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-63b29cff-f6a8-4175-a016-a166ce9e9bdc {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:41:13 devstack sudo[97370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-63b29cff-f6a8-4175-a016-a166ce9e9bdc Sep 23 14:41:13 devstack sudo[97370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:41:13 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-7c92846f-79fe-4b11-bb14-d82725e19c45 tempest-VolumesSnapshotNegativeTestJSON-1336612574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:41:13 devstack sudo[97370]: pam_unix(sudo:session): session closed for user root Sep 23 14:41:13 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-40407d2f-9cd5-41fd-8236-e7212e586d8d tempest-VolumesTransfersV355Test-1700483037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-63b29cff-f6a8-4175-a016-a166ce9e9bdc" returned: 0 in 0.338s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:41:13 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-40407d2f-9cd5-41fd-8236-e7212e586d8d tempest-VolumesTransfersV355Test-1700483037 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:41:13 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-40407d2f-9cd5-41fd-8236-e7212e586d8d tempest-VolumesTransfersV355Test-1700483037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:41:13 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-7c92846f-79fe-4b11-bb14-d82725e19c45 tempest-VolumesSnapshotNegativeTestJSON-1336612574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.212s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:41:13 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-40407d2f-9cd5-41fd-8236-e7212e586d8d tempest-VolumesTransfersV355Test-1700483037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32289513-9427-4196-9e2d-1266c9408116) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63b29cff-f6a8-4175-a016-a166ce9e9bdc', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:41:13 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-40407d2f-9cd5-41fd-8236-e7212e586d8d tempest-VolumesTransfersV355Test-1700483037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42b20045-8208-475d-ba1a-99a277cd67f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:41:13 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-7c92846f-79fe-4b11-bb14-d82725e19c45 tempest-VolumesSnapshotNegativeTestJSON-1336612574 None] Creating offline snapshot 58c749e3-f67f-443e-add0-605eaea7cb55 of volume 2c5bcc4c-a196-4aa2-aadc-2a3249f773b1 {{(pid=86310) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 14:41:13 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-40407d2f-9cd5-41fd-8236-e7212e586d8d tempest-VolumesTransfersV355Test-1700483037 None] Volume volume-63b29cff-f6a8-4175-a016-a166ce9e9bdc (63b29cff-f6a8-4175-a016-a166ce9e9bdc): created successfully Sep 23 14:41:13 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-40407d2f-9cd5-41fd-8236-e7212e586d8d tempest-VolumesTransfersV355Test-1700483037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42b20045-8208-475d-ba1a-99a277cd67f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:41:13 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-40407d2f-9cd5-41fd-8236-e7212e586d8d tempest-VolumesTransfersV355Test-1700483037 None] Flow 'volume_create_manager' (82d55491-00b6-4519-8db8-06f1df40b35f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:41:13 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[33f48c42-c7f9-40d1-b2dd-f440543ddb0d]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:41:13 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-7c92846f-79fe-4b11-bb14-d82725e19c45 tempest-VolumesSnapshotNegativeTestJSON-1336612574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2c5bcc4c-a196-4aa2-aadc-2a3249f773b1 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:41:13 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-40407d2f-9cd5-41fd-8236-e7212e586d8d tempest-VolumesTransfersV355Test-1700483037 None] Created volume successfully. Sep 23 14:41:13 devstack sudo[97373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2c5bcc4c-a196-4aa2-aadc-2a3249f773b1 Sep 23 14:41:13 devstack sudo[97373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:41:14 devstack sudo[97373]: pam_unix(sudo:session): session closed for user root Sep 23 14:41:14 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-7c92846f-79fe-4b11-bb14-d82725e19c45 tempest-VolumesSnapshotNegativeTestJSON-1336612574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2c5bcc4c-a196-4aa2-aadc-2a3249f773b1" returned: 0 in 0.527s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:41:14 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-7c92846f-79fe-4b11-bb14-d82725e19c45 tempest-VolumesSnapshotNegativeTestJSON-1336612574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2c5bcc4c-a196-4aa2-aadc-2a3249f773b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2c5bcc4c-a196-4aa2-aadc-2a3249f773b1.58c749e3-f67f-443e-add0-605eaea7cb55 2G {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:41:14 devstack sudo[97379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2c5bcc4c-a196-4aa2-aadc-2a3249f773b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2c5bcc4c-a196-4aa2-aadc-2a3249f773b1.58c749e3-f67f-443e-add0-605eaea7cb55 2G Sep 23 14:41:14 devstack sudo[97379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:41:14 devstack sudo[97379]: pam_unix(sudo:session): session closed for user root Sep 23 14:41:14 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-7c92846f-79fe-4b11-bb14-d82725e19c45 tempest-VolumesSnapshotNegativeTestJSON-1336612574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2c5bcc4c-a196-4aa2-aadc-2a3249f773b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2c5bcc4c-a196-4aa2-aadc-2a3249f773b1.58c749e3-f67f-443e-add0-605eaea7cb55 2G" returned: 0 in 0.743s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:41:14 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-7c92846f-79fe-4b11-bb14-d82725e19c45 tempest-VolumesSnapshotNegativeTestJSON-1336612574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c5bcc4c-a196-4aa2-aadc-2a3249f773b1 -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2c5bcc4c-a196-4aa2-aadc-2a3249f773b1.58c749e3-f67f-443e-add0-605eaea7cb55 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:41:15 devstack sudo[97397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c5bcc4c-a196-4aa2-aadc-2a3249f773b1 -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2c5bcc4c-a196-4aa2-aadc-2a3249f773b1.58c749e3-f67f-443e-add0-605eaea7cb55 Sep 23 14:41:15 devstack sudo[97397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:41:15 devstack sudo[97397]: pam_unix(sudo:session): session closed for user root Sep 23 14:41:15 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-7c92846f-79fe-4b11-bb14-d82725e19c45 tempest-VolumesSnapshotNegativeTestJSON-1336612574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c5bcc4c-a196-4aa2-aadc-2a3249f773b1 -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2c5bcc4c-a196-4aa2-aadc-2a3249f773b1.58c749e3-f67f-443e-add0-605eaea7cb55" returned: 0 in 0.541s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:41:15 devstack cinder-volume[86310]: WARNING cinder.volume.drivers.remotefs [None req-7c92846f-79fe-4b11-bb14-d82725e19c45 tempest-VolumesSnapshotNegativeTestJSON-1336612574 None] /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2c5bcc4c-a196-4aa2-aadc-2a3249f773b1.58c749e3-f67f-443e-add0-605eaea7cb55 is being set with open permissions: ugo+rw Sep 23 14:41:15 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-7c92846f-79fe-4b11-bb14-d82725e19c45 tempest-VolumesSnapshotNegativeTestJSON-1336612574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2c5bcc4c-a196-4aa2-aadc-2a3249f773b1.58c749e3-f67f-443e-add0-605eaea7cb55 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:41:15 devstack sudo[97404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2c5bcc4c-a196-4aa2-aadc-2a3249f773b1.58c749e3-f67f-443e-add0-605eaea7cb55 Sep 23 14:41:15 devstack sudo[97404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:41:15 devstack sudo[97404]: pam_unix(sudo:session): session closed for user root Sep 23 14:41:15 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-7c92846f-79fe-4b11-bb14-d82725e19c45 tempest-VolumesSnapshotNegativeTestJSON-1336612574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2c5bcc4c-a196-4aa2-aadc-2a3249f773b1.58c749e3-f67f-443e-add0-605eaea7cb55" returned: 0 in 0.291s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:41:15 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-7c92846f-79fe-4b11-bb14-d82725e19c45 tempest-VolumesSnapshotNegativeTestJSON-1336612574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2c5bcc4c-a196-4aa2-aadc-2a3249f773b1.info {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:41:15 devstack sudo[97407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2c5bcc4c-a196-4aa2-aadc-2a3249f773b1.info Sep 23 14:41:15 devstack sudo[97407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:41:16 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-312717dd-cb50-4423-b5a1-c35fa8ff0bc6 tempest-VolumesTransfersV355Test-2104928346 None] Transfer volume completed successfully. Sep 23 14:41:16 devstack sudo[97407]: pam_unix(sudo:session): session closed for user root Sep 23 14:41:16 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-7c92846f-79fe-4b11-bb14-d82725e19c45 tempest-VolumesSnapshotNegativeTestJSON-1336612574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2c5bcc4c-a196-4aa2-aadc-2a3249f773b1.info" returned: 0 in 0.446s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:41:16 devstack cinder-volume[86310]: WARNING cinder.volume.drivers.remotefs [None req-7c92846f-79fe-4b11-bb14-d82725e19c45 tempest-VolumesSnapshotNegativeTestJSON-1336612574 None] /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2c5bcc4c-a196-4aa2-aadc-2a3249f773b1.info is being set with open permissions: ugo+rw Sep 23 14:41:16 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-7c92846f-79fe-4b11-bb14-d82725e19c45 tempest-VolumesSnapshotNegativeTestJSON-1336612574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2c5bcc4c-a196-4aa2-aadc-2a3249f773b1.info {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:41:16 devstack sudo[97410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2c5bcc4c-a196-4aa2-aadc-2a3249f773b1.info Sep 23 14:41:16 devstack sudo[97410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:41:16 devstack sudo[97410]: pam_unix(sudo:session): session closed for user root Sep 23 14:41:16 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-7c92846f-79fe-4b11-bb14-d82725e19c45 tempest-VolumesSnapshotNegativeTestJSON-1336612574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2c5bcc4c-a196-4aa2-aadc-2a3249f773b1.info" returned: 0 in 0.383s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:41:16 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-7c92846f-79fe-4b11-bb14-d82725e19c45 tempest-VolumesSnapshotNegativeTestJSON-1336612574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.103s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:41:16 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-7c92846f-79fe-4b11-bb14-d82725e19c45 tempest-VolumesSnapshotNegativeTestJSON-1336612574 None] Create snapshot completed successfully Sep 23 14:41:16 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-c0909b0e-7d60-4fef-886b-02168209ccef tempest-VolumesTransfersV355Test-736523973 None] Acquiring lock "cinder-63b29cff-f6a8-4175-a016-a166ce9e9bdc-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:41:16 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-c0909b0e-7d60-4fef-886b-02168209ccef tempest-VolumesTransfersV355Test-736523973 None] Lock "cinder-63b29cff-f6a8-4175-a016-a166ce9e9bdc-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:41:16 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-c0909b0e-7d60-4fef-886b-02168209ccef tempest-VolumesTransfersV355Test-736523973 None] Acquiring lock "cinder-quobyte-63b29cff-f6a8-4175-a016-a166ce9e9bdc" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:41:16 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-c0909b0e-7d60-4fef-886b-02168209ccef tempest-VolumesTransfersV355Test-736523973 None] Lock "cinder-quobyte-63b29cff-f6a8-4175-a016-a166ce9e9bdc" acquired by "delete_volume" :: waited 0.017s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:41:17 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cb641bd-901d-44f2-bf7d-379439bbc503]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:41:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-c0909b0e-7d60-4fef-886b-02168209ccef tempest-VolumesTransfersV355Test-736523973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-63b29cff-f6a8-4175-a016-a166ce9e9bdc {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:41:17 devstack sudo[97413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-63b29cff-f6a8-4175-a016-a166ce9e9bdc Sep 23 14:41:17 devstack sudo[97413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:41:17 devstack sudo[97413]: pam_unix(sudo:session): session closed for user root Sep 23 14:41:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-c0909b0e-7d60-4fef-886b-02168209ccef tempest-VolumesTransfersV355Test-736523973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-63b29cff-f6a8-4175-a016-a166ce9e9bdc" returned: 0 in 0.381s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:41:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-c0909b0e-7d60-4fef-886b-02168209ccef tempest-VolumesTransfersV355Test-736523973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-63b29cff-f6a8-4175-a016-a166ce9e9bdc {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:41:17 devstack sudo[97418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-63b29cff-f6a8-4175-a016-a166ce9e9bdc Sep 23 14:41:17 devstack sudo[97418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:41:17 devstack sudo[97418]: pam_unix(sudo:session): session closed for user root Sep 23 14:41:17 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-2fe9e693-412c-4fb2-8102-e0cfe722adda tempest-VolumesSnapshotNegativeTestJSON-1336612574 None] Acquiring lock "cinder-58c749e3-f67f-443e-add0-605eaea7cb55-delete_snapshot" by "delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:41:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-c0909b0e-7d60-4fef-886b-02168209ccef tempest-VolumesTransfersV355Test-736523973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-63b29cff-f6a8-4175-a016-a166ce9e9bdc" returned: 0 in 0.378s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:41:17 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-c0909b0e-7d60-4fef-886b-02168209ccef tempest-VolumesTransfersV355Test-736523973 None] Lock "cinder-quobyte-63b29cff-f6a8-4175-a016-a166ce9e9bdc" released by "delete_volume" :: held 0.817s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:41:17 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-2fe9e693-412c-4fb2-8102-e0cfe722adda tempest-VolumesSnapshotNegativeTestJSON-1336612574 None] Lock "cinder-58c749e3-f67f-443e-add0-605eaea7cb55-delete_snapshot" acquired by "delete_snapshot" :: waited 0.053s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:41:17 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-2fe9e693-412c-4fb2-8102-e0cfe722adda tempest-VolumesSnapshotNegativeTestJSON-1336612574 None] Acquiring lock "cinder-quobyte-2c5bcc4c-a196-4aa2-aadc-2a3249f773b1" by "delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:41:17 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-2fe9e693-412c-4fb2-8102-e0cfe722adda tempest-VolumesSnapshotNegativeTestJSON-1336612574 None] Lock "cinder-quobyte-2c5bcc4c-a196-4aa2-aadc-2a3249f773b1" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:41:17 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-2fe9e693-412c-4fb2-8102-e0cfe722adda tempest-VolumesSnapshotNegativeTestJSON-1336612574 None] Acquiring lock "cinder-quobyte-58c749e3-f67f-443e-add0-605eaea7cb55" by "_delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:41:17 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-2fe9e693-412c-4fb2-8102-e0cfe722adda tempest-VolumesSnapshotNegativeTestJSON-1336612574 None] Lock "cinder-quobyte-58c749e3-f67f-443e-add0-605eaea7cb55" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:41:17 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-2fe9e693-412c-4fb2-8102-e0cfe722adda tempest-VolumesSnapshotNegativeTestJSON-1336612574 None] Deleting offline snapshot 58c749e3-f67f-443e-add0-605eaea7cb55 of volume 2c5bcc4c-a196-4aa2-aadc-2a3249f773b1 {{(pid=86310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 14:41:17 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-2fe9e693-412c-4fb2-8102-e0cfe722adda tempest-VolumesSnapshotNegativeTestJSON-1336612574 None] snapshot_file for this snap is: volume-2c5bcc4c-a196-4aa2-aadc-2a3249f773b1.58c749e3-f67f-443e-add0-605eaea7cb55 {{(pid=86310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 14:41:17 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d5d4896-f640-4e22-8e47-0be9b1723f4b]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:41:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-2fe9e693-412c-4fb2-8102-e0cfe722adda tempest-VolumesSnapshotNegativeTestJSON-1336612574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2c5bcc4c-a196-4aa2-aadc-2a3249f773b1.58c749e3-f67f-443e-add0-605eaea7cb55 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:41:17 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-c0909b0e-7d60-4fef-886b-02168209ccef tempest-VolumesTransfersV355Test-736523973 None] Created reservations ['cbce5114-5978-414f-89b0-de004b260f2a', 'e83f7c68-cccb-4d0e-97e6-d7f7fe18652d', '1c595a3e-8d93-4180-8afa-87fb5aeff4b0', 'b50d2f56-0df2-439b-9a0c-bf8bb0ba5698'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:41:18 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-c0909b0e-7d60-4fef-886b-02168209ccef tempest-VolumesTransfersV355Test-736523973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:41:18 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-c0909b0e-7d60-4fef-886b-02168209ccef tempest-VolumesTransfersV355Test-736523973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:41:18 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-c0909b0e-7d60-4fef-886b-02168209ccef tempest-VolumesTransfersV355Test-736523973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:41:18 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-c0909b0e-7d60-4fef-886b-02168209ccef tempest-VolumesTransfersV355Test-736523973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:41:18 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-c0909b0e-7d60-4fef-886b-02168209ccef tempest-VolumesTransfersV355Test-736523973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:41:18 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-c0909b0e-7d60-4fef-886b-02168209ccef tempest-VolumesTransfersV355Test-736523973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:41:18 devstack sudo[97422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2c5bcc4c-a196-4aa2-aadc-2a3249f773b1.58c749e3-f67f-443e-add0-605eaea7cb55 Sep 23 14:41:18 devstack sudo[97422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:41:18 devstack sudo[97423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:41:18 devstack sudo[97423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:41:18 devstack sudo[97423]: pam_unix(sudo:session): session closed for user root Sep 23 14:41:18 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-c0909b0e-7d60-4fef-886b-02168209ccef tempest-VolumesTransfersV355Test-736523973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.368s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:41:18 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-c0909b0e-7d60-4fef-886b-02168209ccef tempest-VolumesTransfersV355Test-736523973 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:41:18 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-c0909b0e-7d60-4fef-886b-02168209ccef tempest-VolumesTransfersV355Test-736523973 None] Deleted volume successfully. Sep 23 14:41:18 devstack sudo[97422]: pam_unix(sudo:session): session closed for user root Sep 23 14:41:18 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-2fe9e693-412c-4fb2-8102-e0cfe722adda tempest-VolumesSnapshotNegativeTestJSON-1336612574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2c5bcc4c-a196-4aa2-aadc-2a3249f773b1.58c749e3-f67f-443e-add0-605eaea7cb55" returned: 0 in 0.572s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:41:18 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-2fe9e693-412c-4fb2-8102-e0cfe722adda tempest-VolumesSnapshotNegativeTestJSON-1336612574 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2c5bcc4c-a196-4aa2-aadc-2a3249f773b1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 14:41:18 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-c0909b0e-7d60-4fef-886b-02168209ccef tempest-VolumesTransfersV355Test-736523973 None] Lock "cinder-63b29cff-f6a8-4175-a016-a166ce9e9bdc-delete_volume" released by "delete_volume" :: held 1.751s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:41:18 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a914830-99e2-4715-a999-ec59ba825691]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:41:18 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-2fe9e693-412c-4fb2-8102-e0cfe722adda tempest-VolumesSnapshotNegativeTestJSON-1336612574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2c5bcc4c-a196-4aa2-aadc-2a3249f773b1 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:41:18 devstack sudo[97441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2c5bcc4c-a196-4aa2-aadc-2a3249f773b1 Sep 23 14:41:18 devstack sudo[97441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:41:19 devstack sudo[97441]: pam_unix(sudo:session): session closed for user root Sep 23 14:41:19 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-2fe9e693-412c-4fb2-8102-e0cfe722adda tempest-VolumesSnapshotNegativeTestJSON-1336612574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2c5bcc4c-a196-4aa2-aadc-2a3249f773b1" returned: 0 in 0.926s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:41:19 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-2fe9e693-412c-4fb2-8102-e0cfe722adda tempest-VolumesSnapshotNegativeTestJSON-1336612574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2c5bcc4c-a196-4aa2-aadc-2a3249f773b1.58c749e3-f67f-443e-add0-605eaea7cb55 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:41:19 devstack sudo[97526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2c5bcc4c-a196-4aa2-aadc-2a3249f773b1.58c749e3-f67f-443e-add0-605eaea7cb55 Sep 23 14:41:19 devstack sudo[97526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:41:20 devstack sudo[97526]: pam_unix(sudo:session): session closed for user root Sep 23 14:41:20 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-2fe9e693-412c-4fb2-8102-e0cfe722adda tempest-VolumesSnapshotNegativeTestJSON-1336612574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2c5bcc4c-a196-4aa2-aadc-2a3249f773b1.58c749e3-f67f-443e-add0-605eaea7cb55" returned: 0 in 0.851s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:41:20 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-2fe9e693-412c-4fb2-8102-e0cfe722adda tempest-VolumesSnapshotNegativeTestJSON-1336612574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2c5bcc4c-a196-4aa2-aadc-2a3249f773b1.58c749e3-f67f-443e-add0-605eaea7cb55 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:41:20 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e7e50c8-470c-43ee-9075-3ad28416ee8f tempest-VolumesTransfersV355Test-1700483037 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:41:20 devstack sudo[97542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2c5bcc4c-a196-4aa2-aadc-2a3249f773b1.58c749e3-f67f-443e-add0-605eaea7cb55 Sep 23 14:41:20 devstack sudo[97542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:41:20 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-1e7e50c8-470c-43ee-9075-3ad28416ee8f tempest-VolumesTransfersV355Test-1700483037 None] Flow 'volume_create_manager' (0be5fb13-c12b-4ff9-b334-3c6fcc7b40f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:41:20 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-1e7e50c8-470c-43ee-9075-3ad28416ee8f tempest-VolumesTransfersV355Test-1700483037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fd2f9cf-53fc-4c44-ba7b-33453e2a7d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:41:20 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-1e7e50c8-470c-43ee-9075-3ad28416ee8f tempest-VolumesTransfersV355Test-1700483037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fd2f9cf-53fc-4c44-ba7b-33453e2a7d5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:41:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-270078251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15ab669b-661f-4c52-9843-9c066b24b3a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a56048f92d3b408c9a6756504e805c4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:41:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:41:20Z,use_quota=True,user_id='cd9f9afd800f41f88c018ae4773a04d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:41:20 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-1e7e50c8-470c-43ee-9075-3ad28416ee8f tempest-VolumesTransfersV355Test-1700483037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (456c7bca-30e1-4579-8a66-936301ed9daa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:41:20 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-1e7e50c8-470c-43ee-9075-3ad28416ee8f tempest-VolumesTransfersV355Test-1700483037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (456c7bca-30e1-4579-8a66-936301ed9daa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:41:20 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-1e7e50c8-470c-43ee-9075-3ad28416ee8f tempest-VolumesTransfersV355Test-1700483037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (321560e1-a5f3-4eea-9e92-617d6ba00b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:41:20 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-1e7e50c8-470c-43ee-9075-3ad28416ee8f tempest-VolumesTransfersV355Test-1700483037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (321560e1-a5f3-4eea-9e92-617d6ba00b5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15ab669b-661f-4c52-9843-9c066b24b3a1', 'volume_name': 'volume-15ab669b-661f-4c52-9843-9c066b24b3a1', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:41:20 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-1e7e50c8-470c-43ee-9075-3ad28416ee8f tempest-VolumesTransfersV355Test-1700483037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16e91712-573e-4603-9f57-e9726cc4091f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:41:20 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-1e7e50c8-470c-43ee-9075-3ad28416ee8f tempest-VolumesTransfersV355Test-1700483037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16e91712-573e-4603-9f57-e9726cc4091f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:41:20 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-1e7e50c8-470c-43ee-9075-3ad28416ee8f tempest-VolumesTransfersV355Test-1700483037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b800b23-b704-4d1a-ab19-8b7914122116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:41:20 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-1e7e50c8-470c-43ee-9075-3ad28416ee8f tempest-VolumesTransfersV355Test-1700483037 None] Volume 15ab669b-661f-4c52-9843-9c066b24b3a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15ab669b-661f-4c52-9843-9c066b24b3a1', 'volume_size': 1} Sep 23 14:41:20 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-1e7e50c8-470c-43ee-9075-3ad28416ee8f tempest-VolumesTransfersV355Test-1700483037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:41:20 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-1e7e50c8-470c-43ee-9075-3ad28416ee8f tempest-VolumesTransfersV355Test-1700483037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:41:20 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-1e7e50c8-470c-43ee-9075-3ad28416ee8f tempest-VolumesTransfersV355Test-1700483037 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:41:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-270078251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15ab669b-661f-4c52-9843-9c066b24b3a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a56048f92d3b408c9a6756504e805c4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:41:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:41:20Z,use_quota=True,user_id='cd9f9afd800f41f88c018ae4773a04d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:41:20 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-1e7e50c8-470c-43ee-9075-3ad28416ee8f tempest-VolumesTransfersV355Test-1700483037 None] Creating volume 15ab669b-661f-4c52-9843-9c066b24b3a1 {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:41:20 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-1e7e50c8-470c-43ee-9075-3ad28416ee8f tempest-VolumesTransfersV355Test-1700483037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:41:20 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-1e7e50c8-470c-43ee-9075-3ad28416ee8f tempest-VolumesTransfersV355Test-1700483037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:41:20 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-1e7e50c8-470c-43ee-9075-3ad28416ee8f tempest-VolumesTransfersV355Test-1700483037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:41:20 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-1e7e50c8-470c-43ee-9075-3ad28416ee8f tempest-VolumesTransfersV355Test-1700483037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:41:20 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-1e7e50c8-470c-43ee-9075-3ad28416ee8f tempest-VolumesTransfersV355Test-1700483037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:41:20 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-1e7e50c8-470c-43ee-9075-3ad28416ee8f tempest-VolumesTransfersV355Test-1700483037 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:41:20 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-1e7e50c8-470c-43ee-9075-3ad28416ee8f tempest-VolumesTransfersV355Test-1700483037 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:41:20 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-1e7e50c8-470c-43ee-9075-3ad28416ee8f tempest-VolumesTransfersV355Test-1700483037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-15ab669b-661f-4c52-9843-9c066b24b3a1 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:41:20 devstack sudo[97546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-15ab669b-661f-4c52-9843-9c066b24b3a1 1073741824 Sep 23 14:41:20 devstack sudo[97546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:41:21 devstack sudo[97542]: pam_unix(sudo:session): session closed for user root Sep 23 14:41:21 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-2fe9e693-412c-4fb2-8102-e0cfe722adda tempest-VolumesSnapshotNegativeTestJSON-1336612574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2c5bcc4c-a196-4aa2-aadc-2a3249f773b1.58c749e3-f67f-443e-add0-605eaea7cb55" returned: 0 in 0.687s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:41:21 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-2fe9e693-412c-4fb2-8102-e0cfe722adda tempest-VolumesSnapshotNegativeTestJSON-1336612574 None] Lock "cinder-quobyte-58c749e3-f67f-443e-add0-605eaea7cb55" released by "_delete_snapshot" :: held 3.350s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:41:21 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-2fe9e693-412c-4fb2-8102-e0cfe722adda tempest-VolumesSnapshotNegativeTestJSON-1336612574 None] Lock "cinder-quobyte-2c5bcc4c-a196-4aa2-aadc-2a3249f773b1" released by "delete_snapshot" :: held 3.397s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:41:21 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-2fe9e693-412c-4fb2-8102-e0cfe722adda tempest-VolumesSnapshotNegativeTestJSON-1336612574 None] Created reservations ['22e40fb4-83e5-4517-8df4-acf144440808', '829e46c3-e705-4f2f-8803-51c86f982371', '686bce40-322a-42bc-8640-bd2eb3b3fb0d', '84bc78fa-c799-479a-8cce-cf41201a9034'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:41:21 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-2fe9e693-412c-4fb2-8102-e0cfe722adda tempest-VolumesSnapshotNegativeTestJSON-1336612574 None] Delete snapshot completed successfully. Sep 23 14:41:21 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-2fe9e693-412c-4fb2-8102-e0cfe722adda tempest-VolumesSnapshotNegativeTestJSON-1336612574 None] Lock "cinder-58c749e3-f67f-443e-add0-605eaea7cb55-delete_snapshot" released by "delete_snapshot" :: held 3.630s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:41:21 devstack sudo[97546]: pam_unix(sudo:session): session closed for user root Sep 23 14:41:21 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-1e7e50c8-470c-43ee-9075-3ad28416ee8f tempest-VolumesTransfersV355Test-1700483037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-15ab669b-661f-4c52-9843-9c066b24b3a1 1073741824" returned: 0 in 0.786s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:41:21 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-1e7e50c8-470c-43ee-9075-3ad28416ee8f tempest-VolumesTransfersV355Test-1700483037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-15ab669b-661f-4c52-9843-9c066b24b3a1 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:41:21 devstack sudo[97553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-15ab669b-661f-4c52-9843-9c066b24b3a1 Sep 23 14:41:21 devstack sudo[97553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:41:21 devstack sudo[97553]: pam_unix(sudo:session): session closed for user root Sep 23 14:41:21 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-1e7e50c8-470c-43ee-9075-3ad28416ee8f tempest-VolumesTransfersV355Test-1700483037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-15ab669b-661f-4c52-9843-9c066b24b3a1" returned: 0 in 0.323s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:41:21 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-1e7e50c8-470c-43ee-9075-3ad28416ee8f tempest-VolumesTransfersV355Test-1700483037 None] <== create_volume: return (1203ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:41:21 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-1e7e50c8-470c-43ee-9075-3ad28416ee8f tempest-VolumesTransfersV355Test-1700483037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.206s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:41:21 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-1e7e50c8-470c-43ee-9075-3ad28416ee8f tempest-VolumesTransfersV355Test-1700483037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b800b23-b704-4d1a-ab19-8b7914122116) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15ab669b-661f-4c52-9843-9c066b24b3a1', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:41:21 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-1e7e50c8-470c-43ee-9075-3ad28416ee8f tempest-VolumesTransfersV355Test-1700483037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fa66cde-8eb4-4899-802b-22d2b194dec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:41:21 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-1e7e50c8-470c-43ee-9075-3ad28416ee8f tempest-VolumesTransfersV355Test-1700483037 None] Volume volume-15ab669b-661f-4c52-9843-9c066b24b3a1 (15ab669b-661f-4c52-9843-9c066b24b3a1): created successfully Sep 23 14:41:21 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-1e7e50c8-470c-43ee-9075-3ad28416ee8f tempest-VolumesTransfersV355Test-1700483037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fa66cde-8eb4-4899-802b-22d2b194dec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:41:22 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-1e7e50c8-470c-43ee-9075-3ad28416ee8f tempest-VolumesTransfersV355Test-1700483037 None] Flow 'volume_create_manager' (0be5fb13-c12b-4ff9-b334-3c6fcc7b40f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:41:22 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-1e7e50c8-470c-43ee-9075-3ad28416ee8f tempest-VolumesTransfersV355Test-1700483037 None] Created volume successfully. Sep 23 14:41:22 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-a580007a-1078-40eb-8b8b-90313fe6e914 tempest-VolumesServicesTestJSON-324700875 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:41:22 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-a580007a-1078-40eb-8b8b-90313fe6e914 tempest-VolumesServicesTestJSON-324700875 None] Flow 'volume_create_manager' (49254e0d-01f1-4ef4-8377-b518458e5328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:41:22 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-a580007a-1078-40eb-8b8b-90313fe6e914 tempest-VolumesServicesTestJSON-324700875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e805e49-7949-4500-b565-942ae49e0a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:41:22 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-a580007a-1078-40eb-8b8b-90313fe6e914 tempest-VolumesServicesTestJSON-324700875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e805e49-7949-4500-b565-942ae49e0a8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:41:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-389034856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf5b89e9-39da-4db7-9fb3-a1e5d7e4142b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='083f883a40724e9d900959fd0a2ea98e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:41:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:41:22Z,use_quota=True,user_id='53b787349d0b44e7ae3e7f0ef464dacd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:41:22 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-a580007a-1078-40eb-8b8b-90313fe6e914 tempest-VolumesServicesTestJSON-324700875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a8bf1a2-dec3-4088-84e2-9bfca219f7f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:41:22 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-a580007a-1078-40eb-8b8b-90313fe6e914 tempest-VolumesServicesTestJSON-324700875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a8bf1a2-dec3-4088-84e2-9bfca219f7f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:41:22 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-a580007a-1078-40eb-8b8b-90313fe6e914 tempest-VolumesServicesTestJSON-324700875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7021dbbf-230b-41a4-855c-89b18ac1d1aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:41:22 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-a580007a-1078-40eb-8b8b-90313fe6e914 tempest-VolumesServicesTestJSON-324700875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7021dbbf-230b-41a4-855c-89b18ac1d1aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf5b89e9-39da-4db7-9fb3-a1e5d7e4142b', 'volume_name': 'volume-cf5b89e9-39da-4db7-9fb3-a1e5d7e4142b', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:41:22 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-a580007a-1078-40eb-8b8b-90313fe6e914 tempest-VolumesServicesTestJSON-324700875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (350f098d-18da-4cdb-b61e-5ec86fc4a464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:41:22 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-a580007a-1078-40eb-8b8b-90313fe6e914 tempest-VolumesServicesTestJSON-324700875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (350f098d-18da-4cdb-b61e-5ec86fc4a464) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:41:22 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-a580007a-1078-40eb-8b8b-90313fe6e914 tempest-VolumesServicesTestJSON-324700875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75e8a02f-1c05-4dc4-898a-77c3d0ff2fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:41:22 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-a580007a-1078-40eb-8b8b-90313fe6e914 tempest-VolumesServicesTestJSON-324700875 None] Volume cf5b89e9-39da-4db7-9fb3-a1e5d7e4142b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf5b89e9-39da-4db7-9fb3-a1e5d7e4142b', 'volume_size': 1} Sep 23 14:41:22 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-a580007a-1078-40eb-8b8b-90313fe6e914 tempest-VolumesServicesTestJSON-324700875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:41:22 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-a580007a-1078-40eb-8b8b-90313fe6e914 tempest-VolumesServicesTestJSON-324700875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:41:22 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-a580007a-1078-40eb-8b8b-90313fe6e914 tempest-VolumesServicesTestJSON-324700875 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:41:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-389034856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf5b89e9-39da-4db7-9fb3-a1e5d7e4142b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='083f883a40724e9d900959fd0a2ea98e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:41:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:41:22Z,use_quota=True,user_id='53b787349d0b44e7ae3e7f0ef464dacd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:41:22 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-a580007a-1078-40eb-8b8b-90313fe6e914 tempest-VolumesServicesTestJSON-324700875 None] Creating volume cf5b89e9-39da-4db7-9fb3-a1e5d7e4142b {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:41:22 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-a580007a-1078-40eb-8b8b-90313fe6e914 tempest-VolumesServicesTestJSON-324700875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:41:22 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-a580007a-1078-40eb-8b8b-90313fe6e914 tempest-VolumesServicesTestJSON-324700875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:41:22 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-a580007a-1078-40eb-8b8b-90313fe6e914 tempest-VolumesServicesTestJSON-324700875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:41:22 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-a580007a-1078-40eb-8b8b-90313fe6e914 tempest-VolumesServicesTestJSON-324700875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:41:22 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-a580007a-1078-40eb-8b8b-90313fe6e914 tempest-VolumesServicesTestJSON-324700875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:41:22 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-a580007a-1078-40eb-8b8b-90313fe6e914 tempest-VolumesServicesTestJSON-324700875 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:41:22 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-a580007a-1078-40eb-8b8b-90313fe6e914 tempest-VolumesServicesTestJSON-324700875 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:41:22 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a580007a-1078-40eb-8b8b-90313fe6e914 tempest-VolumesServicesTestJSON-324700875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-cf5b89e9-39da-4db7-9fb3-a1e5d7e4142b 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:41:22 devstack sudo[97556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-cf5b89e9-39da-4db7-9fb3-a1e5d7e4142b 1073741824 Sep 23 14:41:22 devstack sudo[97556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:41:22 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-64363b9d-a003-46a4-ae35-fc5f227c9b33 tempest-VolumesSnapshotNegativeTestJSON-1336612574 None] Acquiring lock "cinder-2c5bcc4c-a196-4aa2-aadc-2a3249f773b1-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:41:22 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-64363b9d-a003-46a4-ae35-fc5f227c9b33 tempest-VolumesSnapshotNegativeTestJSON-1336612574 None] Lock "cinder-2c5bcc4c-a196-4aa2-aadc-2a3249f773b1-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:41:22 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-64363b9d-a003-46a4-ae35-fc5f227c9b33 tempest-VolumesSnapshotNegativeTestJSON-1336612574 None] Acquiring lock "cinder-quobyte-2c5bcc4c-a196-4aa2-aadc-2a3249f773b1" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:41:22 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-64363b9d-a003-46a4-ae35-fc5f227c9b33 tempest-VolumesSnapshotNegativeTestJSON-1336612574 None] Lock "cinder-quobyte-2c5bcc4c-a196-4aa2-aadc-2a3249f773b1" acquired by "delete_volume" :: waited 0.039s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:41:22 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[26bff8b8-d2ad-447a-94b4-9b5f3c83e938]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:41:22 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-64363b9d-a003-46a4-ae35-fc5f227c9b33 tempest-VolumesSnapshotNegativeTestJSON-1336612574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2c5bcc4c-a196-4aa2-aadc-2a3249f773b1 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:41:22 devstack sudo[97561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2c5bcc4c-a196-4aa2-aadc-2a3249f773b1 Sep 23 14:41:22 devstack sudo[97561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:41:22 devstack sudo[97556]: pam_unix(sudo:session): session closed for user root Sep 23 14:41:22 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a580007a-1078-40eb-8b8b-90313fe6e914 tempest-VolumesServicesTestJSON-324700875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-cf5b89e9-39da-4db7-9fb3-a1e5d7e4142b 1073741824" returned: 0 in 0.837s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:41:23 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a580007a-1078-40eb-8b8b-90313fe6e914 tempest-VolumesServicesTestJSON-324700875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-cf5b89e9-39da-4db7-9fb3-a1e5d7e4142b {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:41:23 devstack sudo[97568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-cf5b89e9-39da-4db7-9fb3-a1e5d7e4142b Sep 23 14:41:23 devstack sudo[97568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:41:23 devstack sudo[97561]: pam_unix(sudo:session): session closed for user root Sep 23 14:41:23 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-64363b9d-a003-46a4-ae35-fc5f227c9b33 tempest-VolumesSnapshotNegativeTestJSON-1336612574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2c5bcc4c-a196-4aa2-aadc-2a3249f773b1" returned: 0 in 0.616s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:41:23 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-64363b9d-a003-46a4-ae35-fc5f227c9b33 tempest-VolumesSnapshotNegativeTestJSON-1336612574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2c5bcc4c-a196-4aa2-aadc-2a3249f773b1 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:41:23 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-bf801c56-4f20-4861-93a7-c3cfdeaaf13f tempest-VolumesTransfersV355Test-736523973 None] Acquiring lock "cinder-15ab669b-661f-4c52-9843-9c066b24b3a1-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:41:23 devstack sudo[97570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2c5bcc4c-a196-4aa2-aadc-2a3249f773b1 Sep 23 14:41:23 devstack sudo[97570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:41:23 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-bf801c56-4f20-4861-93a7-c3cfdeaaf13f tempest-VolumesTransfersV355Test-736523973 None] Lock "cinder-15ab669b-661f-4c52-9843-9c066b24b3a1-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:41:23 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-bf801c56-4f20-4861-93a7-c3cfdeaaf13f tempest-VolumesTransfersV355Test-736523973 None] Acquiring lock "cinder-quobyte-15ab669b-661f-4c52-9843-9c066b24b3a1" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:41:23 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-bf801c56-4f20-4861-93a7-c3cfdeaaf13f tempest-VolumesTransfersV355Test-736523973 None] Lock "cinder-quobyte-15ab669b-661f-4c52-9843-9c066b24b3a1" acquired by "delete_volume" :: waited 0.021s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:41:23 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdae09a8-7008-4687-ab02-d95ecfb1de1d]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:41:23 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-bf801c56-4f20-4861-93a7-c3cfdeaaf13f tempest-VolumesTransfersV355Test-736523973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-15ab669b-661f-4c52-9843-9c066b24b3a1 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:41:23 devstack sudo[97568]: pam_unix(sudo:session): session closed for user root Sep 23 14:41:23 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a580007a-1078-40eb-8b8b-90313fe6e914 tempest-VolumesServicesTestJSON-324700875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-cf5b89e9-39da-4db7-9fb3-a1e5d7e4142b" returned: 0 in 0.411s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:41:23 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-a580007a-1078-40eb-8b8b-90313fe6e914 tempest-VolumesServicesTestJSON-324700875 None] <== create_volume: return (1326ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:41:23 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-a580007a-1078-40eb-8b8b-90313fe6e914 tempest-VolumesServicesTestJSON-324700875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.329s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:41:23 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-a580007a-1078-40eb-8b8b-90313fe6e914 tempest-VolumesServicesTestJSON-324700875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75e8a02f-1c05-4dc4-898a-77c3d0ff2fb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf5b89e9-39da-4db7-9fb3-a1e5d7e4142b', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:41:23 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-a580007a-1078-40eb-8b8b-90313fe6e914 tempest-VolumesServicesTestJSON-324700875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e47df3d0-f384-4a48-8b7b-dcad387c095c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:41:23 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-a580007a-1078-40eb-8b8b-90313fe6e914 tempest-VolumesServicesTestJSON-324700875 None] Volume volume-cf5b89e9-39da-4db7-9fb3-a1e5d7e4142b (cf5b89e9-39da-4db7-9fb3-a1e5d7e4142b): created successfully Sep 23 14:41:23 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-a580007a-1078-40eb-8b8b-90313fe6e914 tempest-VolumesServicesTestJSON-324700875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e47df3d0-f384-4a48-8b7b-dcad387c095c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:41:23 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-a580007a-1078-40eb-8b8b-90313fe6e914 tempest-VolumesServicesTestJSON-324700875 None] Flow 'volume_create_manager' (49254e0d-01f1-4ef4-8377-b518458e5328) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:41:23 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-a580007a-1078-40eb-8b8b-90313fe6e914 tempest-VolumesServicesTestJSON-324700875 None] Created volume successfully. Sep 23 14:41:23 devstack sudo[97576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-15ab669b-661f-4c52-9843-9c066b24b3a1 Sep 23 14:41:23 devstack sudo[97576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:41:23 devstack sudo[97570]: pam_unix(sudo:session): session closed for user root Sep 23 14:41:23 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-64363b9d-a003-46a4-ae35-fc5f227c9b33 tempest-VolumesSnapshotNegativeTestJSON-1336612574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2c5bcc4c-a196-4aa2-aadc-2a3249f773b1" returned: 0 in 0.598s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:41:23 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-64363b9d-a003-46a4-ae35-fc5f227c9b33 tempest-VolumesSnapshotNegativeTestJSON-1336612574 None] Lock "cinder-quobyte-2c5bcc4c-a196-4aa2-aadc-2a3249f773b1" released by "delete_volume" :: held 1.371s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:41:23 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-64363b9d-a003-46a4-ae35-fc5f227c9b33 tempest-VolumesSnapshotNegativeTestJSON-1336612574 None] Created reservations ['3aba1cad-e0b5-4c06-8461-0ffeb4b4ae5d', 'c10c98f1-d71b-4642-8f6d-751507e991cd', '0bd79d2f-ec53-4699-8515-7433daa1ea6c', '05e20348-d077-4dee-92e8-b0b902e7ebfc'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:41:23 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-64363b9d-a003-46a4-ae35-fc5f227c9b33 tempest-VolumesSnapshotNegativeTestJSON-1336612574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:41:23 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-64363b9d-a003-46a4-ae35-fc5f227c9b33 tempest-VolumesSnapshotNegativeTestJSON-1336612574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:41:23 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-64363b9d-a003-46a4-ae35-fc5f227c9b33 tempest-VolumesSnapshotNegativeTestJSON-1336612574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:41:23 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-64363b9d-a003-46a4-ae35-fc5f227c9b33 tempest-VolumesSnapshotNegativeTestJSON-1336612574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:41:23 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-64363b9d-a003-46a4-ae35-fc5f227c9b33 tempest-VolumesSnapshotNegativeTestJSON-1336612574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:41:23 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-64363b9d-a003-46a4-ae35-fc5f227c9b33 tempest-VolumesSnapshotNegativeTestJSON-1336612574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:41:23 devstack sudo[97576]: pam_unix(sudo:session): session closed for user root Sep 23 14:41:23 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-bf801c56-4f20-4861-93a7-c3cfdeaaf13f tempest-VolumesTransfersV355Test-736523973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-15ab669b-661f-4c52-9843-9c066b24b3a1" returned: 0 in 0.571s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:41:23 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-bf801c56-4f20-4861-93a7-c3cfdeaaf13f tempest-VolumesTransfersV355Test-736523973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-15ab669b-661f-4c52-9843-9c066b24b3a1 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:41:24 devstack sudo[97603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:41:24 devstack sudo[97603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:41:24 devstack sudo[97604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-15ab669b-661f-4c52-9843-9c066b24b3a1 Sep 23 14:41:24 devstack sudo[97604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:41:24 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-389f08fc-a606-420b-91b0-7fa7cb8010fe tempest-VolumesServicesTestJSON-324700875 None] Acquiring lock "cinder-cf5b89e9-39da-4db7-9fb3-a1e5d7e4142b-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:41:24 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-389f08fc-a606-420b-91b0-7fa7cb8010fe tempest-VolumesServicesTestJSON-324700875 None] Lock "cinder-cf5b89e9-39da-4db7-9fb3-a1e5d7e4142b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:41:24 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-389f08fc-a606-420b-91b0-7fa7cb8010fe tempest-VolumesServicesTestJSON-324700875 None] Acquiring lock "cinder-quobyte-cf5b89e9-39da-4db7-9fb3-a1e5d7e4142b" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:41:24 devstack sudo[97604]: pam_unix(sudo:session): session closed for user root Sep 23 14:41:24 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-bf801c56-4f20-4861-93a7-c3cfdeaaf13f tempest-VolumesTransfersV355Test-736523973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-15ab669b-661f-4c52-9843-9c066b24b3a1" returned: 0 in 0.370s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:41:24 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-389f08fc-a606-420b-91b0-7fa7cb8010fe tempest-VolumesServicesTestJSON-324700875 None] Lock "cinder-quobyte-cf5b89e9-39da-4db7-9fb3-a1e5d7e4142b" acquired by "delete_volume" :: waited 0.038s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:41:24 devstack sudo[97603]: pam_unix(sudo:session): session closed for user root Sep 23 14:41:24 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-bf801c56-4f20-4861-93a7-c3cfdeaaf13f tempest-VolumesTransfersV355Test-736523973 None] Lock "cinder-quobyte-15ab669b-661f-4c52-9843-9c066b24b3a1" released by "delete_volume" :: held 1.056s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:41:24 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-64363b9d-a003-46a4-ae35-fc5f227c9b33 tempest-VolumesSnapshotNegativeTestJSON-1336612574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.471s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:41:24 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-64363b9d-a003-46a4-ae35-fc5f227c9b33 tempest-VolumesSnapshotNegativeTestJSON-1336612574 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:41:24 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-64363b9d-a003-46a4-ae35-fc5f227c9b33 tempest-VolumesSnapshotNegativeTestJSON-1336612574 None] Deleted volume successfully. Sep 23 14:41:24 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[363af8ae-e9cf-412a-ab69-1fa9d53f4655]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:41:24 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-389f08fc-a606-420b-91b0-7fa7cb8010fe tempest-VolumesServicesTestJSON-324700875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-cf5b89e9-39da-4db7-9fb3-a1e5d7e4142b {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:41:24 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-64363b9d-a003-46a4-ae35-fc5f227c9b33 tempest-VolumesSnapshotNegativeTestJSON-1336612574 None] Lock "cinder-2c5bcc4c-a196-4aa2-aadc-2a3249f773b1-delete_volume" released by "delete_volume" :: held 2.186s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:41:24 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-bf801c56-4f20-4861-93a7-c3cfdeaaf13f tempest-VolumesTransfersV355Test-736523973 None] Created reservations ['7a278192-00f0-4ff1-9bd3-3e254220d808', '1920ab5d-7875-4e0b-9c9f-2d6cb3e0dd0a', '8ac60f5a-b4b1-4c58-bbfd-f10dfcfe3748', 'ba70e3bd-fbe5-4cde-b7ce-b1f321e8131a'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:41:24 devstack sudo[97609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-cf5b89e9-39da-4db7-9fb3-a1e5d7e4142b Sep 23 14:41:24 devstack sudo[97609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:41:24 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-bf801c56-4f20-4861-93a7-c3cfdeaaf13f tempest-VolumesTransfersV355Test-736523973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:41:24 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-bf801c56-4f20-4861-93a7-c3cfdeaaf13f tempest-VolumesTransfersV355Test-736523973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:41:24 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-bf801c56-4f20-4861-93a7-c3cfdeaaf13f tempest-VolumesTransfersV355Test-736523973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:41:24 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-bf801c56-4f20-4861-93a7-c3cfdeaaf13f tempest-VolumesTransfersV355Test-736523973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:41:24 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-bf801c56-4f20-4861-93a7-c3cfdeaaf13f tempest-VolumesTransfersV355Test-736523973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:41:24 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-bf801c56-4f20-4861-93a7-c3cfdeaaf13f tempest-VolumesTransfersV355Test-736523973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:41:24 devstack sudo[97611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:41:24 devstack sudo[97611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:41:24 devstack sudo[97611]: pam_unix(sudo:session): session closed for user root Sep 23 14:41:24 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-bf801c56-4f20-4861-93a7-c3cfdeaaf13f tempest-VolumesTransfersV355Test-736523973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.349s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:41:25 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-bf801c56-4f20-4861-93a7-c3cfdeaaf13f tempest-VolumesTransfersV355Test-736523973 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:41:25 devstack sudo[97609]: pam_unix(sudo:session): session closed for user root Sep 23 14:41:25 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-389f08fc-a606-420b-91b0-7fa7cb8010fe tempest-VolumesServicesTestJSON-324700875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-cf5b89e9-39da-4db7-9fb3-a1e5d7e4142b" returned: 0 in 0.547s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:41:25 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-389f08fc-a606-420b-91b0-7fa7cb8010fe tempest-VolumesServicesTestJSON-324700875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-cf5b89e9-39da-4db7-9fb3-a1e5d7e4142b {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:41:25 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-bf801c56-4f20-4861-93a7-c3cfdeaaf13f tempest-VolumesTransfersV355Test-736523973 None] Deleted volume successfully. Sep 23 14:41:25 devstack sudo[97618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-cf5b89e9-39da-4db7-9fb3-a1e5d7e4142b Sep 23 14:41:25 devstack sudo[97618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:41:25 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-bf801c56-4f20-4861-93a7-c3cfdeaaf13f tempest-VolumesTransfersV355Test-736523973 None] Lock "cinder-15ab669b-661f-4c52-9843-9c066b24b3a1-delete_volume" released by "delete_volume" :: held 1.848s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:41:25 devstack sudo[97618]: pam_unix(sudo:session): session closed for user root Sep 23 14:41:25 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-389f08fc-a606-420b-91b0-7fa7cb8010fe tempest-VolumesServicesTestJSON-324700875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-cf5b89e9-39da-4db7-9fb3-a1e5d7e4142b" returned: 0 in 0.307s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:41:25 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-389f08fc-a606-420b-91b0-7fa7cb8010fe tempest-VolumesServicesTestJSON-324700875 None] Lock "cinder-quobyte-cf5b89e9-39da-4db7-9fb3-a1e5d7e4142b" released by "delete_volume" :: held 0.950s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:41:25 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-389f08fc-a606-420b-91b0-7fa7cb8010fe tempest-VolumesServicesTestJSON-324700875 None] Created reservations ['a330bcc7-bbc5-4ee7-9316-c886a6430773', 'd29537a4-2c94-486a-8acf-09791aea74ae', 'b38d432d-94a9-46f6-ad42-d7f602b57947', '07cd3f71-5ffc-4128-832f-df368e3f4e11'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:41:25 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-389f08fc-a606-420b-91b0-7fa7cb8010fe tempest-VolumesServicesTestJSON-324700875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:41:25 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-389f08fc-a606-420b-91b0-7fa7cb8010fe tempest-VolumesServicesTestJSON-324700875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:41:25 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-389f08fc-a606-420b-91b0-7fa7cb8010fe tempest-VolumesServicesTestJSON-324700875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:41:25 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-389f08fc-a606-420b-91b0-7fa7cb8010fe tempest-VolumesServicesTestJSON-324700875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:41:25 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-389f08fc-a606-420b-91b0-7fa7cb8010fe tempest-VolumesServicesTestJSON-324700875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:41:25 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-389f08fc-a606-420b-91b0-7fa7cb8010fe tempest-VolumesServicesTestJSON-324700875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:41:25 devstack sudo[97622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:41:25 devstack sudo[97622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:41:25 devstack sudo[97622]: pam_unix(sudo:session): session closed for user root Sep 23 14:41:25 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-389f08fc-a606-420b-91b0-7fa7cb8010fe tempest-VolumesServicesTestJSON-324700875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.351s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:41:25 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-389f08fc-a606-420b-91b0-7fa7cb8010fe tempest-VolumesServicesTestJSON-324700875 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:41:25 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-389f08fc-a606-420b-91b0-7fa7cb8010fe tempest-VolumesServicesTestJSON-324700875 None] Deleted volume successfully. Sep 23 14:41:26 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-389f08fc-a606-420b-91b0-7fa7cb8010fe tempest-VolumesServicesTestJSON-324700875 None] Lock "cinder-cf5b89e9-39da-4db7-9fb3-a1e5d7e4142b-delete_volume" released by "delete_volume" :: held 1.725s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:41:35 devstack cinder-volume[86310]: DEBUG dbcounter [-] [86310] Writing DB stats cinder:SELECT=75,cinder:INSERT=28,cinder:UPDATE=106,cinder:DELETE=9 {{(pid=86310) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 14:41:35 devstack cinder-volume[86310]: DEBUG dbcounter [-] [86310] Writing DB stats cinder:SELECT=78,cinder:INSERT=25,cinder:UPDATE=110,cinder:DELETE=9 {{(pid=86310) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 14:41:36 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-68d365eb-f0d8-4afc-aca4-10af417ec35f tempest-VolumesCloneTest-286201423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:41:36 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-68d365eb-f0d8-4afc-aca4-10af417ec35f tempest-VolumesCloneTest-286201423 None] Flow 'volume_create_manager' (bdd7b15f-12c7-4a70-a0c0-c7222b743f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:41:36 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-68d365eb-f0d8-4afc-aca4-10af417ec35f tempest-VolumesCloneTest-286201423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58b3097f-5ea0-4dd9-af5e-0e91db609606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:41:36 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-68d365eb-f0d8-4afc-aca4-10af417ec35f tempest-VolumesCloneTest-286201423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58b3097f-5ea0-4dd9-af5e-0e91db609606) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:41:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1985203494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6db60796-7fd9-4bf8-9026-b683ee7d547b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61233ab2c64346e5abe3ed8365b16cc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:41:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:41:36Z,use_quota=True,user_id='34f011594f2f40df9bcc9bb5b1377750',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:41:36 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-68d365eb-f0d8-4afc-aca4-10af417ec35f tempest-VolumesCloneTest-286201423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe0febcd-dbe0-442e-8e39-eb52327ec18b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:41:36 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-68d365eb-f0d8-4afc-aca4-10af417ec35f tempest-VolumesCloneTest-286201423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe0febcd-dbe0-442e-8e39-eb52327ec18b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:41:36 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-68d365eb-f0d8-4afc-aca4-10af417ec35f tempest-VolumesCloneTest-286201423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e81ee448-35cd-48c9-9aee-2096f04f091a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:41:36 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-68d365eb-f0d8-4afc-aca4-10af417ec35f tempest-VolumesCloneTest-286201423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e81ee448-35cd-48c9-9aee-2096f04f091a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6db60796-7fd9-4bf8-9026-b683ee7d547b', 'volume_name': 'volume-6db60796-7fd9-4bf8-9026-b683ee7d547b', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:41:36 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-68d365eb-f0d8-4afc-aca4-10af417ec35f tempest-VolumesCloneTest-286201423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c8e525f-219f-4188-8412-7659e7a9b92c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:41:36 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-68d365eb-f0d8-4afc-aca4-10af417ec35f tempest-VolumesCloneTest-286201423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c8e525f-219f-4188-8412-7659e7a9b92c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:41:36 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-68d365eb-f0d8-4afc-aca4-10af417ec35f tempest-VolumesCloneTest-286201423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79a59c17-0175-48f1-9638-75d411c26ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:41:36 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-68d365eb-f0d8-4afc-aca4-10af417ec35f tempest-VolumesCloneTest-286201423 None] Volume 6db60796-7fd9-4bf8-9026-b683ee7d547b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6db60796-7fd9-4bf8-9026-b683ee7d547b', 'volume_size': 1} Sep 23 14:41:36 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-68d365eb-f0d8-4afc-aca4-10af417ec35f tempest-VolumesCloneTest-286201423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:41:36 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-68d365eb-f0d8-4afc-aca4-10af417ec35f tempest-VolumesCloneTest-286201423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:41:36 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-68d365eb-f0d8-4afc-aca4-10af417ec35f tempest-VolumesCloneTest-286201423 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:41:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1985203494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6db60796-7fd9-4bf8-9026-b683ee7d547b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61233ab2c64346e5abe3ed8365b16cc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:41:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:41:36Z,use_quota=True,user_id='34f011594f2f40df9bcc9bb5b1377750',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:41:36 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-68d365eb-f0d8-4afc-aca4-10af417ec35f tempest-VolumesCloneTest-286201423 None] Creating volume 6db60796-7fd9-4bf8-9026-b683ee7d547b {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:41:36 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-68d365eb-f0d8-4afc-aca4-10af417ec35f tempest-VolumesCloneTest-286201423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:41:36 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-68d365eb-f0d8-4afc-aca4-10af417ec35f tempest-VolumesCloneTest-286201423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:41:36 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-68d365eb-f0d8-4afc-aca4-10af417ec35f tempest-VolumesCloneTest-286201423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:41:36 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-68d365eb-f0d8-4afc-aca4-10af417ec35f tempest-VolumesCloneTest-286201423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:41:36 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-68d365eb-f0d8-4afc-aca4-10af417ec35f tempest-VolumesCloneTest-286201423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:41:36 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-68d365eb-f0d8-4afc-aca4-10af417ec35f tempest-VolumesCloneTest-286201423 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:41:36 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-68d365eb-f0d8-4afc-aca4-10af417ec35f tempest-VolumesCloneTest-286201423 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:41:36 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-68d365eb-f0d8-4afc-aca4-10af417ec35f tempest-VolumesCloneTest-286201423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6db60796-7fd9-4bf8-9026-b683ee7d547b 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:41:36 devstack sudo[97636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6db60796-7fd9-4bf8-9026-b683ee7d547b 1073741824 Sep 23 14:41:36 devstack sudo[97636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:41:36 devstack sudo[97636]: pam_unix(sudo:session): session closed for user root Sep 23 14:41:36 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-16177615-d10d-4125-bb77-9a0d876f6e72 tempest-VolumesNegativeTest-1045013219 None] Acquiring lock "cinder-80d8668d-7747-471f-b26c-68006ca71a50-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:41:37 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-68d365eb-f0d8-4afc-aca4-10af417ec35f tempest-VolumesCloneTest-286201423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6db60796-7fd9-4bf8-9026-b683ee7d547b 1073741824" returned: 0 in 0.783s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:41:37 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-16177615-d10d-4125-bb77-9a0d876f6e72 tempest-VolumesNegativeTest-1045013219 None] Lock "cinder-80d8668d-7747-471f-b26c-68006ca71a50-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:41:37 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-68d365eb-f0d8-4afc-aca4-10af417ec35f tempest-VolumesCloneTest-286201423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6db60796-7fd9-4bf8-9026-b683ee7d547b {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:41:37 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-16177615-d10d-4125-bb77-9a0d876f6e72 tempest-VolumesNegativeTest-1045013219 None] Acquiring lock "cinder-quobyte-80d8668d-7747-471f-b26c-68006ca71a50" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:41:37 devstack sudo[97642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6db60796-7fd9-4bf8-9026-b683ee7d547b Sep 23 14:41:37 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-16177615-d10d-4125-bb77-9a0d876f6e72 tempest-VolumesNegativeTest-1045013219 None] Lock "cinder-quobyte-80d8668d-7747-471f-b26c-68006ca71a50" acquired by "delete_volume" :: waited 0.033s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:41:37 devstack sudo[97642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:41:37 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[8172d626-ea0d-46b2-98ac-dab53354687f]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:41:37 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-16177615-d10d-4125-bb77-9a0d876f6e72 tempest-VolumesNegativeTest-1045013219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-80d8668d-7747-471f-b26c-68006ca71a50 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:41:37 devstack sudo[97644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-80d8668d-7747-471f-b26c-68006ca71a50 Sep 23 14:41:37 devstack sudo[97644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:41:37 devstack sudo[97642]: pam_unix(sudo:session): session closed for user root Sep 23 14:41:37 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-68d365eb-f0d8-4afc-aca4-10af417ec35f tempest-VolumesCloneTest-286201423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6db60796-7fd9-4bf8-9026-b683ee7d547b" returned: 0 in 0.418s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:41:37 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-68d365eb-f0d8-4afc-aca4-10af417ec35f tempest-VolumesCloneTest-286201423 None] <== create_volume: return (1309ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:41:37 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-68d365eb-f0d8-4afc-aca4-10af417ec35f tempest-VolumesCloneTest-286201423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.313s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:41:37 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-68d365eb-f0d8-4afc-aca4-10af417ec35f tempest-VolumesCloneTest-286201423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79a59c17-0175-48f1-9638-75d411c26ea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6db60796-7fd9-4bf8-9026-b683ee7d547b', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:41:37 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-68d365eb-f0d8-4afc-aca4-10af417ec35f tempest-VolumesCloneTest-286201423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2628546-f78a-4be2-aa7e-12606277d36d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:41:37 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-68d365eb-f0d8-4afc-aca4-10af417ec35f tempest-VolumesCloneTest-286201423 None] Volume volume-6db60796-7fd9-4bf8-9026-b683ee7d547b (6db60796-7fd9-4bf8-9026-b683ee7d547b): created successfully Sep 23 14:41:37 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-68d365eb-f0d8-4afc-aca4-10af417ec35f tempest-VolumesCloneTest-286201423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2628546-f78a-4be2-aa7e-12606277d36d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:41:37 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-68d365eb-f0d8-4afc-aca4-10af417ec35f tempest-VolumesCloneTest-286201423 None] Flow 'volume_create_manager' (bdd7b15f-12c7-4a70-a0c0-c7222b743f12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:41:37 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-68d365eb-f0d8-4afc-aca4-10af417ec35f tempest-VolumesCloneTest-286201423 None] Created volume successfully. Sep 23 14:41:37 devstack sudo[97644]: pam_unix(sudo:session): session closed for user root Sep 23 14:41:37 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-16177615-d10d-4125-bb77-9a0d876f6e72 tempest-VolumesNegativeTest-1045013219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-80d8668d-7747-471f-b26c-68006ca71a50" returned: 0 in 0.522s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:41:37 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-16177615-d10d-4125-bb77-9a0d876f6e72 tempest-VolumesNegativeTest-1045013219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-80d8668d-7747-471f-b26c-68006ca71a50 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:41:37 devstack sudo[97650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-80d8668d-7747-471f-b26c-68006ca71a50 Sep 23 14:41:37 devstack sudo[97650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:41:38 devstack sudo[97650]: pam_unix(sudo:session): session closed for user root Sep 23 14:41:38 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-16177615-d10d-4125-bb77-9a0d876f6e72 tempest-VolumesNegativeTest-1045013219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-80d8668d-7747-471f-b26c-68006ca71a50" returned: 0 in 0.360s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:41:38 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-16177615-d10d-4125-bb77-9a0d876f6e72 tempest-VolumesNegativeTest-1045013219 None] Lock "cinder-quobyte-80d8668d-7747-471f-b26c-68006ca71a50" released by "delete_volume" :: held 0.957s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:41:38 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-16177615-d10d-4125-bb77-9a0d876f6e72 tempest-VolumesNegativeTest-1045013219 None] Created reservations ['c6f70973-97d5-436a-87af-a4893ab6abb1', 'c54c2774-e2e1-45e5-9263-8a0af8dd5291', '363441cd-2432-4135-9ff2-e56de84d1f78', 'cd4be9c7-0efb-49db-924a-6e6bc9a2b97e'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:41:38 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-16177615-d10d-4125-bb77-9a0d876f6e72 tempest-VolumesNegativeTest-1045013219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:41:38 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-16177615-d10d-4125-bb77-9a0d876f6e72 tempest-VolumesNegativeTest-1045013219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:41:38 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-16177615-d10d-4125-bb77-9a0d876f6e72 tempest-VolumesNegativeTest-1045013219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:41:38 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-16177615-d10d-4125-bb77-9a0d876f6e72 tempest-VolumesNegativeTest-1045013219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:41:38 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-16177615-d10d-4125-bb77-9a0d876f6e72 tempest-VolumesNegativeTest-1045013219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:41:38 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-16177615-d10d-4125-bb77-9a0d876f6e72 tempest-VolumesNegativeTest-1045013219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:41:38 devstack sudo[97653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:41:38 devstack sudo[97653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:41:38 devstack sudo[97653]: pam_unix(sudo:session): session closed for user root Sep 23 14:41:38 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-16177615-d10d-4125-bb77-9a0d876f6e72 tempest-VolumesNegativeTest-1045013219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.405s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:41:38 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-16177615-d10d-4125-bb77-9a0d876f6e72 tempest-VolumesNegativeTest-1045013219 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:41:38 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-16177615-d10d-4125-bb77-9a0d876f6e72 tempest-VolumesNegativeTest-1045013219 None] Deleted volume successfully. Sep 23 14:41:38 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-16177615-d10d-4125-bb77-9a0d876f6e72 tempest-VolumesNegativeTest-1045013219 None] Lock "cinder-80d8668d-7747-471f-b26c-68006ca71a50-delete_volume" released by "delete_volume" :: held 1.827s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:41:39 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b255e72-8eeb-4d0c-9826-20d4f7481446 tempest-VolumesCloneTest-286201423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:41:39 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-8b255e72-8eeb-4d0c-9826-20d4f7481446 tempest-VolumesCloneTest-286201423 None] Flow 'volume_create_manager' (f63c8129-ed3d-4257-9ed0-87ed38ad1159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:41:39 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-8b255e72-8eeb-4d0c-9826-20d4f7481446 tempest-VolumesCloneTest-286201423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (725c755e-81e7-4143-8b7c-ca79c9b777d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:41:39 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-8b255e72-8eeb-4d0c-9826-20d4f7481446 tempest-VolumesCloneTest-286201423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (725c755e-81e7-4143-8b7c-ca79c9b777d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:41:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1074659639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42fdc562-043c-4be5-908c-454927dabc61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61233ab2c64346e5abe3ed8365b16cc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:41:39Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=6db60796-7fd9-4bf8-9026-b683ee7d547b,status='creating',terminated_at=None,updated_at=2026-09-23T12:41:39Z,use_quota=True,user_id='34f011594f2f40df9bcc9bb5b1377750',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:41:39 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-8b255e72-8eeb-4d0c-9826-20d4f7481446 tempest-VolumesCloneTest-286201423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23f5bc05-c1b2-4072-b805-3d48d8e5f2ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:41:39 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-8b255e72-8eeb-4d0c-9826-20d4f7481446 tempest-VolumesCloneTest-286201423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23f5bc05-c1b2-4072-b805-3d48d8e5f2ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:41:39 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-8b255e72-8eeb-4d0c-9826-20d4f7481446 tempest-VolumesCloneTest-286201423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cff3ae58-e84c-4d2e-b920-d474b76fff99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:41:39 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-8b255e72-8eeb-4d0c-9826-20d4f7481446 tempest-VolumesCloneTest-286201423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cff3ae58-e84c-4d2e-b920-d474b76fff99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '42fdc562-043c-4be5-908c-454927dabc61', 'volume_name': 'volume-42fdc562-043c-4be5-908c-454927dabc61', 'volume_size': 2, 'source_volid': '6db60796-7fd9-4bf8-9026-b683ee7d547b', 'source_volstatus': 'available'}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:41:39 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-8b255e72-8eeb-4d0c-9826-20d4f7481446 tempest-VolumesCloneTest-286201423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (024c0683-639b-4bbb-bd45-4eb301a1d1c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:41:39 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-8b255e72-8eeb-4d0c-9826-20d4f7481446 tempest-VolumesCloneTest-286201423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (024c0683-639b-4bbb-bd45-4eb301a1d1c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:41:39 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-8b255e72-8eeb-4d0c-9826-20d4f7481446 tempest-VolumesCloneTest-286201423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a94f6edf-53e0-4e3b-84ac-ecc37868ec18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:41:39 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-8b255e72-8eeb-4d0c-9826-20d4f7481446 tempest-VolumesCloneTest-286201423 None] Volume 42fdc562-043c-4be5-908c-454927dabc61: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-42fdc562-043c-4be5-908c-454927dabc61', 'volume_size': 2, 'source_volid': '6db60796-7fd9-4bf8-9026-b683ee7d547b', 'source_volstatus': 'available'} Sep 23 14:41:39 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-8b255e72-8eeb-4d0c-9826-20d4f7481446 tempest-VolumesCloneTest-286201423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:41:39 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-8b255e72-8eeb-4d0c-9826-20d4f7481446 tempest-VolumesCloneTest-286201423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:41:39 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-8b255e72-8eeb-4d0c-9826-20d4f7481446 tempest-VolumesCloneTest-286201423 None] Cloning volume 6db60796-7fd9-4bf8-9026-b683ee7d547b to volume 42fdc562-043c-4be5-908c-454927dabc61 Sep 23 14:41:39 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-8b255e72-8eeb-4d0c-9826-20d4f7481446 tempest-VolumesCloneTest-286201423 None] Creating offline snapshot 42c0d39e-8112-45cb-a90b-c880e6baba94 of volume 6db60796-7fd9-4bf8-9026-b683ee7d547b {{(pid=86310) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 14:41:39 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d7ae36a-266f-46b3-ab16-d0a44e5febfe]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:41:39 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8b255e72-8eeb-4d0c-9826-20d4f7481446 tempest-VolumesCloneTest-286201423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6db60796-7fd9-4bf8-9026-b683ee7d547b {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:41:39 devstack sudo[97656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6db60796-7fd9-4bf8-9026-b683ee7d547b Sep 23 14:41:39 devstack sudo[97656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:41:40 devstack sudo[97656]: pam_unix(sudo:session): session closed for user root Sep 23 14:41:40 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8b255e72-8eeb-4d0c-9826-20d4f7481446 tempest-VolumesCloneTest-286201423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6db60796-7fd9-4bf8-9026-b683ee7d547b" returned: 0 in 0.523s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:41:40 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8b255e72-8eeb-4d0c-9826-20d4f7481446 tempest-VolumesCloneTest-286201423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6db60796-7fd9-4bf8-9026-b683ee7d547b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6db60796-7fd9-4bf8-9026-b683ee7d547b.42c0d39e-8112-45cb-a90b-c880e6baba94 1G {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:41:40 devstack sudo[97661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6db60796-7fd9-4bf8-9026-b683ee7d547b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6db60796-7fd9-4bf8-9026-b683ee7d547b.42c0d39e-8112-45cb-a90b-c880e6baba94 1G Sep 23 14:41:40 devstack sudo[97661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:41:40 devstack sudo[97661]: pam_unix(sudo:session): session closed for user root Sep 23 14:41:40 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8b255e72-8eeb-4d0c-9826-20d4f7481446 tempest-VolumesCloneTest-286201423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6db60796-7fd9-4bf8-9026-b683ee7d547b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6db60796-7fd9-4bf8-9026-b683ee7d547b.42c0d39e-8112-45cb-a90b-c880e6baba94 1G" returned: 0 in 0.607s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:41:40 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8b255e72-8eeb-4d0c-9826-20d4f7481446 tempest-VolumesCloneTest-286201423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6db60796-7fd9-4bf8-9026-b683ee7d547b -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6db60796-7fd9-4bf8-9026-b683ee7d547b.42c0d39e-8112-45cb-a90b-c880e6baba94 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:41:40 devstack sudo[97667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6db60796-7fd9-4bf8-9026-b683ee7d547b -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6db60796-7fd9-4bf8-9026-b683ee7d547b.42c0d39e-8112-45cb-a90b-c880e6baba94 Sep 23 14:41:40 devstack sudo[97667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:41:41 devstack sudo[97667]: pam_unix(sudo:session): session closed for user root Sep 23 14:41:41 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8b255e72-8eeb-4d0c-9826-20d4f7481446 tempest-VolumesCloneTest-286201423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6db60796-7fd9-4bf8-9026-b683ee7d547b -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6db60796-7fd9-4bf8-9026-b683ee7d547b.42c0d39e-8112-45cb-a90b-c880e6baba94" returned: 0 in 0.488s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:41:41 devstack cinder-volume[86310]: WARNING cinder.volume.drivers.remotefs [None req-8b255e72-8eeb-4d0c-9826-20d4f7481446 tempest-VolumesCloneTest-286201423 None] /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6db60796-7fd9-4bf8-9026-b683ee7d547b.42c0d39e-8112-45cb-a90b-c880e6baba94 is being set with open permissions: ugo+rw Sep 23 14:41:41 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8b255e72-8eeb-4d0c-9826-20d4f7481446 tempest-VolumesCloneTest-286201423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6db60796-7fd9-4bf8-9026-b683ee7d547b.42c0d39e-8112-45cb-a90b-c880e6baba94 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:41:41 devstack sudo[97673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6db60796-7fd9-4bf8-9026-b683ee7d547b.42c0d39e-8112-45cb-a90b-c880e6baba94 Sep 23 14:41:41 devstack sudo[97673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:41:41 devstack sudo[97673]: pam_unix(sudo:session): session closed for user root Sep 23 14:41:41 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8b255e72-8eeb-4d0c-9826-20d4f7481446 tempest-VolumesCloneTest-286201423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6db60796-7fd9-4bf8-9026-b683ee7d547b.42c0d39e-8112-45cb-a90b-c880e6baba94" returned: 0 in 0.439s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:41:41 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8b255e72-8eeb-4d0c-9826-20d4f7481446 tempest-VolumesCloneTest-286201423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6db60796-7fd9-4bf8-9026-b683ee7d547b.info {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:41:41 devstack sudo[97676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6db60796-7fd9-4bf8-9026-b683ee7d547b.info Sep 23 14:41:41 devstack sudo[97676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:41:42 devstack sudo[97676]: pam_unix(sudo:session): session closed for user root Sep 23 14:41:42 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8b255e72-8eeb-4d0c-9826-20d4f7481446 tempest-VolumesCloneTest-286201423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6db60796-7fd9-4bf8-9026-b683ee7d547b.info" returned: 0 in 0.402s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:41:42 devstack cinder-volume[86310]: WARNING cinder.volume.drivers.remotefs [None req-8b255e72-8eeb-4d0c-9826-20d4f7481446 tempest-VolumesCloneTest-286201423 None] /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6db60796-7fd9-4bf8-9026-b683ee7d547b.info is being set with open permissions: ugo+rw Sep 23 14:41:42 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8b255e72-8eeb-4d0c-9826-20d4f7481446 tempest-VolumesCloneTest-286201423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6db60796-7fd9-4bf8-9026-b683ee7d547b.info {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:41:42 devstack sudo[97679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6db60796-7fd9-4bf8-9026-b683ee7d547b.info Sep 23 14:41:42 devstack sudo[97679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:41:42 devstack sudo[97679]: pam_unix(sudo:session): session closed for user root Sep 23 14:41:42 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8b255e72-8eeb-4d0c-9826-20d4f7481446 tempest-VolumesCloneTest-286201423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6db60796-7fd9-4bf8-9026-b683ee7d547b.info" returned: 0 in 0.425s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:41:42 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-8b255e72-8eeb-4d0c-9826-20d4f7481446 tempest-VolumesCloneTest-286201423 None] Acquiring lock "cinder-quobyte-42fdc562-043c-4be5-908c-454927dabc61" by "_copy_volume_from_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:41:42 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-8b255e72-8eeb-4d0c-9826-20d4f7481446 tempest-VolumesCloneTest-286201423 None] Lock "cinder-quobyte-42fdc562-043c-4be5-908c-454927dabc61" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:41:42 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-8b255e72-8eeb-4d0c-9826-20d4f7481446 tempest-VolumesCloneTest-286201423 None] snapshot: 42c0d39e-8112-45cb-a90b-c880e6baba94, volume: 42fdc562-043c-4be5-908c-454927dabc61, {{(pid=86310) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 23 14:41:42 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-8b255e72-8eeb-4d0c-9826-20d4f7481446 tempest-VolumesCloneTest-286201423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:41:42 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-8b255e72-8eeb-4d0c-9826-20d4f7481446 tempest-VolumesCloneTest-286201423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:41:42 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-8b255e72-8eeb-4d0c-9826-20d4f7481446 tempest-VolumesCloneTest-286201423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:41:42 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-8b255e72-8eeb-4d0c-9826-20d4f7481446 tempest-VolumesCloneTest-286201423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:41:42 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-8b255e72-8eeb-4d0c-9826-20d4f7481446 tempest-VolumesCloneTest-286201423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:41:42 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[983a1b51-e97b-4b28-969e-14675e24a3ad]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:41:42 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8b255e72-8eeb-4d0c-9826-20d4f7481446 tempest-VolumesCloneTest-286201423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6db60796-7fd9-4bf8-9026-b683ee7d547b.42c0d39e-8112-45cb-a90b-c880e6baba94 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:41:42 devstack sudo[97683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6db60796-7fd9-4bf8-9026-b683ee7d547b.42c0d39e-8112-45cb-a90b-c880e6baba94 Sep 23 14:41:42 devstack sudo[97683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:41:43 devstack sudo[97683]: pam_unix(sudo:session): session closed for user root Sep 23 14:41:43 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8b255e72-8eeb-4d0c-9826-20d4f7481446 tempest-VolumesCloneTest-286201423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6db60796-7fd9-4bf8-9026-b683ee7d547b.42c0d39e-8112-45cb-a90b-c880e6baba94" returned: 0 in 0.501s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:41:43 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-8b255e72-8eeb-4d0c-9826-20d4f7481446 tempest-VolumesCloneTest-286201423 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6db60796-7fd9-4bf8-9026-b683ee7d547b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 14:41:43 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[9361277f-565d-4468-826b-383514c30290]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:41:43 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8b255e72-8eeb-4d0c-9826-20d4f7481446 tempest-VolumesCloneTest-286201423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6db60796-7fd9-4bf8-9026-b683ee7d547b {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:41:43 devstack sudo[97688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6db60796-7fd9-4bf8-9026-b683ee7d547b Sep 23 14:41:43 devstack sudo[97688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:41:43 devstack sudo[97688]: pam_unix(sudo:session): session closed for user root Sep 23 14:41:43 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8b255e72-8eeb-4d0c-9826-20d4f7481446 tempest-VolumesCloneTest-286201423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6db60796-7fd9-4bf8-9026-b683ee7d547b" returned: 0 in 0.548s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:41:43 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-8b255e72-8eeb-4d0c-9826-20d4f7481446 tempest-VolumesCloneTest-286201423 None] will copy from snapshot at /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6db60796-7fd9-4bf8-9026-b683ee7d547b {{(pid=86310) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 23 14:41:43 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-8b255e72-8eeb-4d0c-9826-20d4f7481446 tempest-VolumesCloneTest-286201423 None] Creating direct copy from snapshot {{(pid=86310) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 23 14:41:43 devstack cinder-volume[86310]: DEBUG cinder.utils [None req-8b255e72-8eeb-4d0c-9826-20d4f7481446 tempest-VolumesCloneTest-286201423 None] Path /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-42fdc562-043c-4be5-908c-454927dabc61 not found in is_blk_device check {{(pid=86310) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 23 14:41:43 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8b255e72-8eeb-4d0c-9826-20d4f7481446 tempest-VolumesCloneTest-286201423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6db60796-7fd9-4bf8-9026-b683ee7d547b /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-42fdc562-043c-4be5-908c-454927dabc61 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:41:43 devstack sudo[97693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6db60796-7fd9-4bf8-9026-b683ee7d547b /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-42fdc562-043c-4be5-908c-454927dabc61 Sep 23 14:41:43 devstack sudo[97693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:41:51 devstack cinder-volume[86310]: DEBUG oslo_service.periodic_task [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86310) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 14:41:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:41:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:41:51 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:41:51 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:41:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:41:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:41:51 devstack sudo[97707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:41:51 devstack sudo[97707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:41:51 devstack cinder-volume[86310]: DEBUG dbcounter [-] [86310] Writing DB stats cinder:SELECT=10,cinder:UPDATE=13,cinder:INSERT=3 {{(pid=86310) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 14:41:51 devstack cinder-volume[86310]: DEBUG dbcounter [-] [86310] Writing DB stats cinder:SELECT=12,cinder:UPDATE=11,cinder:INSERT=4,cinder:DELETE=2 {{(pid=86310) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 14:41:51 devstack sudo[97707]: pam_unix(sudo:session): session closed for user root Sep 23 14:41:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.359s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:41:51 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:41:51 devstack cinder-volume[86310]: DEBUG oslo_service.periodic_task [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Running periodic task VolumeManager._thread_info {{(pid=86310) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 14:41:51 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] thread count: 28 {{(pid=86310) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 14:41:51 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] thread info: [<_MainThread(MainThread, started 128854208852096)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86310) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 14:41:52 devstack sudo[97693]: pam_unix(sudo:session): session closed for user root Sep 23 14:41:52 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8b255e72-8eeb-4d0c-9826-20d4f7481446 tempest-VolumesCloneTest-286201423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6db60796-7fd9-4bf8-9026-b683ee7d547b /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-42fdc562-043c-4be5-908c-454927dabc61" returned: 0 in 9.054s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:41:52 devstack cinder-volume[86310]: DEBUG cinder.image.image_utils [None req-8b255e72-8eeb-4d0c-9826-20d4f7481446 tempest-VolumesCloneTest-286201423 None] Image conversion details: src /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6db60796-7fd9-4bf8-9026-b683ee7d547b, size 1024.00 MB, duration 9.05 sec, destination /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-42fdc562-043c-4be5-908c-454927dabc61 {{(pid=86310) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 14:41:52 devstack cinder-volume[86310]: INFO cinder.image.image_utils [None req-8b255e72-8eeb-4d0c-9826-20d4f7481446 tempest-VolumesCloneTest-286201423 None] Converted 1024.00 MB image at 113.09 MB/s Sep 23 14:41:52 devstack cinder-volume[86310]: WARNING cinder.volume.drivers.remotefs [None req-8b255e72-8eeb-4d0c-9826-20d4f7481446 tempest-VolumesCloneTest-286201423 None] /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-42fdc562-043c-4be5-908c-454927dabc61 is being set with open permissions: ugo+rw Sep 23 14:41:52 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8b255e72-8eeb-4d0c-9826-20d4f7481446 tempest-VolumesCloneTest-286201423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-42fdc562-043c-4be5-908c-454927dabc61 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:41:52 devstack sudo[97711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-42fdc562-043c-4be5-908c-454927dabc61 Sep 23 14:41:52 devstack sudo[97711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:41:53 devstack sudo[97711]: pam_unix(sudo:session): session closed for user root Sep 23 14:41:53 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8b255e72-8eeb-4d0c-9826-20d4f7481446 tempest-VolumesCloneTest-286201423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-42fdc562-043c-4be5-908c-454927dabc61" returned: 0 in 0.326s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:41:53 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-8b255e72-8eeb-4d0c-9826-20d4f7481446 tempest-VolumesCloneTest-286201423 None] Lock "cinder-quobyte-42fdc562-043c-4be5-908c-454927dabc61" released by "_copy_volume_from_snapshot" :: held 10.545s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:41:53 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-8b255e72-8eeb-4d0c-9826-20d4f7481446 tempest-VolumesCloneTest-286201423 None] Acquiring lock "cinder-quobyte-42c0d39e-8112-45cb-a90b-c880e6baba94" by "_delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:41:53 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-8b255e72-8eeb-4d0c-9826-20d4f7481446 tempest-VolumesCloneTest-286201423 None] Lock "cinder-quobyte-42c0d39e-8112-45cb-a90b-c880e6baba94" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:41:53 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-8b255e72-8eeb-4d0c-9826-20d4f7481446 tempest-VolumesCloneTest-286201423 None] Deleting offline snapshot 42c0d39e-8112-45cb-a90b-c880e6baba94 of volume 6db60796-7fd9-4bf8-9026-b683ee7d547b {{(pid=86310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 14:41:53 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-8b255e72-8eeb-4d0c-9826-20d4f7481446 tempest-VolumesCloneTest-286201423 None] snapshot_file for this snap is: volume-6db60796-7fd9-4bf8-9026-b683ee7d547b.42c0d39e-8112-45cb-a90b-c880e6baba94 {{(pid=86310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 14:41:53 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[8934953e-7357-4d14-b852-cc8569388163]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:41:53 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8b255e72-8eeb-4d0c-9826-20d4f7481446 tempest-VolumesCloneTest-286201423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6db60796-7fd9-4bf8-9026-b683ee7d547b.42c0d39e-8112-45cb-a90b-c880e6baba94 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:41:53 devstack sudo[97714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6db60796-7fd9-4bf8-9026-b683ee7d547b.42c0d39e-8112-45cb-a90b-c880e6baba94 Sep 23 14:41:53 devstack sudo[97714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:41:53 devstack sudo[97714]: pam_unix(sudo:session): session closed for user root Sep 23 14:41:53 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8b255e72-8eeb-4d0c-9826-20d4f7481446 tempest-VolumesCloneTest-286201423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6db60796-7fd9-4bf8-9026-b683ee7d547b.42c0d39e-8112-45cb-a90b-c880e6baba94" returned: 0 in 0.491s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:41:53 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-8b255e72-8eeb-4d0c-9826-20d4f7481446 tempest-VolumesCloneTest-286201423 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6db60796-7fd9-4bf8-9026-b683ee7d547b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 14:41:53 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[75d1e7b7-f9b6-4244-a8a5-ba245bd65cff]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:41:53 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8b255e72-8eeb-4d0c-9826-20d4f7481446 tempest-VolumesCloneTest-286201423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6db60796-7fd9-4bf8-9026-b683ee7d547b {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:41:53 devstack sudo[97719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6db60796-7fd9-4bf8-9026-b683ee7d547b Sep 23 14:41:53 devstack sudo[97719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:41:54 devstack sudo[97719]: pam_unix(sudo:session): session closed for user root Sep 23 14:41:54 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8b255e72-8eeb-4d0c-9826-20d4f7481446 tempest-VolumesCloneTest-286201423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6db60796-7fd9-4bf8-9026-b683ee7d547b" returned: 0 in 0.657s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:41:54 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8b255e72-8eeb-4d0c-9826-20d4f7481446 tempest-VolumesCloneTest-286201423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6db60796-7fd9-4bf8-9026-b683ee7d547b.42c0d39e-8112-45cb-a90b-c880e6baba94 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:41:54 devstack sudo[97724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6db60796-7fd9-4bf8-9026-b683ee7d547b.42c0d39e-8112-45cb-a90b-c880e6baba94 Sep 23 14:41:54 devstack sudo[97724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:41:54 devstack sudo[97724]: pam_unix(sudo:session): session closed for user root Sep 23 14:41:54 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8b255e72-8eeb-4d0c-9826-20d4f7481446 tempest-VolumesCloneTest-286201423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6db60796-7fd9-4bf8-9026-b683ee7d547b.42c0d39e-8112-45cb-a90b-c880e6baba94" returned: 0 in 0.552s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:41:54 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8b255e72-8eeb-4d0c-9826-20d4f7481446 tempest-VolumesCloneTest-286201423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6db60796-7fd9-4bf8-9026-b683ee7d547b.42c0d39e-8112-45cb-a90b-c880e6baba94 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:41:54 devstack sudo[97729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6db60796-7fd9-4bf8-9026-b683ee7d547b.42c0d39e-8112-45cb-a90b-c880e6baba94 Sep 23 14:41:54 devstack sudo[97729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:41:55 devstack sudo[97729]: pam_unix(sudo:session): session closed for user root Sep 23 14:41:55 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8b255e72-8eeb-4d0c-9826-20d4f7481446 tempest-VolumesCloneTest-286201423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6db60796-7fd9-4bf8-9026-b683ee7d547b.42c0d39e-8112-45cb-a90b-c880e6baba94" returned: 0 in 0.293s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:41:55 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-8b255e72-8eeb-4d0c-9826-20d4f7481446 tempest-VolumesCloneTest-286201423 None] Lock "cinder-quobyte-42c0d39e-8112-45cb-a90b-c880e6baba94" released by "_delete_snapshot" :: held 2.151s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:41:55 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-8b255e72-8eeb-4d0c-9826-20d4f7481446 tempest-VolumesCloneTest-286201423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.893s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:41:55 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-8b255e72-8eeb-4d0c-9826-20d4f7481446 tempest-VolumesCloneTest-286201423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a94f6edf-53e0-4e3b-84ac-ecc37868ec18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42fdc562-043c-4be5-908c-454927dabc61', 'volume_size': 2, 'source_volid': '6db60796-7fd9-4bf8-9026-b683ee7d547b', 'source_volstatus': 'available'}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:41:55 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-8b255e72-8eeb-4d0c-9826-20d4f7481446 tempest-VolumesCloneTest-286201423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8901bc80-26ee-47f0-83a5-a27bb4694dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:41:55 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-8b255e72-8eeb-4d0c-9826-20d4f7481446 tempest-VolumesCloneTest-286201423 None] Volume volume-42fdc562-043c-4be5-908c-454927dabc61 (42fdc562-043c-4be5-908c-454927dabc61): created successfully Sep 23 14:41:55 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-8b255e72-8eeb-4d0c-9826-20d4f7481446 tempest-VolumesCloneTest-286201423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8901bc80-26ee-47f0-83a5-a27bb4694dd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:41:55 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-8b255e72-8eeb-4d0c-9826-20d4f7481446 tempest-VolumesCloneTest-286201423 None] Flow 'volume_create_manager' (f63c8129-ed3d-4257-9ed0-87ed38ad1159) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:41:55 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-8b255e72-8eeb-4d0c-9826-20d4f7481446 tempest-VolumesCloneTest-286201423 None] Created volume successfully. Sep 23 14:41:56 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-57853bf9-9329-4a17-9e73-3f751fd6e016 tempest-VolumesCloneTest-286201423 None] Acquiring lock "cinder-42fdc562-043c-4be5-908c-454927dabc61-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:41:56 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-57853bf9-9329-4a17-9e73-3f751fd6e016 tempest-VolumesCloneTest-286201423 None] Lock "cinder-42fdc562-043c-4be5-908c-454927dabc61-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:41:56 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-57853bf9-9329-4a17-9e73-3f751fd6e016 tempest-VolumesCloneTest-286201423 None] Acquiring lock "cinder-quobyte-42fdc562-043c-4be5-908c-454927dabc61" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:41:56 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-57853bf9-9329-4a17-9e73-3f751fd6e016 tempest-VolumesCloneTest-286201423 None] Lock "cinder-quobyte-42fdc562-043c-4be5-908c-454927dabc61" acquired by "delete_volume" :: waited 0.024s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:41:56 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[35535ba3-713f-4c6e-9836-44c76ac96bc6]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:41:56 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-57853bf9-9329-4a17-9e73-3f751fd6e016 tempest-VolumesCloneTest-286201423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-42fdc562-043c-4be5-908c-454927dabc61 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:41:56 devstack sudo[97732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-42fdc562-043c-4be5-908c-454927dabc61 Sep 23 14:41:56 devstack sudo[97732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:41:56 devstack sudo[97732]: pam_unix(sudo:session): session closed for user root Sep 23 14:41:56 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-57853bf9-9329-4a17-9e73-3f751fd6e016 tempest-VolumesCloneTest-286201423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-42fdc562-043c-4be5-908c-454927dabc61" returned: 0 in 0.535s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:41:56 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-57853bf9-9329-4a17-9e73-3f751fd6e016 tempest-VolumesCloneTest-286201423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-42fdc562-043c-4be5-908c-454927dabc61 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:41:56 devstack sudo[97737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-42fdc562-043c-4be5-908c-454927dabc61 Sep 23 14:41:56 devstack sudo[97737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:41:57 devstack sudo[97737]: pam_unix(sudo:session): session closed for user root Sep 23 14:41:57 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-57853bf9-9329-4a17-9e73-3f751fd6e016 tempest-VolumesCloneTest-286201423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-42fdc562-043c-4be5-908c-454927dabc61" returned: 0 in 0.348s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:41:57 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-57853bf9-9329-4a17-9e73-3f751fd6e016 tempest-VolumesCloneTest-286201423 None] Lock "cinder-quobyte-42fdc562-043c-4be5-908c-454927dabc61" released by "delete_volume" :: held 0.963s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:41:57 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-57853bf9-9329-4a17-9e73-3f751fd6e016 tempest-VolumesCloneTest-286201423 None] Created reservations ['42be9180-d982-4a87-9467-0b33eb0add85', '18881ac1-97c3-4311-86b2-b67b885780e0', 'a5429586-a993-48c6-bd83-256bbda53cc7', '0e5898b4-08be-4588-baf4-75c3484faed7'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:41:57 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-57853bf9-9329-4a17-9e73-3f751fd6e016 tempest-VolumesCloneTest-286201423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:41:57 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-57853bf9-9329-4a17-9e73-3f751fd6e016 tempest-VolumesCloneTest-286201423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:41:57 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-57853bf9-9329-4a17-9e73-3f751fd6e016 tempest-VolumesCloneTest-286201423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:41:57 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-57853bf9-9329-4a17-9e73-3f751fd6e016 tempest-VolumesCloneTest-286201423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:41:57 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-57853bf9-9329-4a17-9e73-3f751fd6e016 tempest-VolumesCloneTest-286201423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:41:57 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-57853bf9-9329-4a17-9e73-3f751fd6e016 tempest-VolumesCloneTest-286201423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:41:57 devstack sudo[97740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:41:57 devstack sudo[97740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:41:57 devstack sudo[97740]: pam_unix(sudo:session): session closed for user root Sep 23 14:41:57 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-57853bf9-9329-4a17-9e73-3f751fd6e016 tempest-VolumesCloneTest-286201423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.274s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:41:57 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-57853bf9-9329-4a17-9e73-3f751fd6e016 tempest-VolumesCloneTest-286201423 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:41:57 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-57853bf9-9329-4a17-9e73-3f751fd6e016 tempest-VolumesCloneTest-286201423 None] Deleted volume successfully. Sep 23 14:41:57 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-57853bf9-9329-4a17-9e73-3f751fd6e016 tempest-VolumesCloneTest-286201423 None] Lock "cinder-42fdc562-043c-4be5-908c-454927dabc61-delete_volume" released by "delete_volume" :: held 1.636s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:41:58 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-7006d042-5b35-4912-93be-d0dbdb99a3a2 tempest-VolumesCloneTest-286201423 None] Acquiring lock "cinder-6db60796-7fd9-4bf8-9026-b683ee7d547b-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:41:58 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-7006d042-5b35-4912-93be-d0dbdb99a3a2 tempest-VolumesCloneTest-286201423 None] Lock "cinder-6db60796-7fd9-4bf8-9026-b683ee7d547b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:41:58 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-7006d042-5b35-4912-93be-d0dbdb99a3a2 tempest-VolumesCloneTest-286201423 None] Acquiring lock "cinder-quobyte-6db60796-7fd9-4bf8-9026-b683ee7d547b" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:41:58 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-7006d042-5b35-4912-93be-d0dbdb99a3a2 tempest-VolumesCloneTest-286201423 None] Lock "cinder-quobyte-6db60796-7fd9-4bf8-9026-b683ee7d547b" acquired by "delete_volume" :: waited 0.025s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:41:58 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d66c51-0410-4896-a8ad-c9a0d659d825]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:41:58 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-7006d042-5b35-4912-93be-d0dbdb99a3a2 tempest-VolumesCloneTest-286201423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6db60796-7fd9-4bf8-9026-b683ee7d547b {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:41:58 devstack sudo[97743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6db60796-7fd9-4bf8-9026-b683ee7d547b Sep 23 14:41:58 devstack sudo[97743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:41:59 devstack sudo[97743]: pam_unix(sudo:session): session closed for user root Sep 23 14:41:59 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-7006d042-5b35-4912-93be-d0dbdb99a3a2 tempest-VolumesCloneTest-286201423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6db60796-7fd9-4bf8-9026-b683ee7d547b" returned: 0 in 0.442s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:41:59 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-7006d042-5b35-4912-93be-d0dbdb99a3a2 tempest-VolumesCloneTest-286201423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6db60796-7fd9-4bf8-9026-b683ee7d547b {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:41:59 devstack sudo[97748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6db60796-7fd9-4bf8-9026-b683ee7d547b Sep 23 14:41:59 devstack sudo[97748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:41:59 devstack sudo[97748]: pam_unix(sudo:session): session closed for user root Sep 23 14:41:59 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-7006d042-5b35-4912-93be-d0dbdb99a3a2 tempest-VolumesCloneTest-286201423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6db60796-7fd9-4bf8-9026-b683ee7d547b" returned: 0 in 0.269s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:41:59 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-7006d042-5b35-4912-93be-d0dbdb99a3a2 tempest-VolumesCloneTest-286201423 None] Lock "cinder-quobyte-6db60796-7fd9-4bf8-9026-b683ee7d547b" released by "delete_volume" :: held 0.822s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:41:59 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-7006d042-5b35-4912-93be-d0dbdb99a3a2 tempest-VolumesCloneTest-286201423 None] Created reservations ['752f71bb-f852-462f-bea1-b2e3c38a71d0', 'c28a9d40-4792-45c0-98a4-28e8bedd1822', '8133d993-4932-4943-a1b1-da48d605dda6', '22274b31-96eb-424c-af1e-aadea6b7abf8'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:41:59 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-7006d042-5b35-4912-93be-d0dbdb99a3a2 tempest-VolumesCloneTest-286201423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:41:59 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-7006d042-5b35-4912-93be-d0dbdb99a3a2 tempest-VolumesCloneTest-286201423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:41:59 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-7006d042-5b35-4912-93be-d0dbdb99a3a2 tempest-VolumesCloneTest-286201423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:41:59 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-7006d042-5b35-4912-93be-d0dbdb99a3a2 tempest-VolumesCloneTest-286201423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:41:59 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-7006d042-5b35-4912-93be-d0dbdb99a3a2 tempest-VolumesCloneTest-286201423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:41:59 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-7006d042-5b35-4912-93be-d0dbdb99a3a2 tempest-VolumesCloneTest-286201423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:41:59 devstack sudo[97751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:41:59 devstack sudo[97751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:42:00 devstack sudo[97751]: pam_unix(sudo:session): session closed for user root Sep 23 14:42:00 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-7006d042-5b35-4912-93be-d0dbdb99a3a2 tempest-VolumesCloneTest-286201423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.344s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:42:00 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-7006d042-5b35-4912-93be-d0dbdb99a3a2 tempest-VolumesCloneTest-286201423 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:42:00 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-7006d042-5b35-4912-93be-d0dbdb99a3a2 tempest-VolumesCloneTest-286201423 None] Deleted volume successfully. Sep 23 14:42:00 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-7006d042-5b35-4912-93be-d0dbdb99a3a2 tempest-VolumesCloneTest-286201423 None] Lock "cinder-6db60796-7fd9-4bf8-9026-b683ee7d547b-delete_volume" released by "delete_volume" :: held 1.472s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:42:03 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4024b04-a7d5-4812-b1bc-20bc7de24dd3 tempest-VolumesDeleteCascade-381167990 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:42:03 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-e4024b04-a7d5-4812-b1bc-20bc7de24dd3 tempest-VolumesDeleteCascade-381167990 None] Flow 'volume_create_manager' (dbfb4284-d4df-4249-a0fd-ea78cd16bed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:42:03 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-e4024b04-a7d5-4812-b1bc-20bc7de24dd3 tempest-VolumesDeleteCascade-381167990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49db4c1e-44a3-46f7-8297-8a03a253ce43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:42:03 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-e4024b04-a7d5-4812-b1bc-20bc7de24dd3 tempest-VolumesDeleteCascade-381167990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49db4c1e-44a3-46f7-8297-8a03a253ce43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:42:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-482924547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7173e226-2785-49f7-8999-ba2ba63af730,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7e9344933224837864266db979e09dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:42:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:42:03Z,use_quota=True,user_id='9cf980bbae57413d81db599d78cdcfc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:42:03 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-e4024b04-a7d5-4812-b1bc-20bc7de24dd3 tempest-VolumesDeleteCascade-381167990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67fbafd4-dbd7-4db6-adbb-66ad5baf20c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:42:03 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-e4024b04-a7d5-4812-b1bc-20bc7de24dd3 tempest-VolumesDeleteCascade-381167990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67fbafd4-dbd7-4db6-adbb-66ad5baf20c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:42:03 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-e4024b04-a7d5-4812-b1bc-20bc7de24dd3 tempest-VolumesDeleteCascade-381167990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b4e50d7-2aff-4c5d-98f2-64284023a292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:42:03 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-e4024b04-a7d5-4812-b1bc-20bc7de24dd3 tempest-VolumesDeleteCascade-381167990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b4e50d7-2aff-4c5d-98f2-64284023a292) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7173e226-2785-49f7-8999-ba2ba63af730', 'volume_name': 'volume-7173e226-2785-49f7-8999-ba2ba63af730', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:42:03 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-e4024b04-a7d5-4812-b1bc-20bc7de24dd3 tempest-VolumesDeleteCascade-381167990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1356c7bc-5744-4c45-a841-bb10a7566a4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:42:03 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-e4024b04-a7d5-4812-b1bc-20bc7de24dd3 tempest-VolumesDeleteCascade-381167990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1356c7bc-5744-4c45-a841-bb10a7566a4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:42:03 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-e4024b04-a7d5-4812-b1bc-20bc7de24dd3 tempest-VolumesDeleteCascade-381167990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7eb30a36-2cde-4106-b7ca-d189a0507453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:42:03 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-e4024b04-a7d5-4812-b1bc-20bc7de24dd3 tempest-VolumesDeleteCascade-381167990 None] Volume 7173e226-2785-49f7-8999-ba2ba63af730: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7173e226-2785-49f7-8999-ba2ba63af730', 'volume_size': 1} Sep 23 14:42:03 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-e4024b04-a7d5-4812-b1bc-20bc7de24dd3 tempest-VolumesDeleteCascade-381167990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:42:03 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-e4024b04-a7d5-4812-b1bc-20bc7de24dd3 tempest-VolumesDeleteCascade-381167990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:42:03 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-e4024b04-a7d5-4812-b1bc-20bc7de24dd3 tempest-VolumesDeleteCascade-381167990 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:42:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-482924547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7173e226-2785-49f7-8999-ba2ba63af730,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7e9344933224837864266db979e09dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:42:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:42:03Z,use_quota=True,user_id='9cf980bbae57413d81db599d78cdcfc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:42:03 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-e4024b04-a7d5-4812-b1bc-20bc7de24dd3 tempest-VolumesDeleteCascade-381167990 None] Creating volume 7173e226-2785-49f7-8999-ba2ba63af730 {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:42:03 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-e4024b04-a7d5-4812-b1bc-20bc7de24dd3 tempest-VolumesDeleteCascade-381167990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:42:03 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-e4024b04-a7d5-4812-b1bc-20bc7de24dd3 tempest-VolumesDeleteCascade-381167990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:42:03 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-e4024b04-a7d5-4812-b1bc-20bc7de24dd3 tempest-VolumesDeleteCascade-381167990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:42:03 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-e4024b04-a7d5-4812-b1bc-20bc7de24dd3 tempest-VolumesDeleteCascade-381167990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:42:03 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-e4024b04-a7d5-4812-b1bc-20bc7de24dd3 tempest-VolumesDeleteCascade-381167990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:42:03 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-e4024b04-a7d5-4812-b1bc-20bc7de24dd3 tempest-VolumesDeleteCascade-381167990 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:42:03 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-e4024b04-a7d5-4812-b1bc-20bc7de24dd3 tempest-VolumesDeleteCascade-381167990 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:42:03 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-e4024b04-a7d5-4812-b1bc-20bc7de24dd3 tempest-VolumesDeleteCascade-381167990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7173e226-2785-49f7-8999-ba2ba63af730 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:42:03 devstack sudo[97758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7173e226-2785-49f7-8999-ba2ba63af730 1073741824 Sep 23 14:42:03 devstack sudo[97758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:42:04 devstack sudo[97758]: pam_unix(sudo:session): session closed for user root Sep 23 14:42:04 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-e4024b04-a7d5-4812-b1bc-20bc7de24dd3 tempest-VolumesDeleteCascade-381167990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7173e226-2785-49f7-8999-ba2ba63af730 1073741824" returned: 0 in 0.748s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:42:04 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-e4024b04-a7d5-4812-b1bc-20bc7de24dd3 tempest-VolumesDeleteCascade-381167990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7173e226-2785-49f7-8999-ba2ba63af730 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:42:04 devstack sudo[97768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7173e226-2785-49f7-8999-ba2ba63af730 Sep 23 14:42:04 devstack sudo[97768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:42:05 devstack sudo[97768]: pam_unix(sudo:session): session closed for user root Sep 23 14:42:05 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-e4024b04-a7d5-4812-b1bc-20bc7de24dd3 tempest-VolumesDeleteCascade-381167990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7173e226-2785-49f7-8999-ba2ba63af730" returned: 0 in 0.549s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:42:05 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-e4024b04-a7d5-4812-b1bc-20bc7de24dd3 tempest-VolumesDeleteCascade-381167990 None] <== create_volume: return (1388ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:42:05 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-e4024b04-a7d5-4812-b1bc-20bc7de24dd3 tempest-VolumesDeleteCascade-381167990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.393s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:42:05 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-e4024b04-a7d5-4812-b1bc-20bc7de24dd3 tempest-VolumesDeleteCascade-381167990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7eb30a36-2cde-4106-b7ca-d189a0507453) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7173e226-2785-49f7-8999-ba2ba63af730', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:42:05 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-e4024b04-a7d5-4812-b1bc-20bc7de24dd3 tempest-VolumesDeleteCascade-381167990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5aafc931-987b-4fba-972c-4e2b62032f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:42:05 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-e4024b04-a7d5-4812-b1bc-20bc7de24dd3 tempest-VolumesDeleteCascade-381167990 None] Volume volume-7173e226-2785-49f7-8999-ba2ba63af730 (7173e226-2785-49f7-8999-ba2ba63af730): created successfully Sep 23 14:42:05 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-e4024b04-a7d5-4812-b1bc-20bc7de24dd3 tempest-VolumesDeleteCascade-381167990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5aafc931-987b-4fba-972c-4e2b62032f7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:42:05 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-e4024b04-a7d5-4812-b1bc-20bc7de24dd3 tempest-VolumesDeleteCascade-381167990 None] Flow 'volume_create_manager' (dbfb4284-d4df-4249-a0fd-ea78cd16bed2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:42:05 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-e4024b04-a7d5-4812-b1bc-20bc7de24dd3 tempest-VolumesDeleteCascade-381167990 None] Created volume successfully. Sep 23 14:42:05 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-bd0b784d-cbaf-4c5c-864a-a8e655da58a6 tempest-VolumesDeleteCascade-381167990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:42:05 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-bd0b784d-cbaf-4c5c-864a-a8e655da58a6 tempest-VolumesDeleteCascade-381167990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:42:05 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-bd0b784d-cbaf-4c5c-864a-a8e655da58a6 tempest-VolumesDeleteCascade-381167990 None] Creating offline snapshot 06fd71a8-7590-4ed5-99f1-e8721e62ae68 of volume 7173e226-2785-49f7-8999-ba2ba63af730 {{(pid=86310) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 14:42:05 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[27eb7cbe-b4c9-4549-8d83-6257bdd204d0]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:42:05 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-bd0b784d-cbaf-4c5c-864a-a8e655da58a6 tempest-VolumesDeleteCascade-381167990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7173e226-2785-49f7-8999-ba2ba63af730 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:42:06 devstack sudo[97783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7173e226-2785-49f7-8999-ba2ba63af730 Sep 23 14:42:06 devstack sudo[97783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:42:06 devstack sudo[97783]: pam_unix(sudo:session): session closed for user root Sep 23 14:42:06 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-bd0b784d-cbaf-4c5c-864a-a8e655da58a6 tempest-VolumesDeleteCascade-381167990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7173e226-2785-49f7-8999-ba2ba63af730" returned: 0 in 0.458s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:42:06 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-bd0b784d-cbaf-4c5c-864a-a8e655da58a6 tempest-VolumesDeleteCascade-381167990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7173e226-2785-49f7-8999-ba2ba63af730,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7173e226-2785-49f7-8999-ba2ba63af730.06fd71a8-7590-4ed5-99f1-e8721e62ae68 1G {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:42:06 devstack sudo[97788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7173e226-2785-49f7-8999-ba2ba63af730,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7173e226-2785-49f7-8999-ba2ba63af730.06fd71a8-7590-4ed5-99f1-e8721e62ae68 1G Sep 23 14:42:06 devstack sudo[97788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:42:06 devstack sudo[97788]: pam_unix(sudo:session): session closed for user root Sep 23 14:42:06 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-bd0b784d-cbaf-4c5c-864a-a8e655da58a6 tempest-VolumesDeleteCascade-381167990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7173e226-2785-49f7-8999-ba2ba63af730,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7173e226-2785-49f7-8999-ba2ba63af730.06fd71a8-7590-4ed5-99f1-e8721e62ae68 1G" returned: 0 in 0.525s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:42:06 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-bd0b784d-cbaf-4c5c-864a-a8e655da58a6 tempest-VolumesDeleteCascade-381167990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7173e226-2785-49f7-8999-ba2ba63af730 -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7173e226-2785-49f7-8999-ba2ba63af730.06fd71a8-7590-4ed5-99f1-e8721e62ae68 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:42:07 devstack sudo[97794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7173e226-2785-49f7-8999-ba2ba63af730 -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7173e226-2785-49f7-8999-ba2ba63af730.06fd71a8-7590-4ed5-99f1-e8721e62ae68 Sep 23 14:42:07 devstack sudo[97794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:42:07 devstack sudo[97794]: pam_unix(sudo:session): session closed for user root Sep 23 14:42:07 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-bd0b784d-cbaf-4c5c-864a-a8e655da58a6 tempest-VolumesDeleteCascade-381167990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7173e226-2785-49f7-8999-ba2ba63af730 -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7173e226-2785-49f7-8999-ba2ba63af730.06fd71a8-7590-4ed5-99f1-e8721e62ae68" returned: 0 in 0.405s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:42:07 devstack cinder-volume[86310]: WARNING cinder.volume.drivers.remotefs [None req-bd0b784d-cbaf-4c5c-864a-a8e655da58a6 tempest-VolumesDeleteCascade-381167990 None] /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7173e226-2785-49f7-8999-ba2ba63af730.06fd71a8-7590-4ed5-99f1-e8721e62ae68 is being set with open permissions: ugo+rw Sep 23 14:42:07 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-bd0b784d-cbaf-4c5c-864a-a8e655da58a6 tempest-VolumesDeleteCascade-381167990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7173e226-2785-49f7-8999-ba2ba63af730.06fd71a8-7590-4ed5-99f1-e8721e62ae68 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:42:07 devstack sudo[97800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7173e226-2785-49f7-8999-ba2ba63af730.06fd71a8-7590-4ed5-99f1-e8721e62ae68 Sep 23 14:42:07 devstack sudo[97800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:42:07 devstack sudo[97800]: pam_unix(sudo:session): session closed for user root Sep 23 14:42:07 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-bd0b784d-cbaf-4c5c-864a-a8e655da58a6 tempest-VolumesDeleteCascade-381167990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7173e226-2785-49f7-8999-ba2ba63af730.06fd71a8-7590-4ed5-99f1-e8721e62ae68" returned: 0 in 0.298s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:42:07 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-bd0b784d-cbaf-4c5c-864a-a8e655da58a6 tempest-VolumesDeleteCascade-381167990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7173e226-2785-49f7-8999-ba2ba63af730.info {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:42:07 devstack sudo[97804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7173e226-2785-49f7-8999-ba2ba63af730.info Sep 23 14:42:07 devstack sudo[97804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:42:08 devstack sudo[97804]: pam_unix(sudo:session): session closed for user root Sep 23 14:42:08 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-bd0b784d-cbaf-4c5c-864a-a8e655da58a6 tempest-VolumesDeleteCascade-381167990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7173e226-2785-49f7-8999-ba2ba63af730.info" returned: 0 in 0.350s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:42:08 devstack cinder-volume[86310]: WARNING cinder.volume.drivers.remotefs [None req-bd0b784d-cbaf-4c5c-864a-a8e655da58a6 tempest-VolumesDeleteCascade-381167990 None] /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7173e226-2785-49f7-8999-ba2ba63af730.info is being set with open permissions: ugo+rw Sep 23 14:42:08 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-bd0b784d-cbaf-4c5c-864a-a8e655da58a6 tempest-VolumesDeleteCascade-381167990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7173e226-2785-49f7-8999-ba2ba63af730.info {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:42:08 devstack sudo[97807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7173e226-2785-49f7-8999-ba2ba63af730.info Sep 23 14:42:08 devstack sudo[97807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:42:08 devstack sudo[97807]: pam_unix(sudo:session): session closed for user root Sep 23 14:42:08 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-bd0b784d-cbaf-4c5c-864a-a8e655da58a6 tempest-VolumesDeleteCascade-381167990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7173e226-2785-49f7-8999-ba2ba63af730.info" returned: 0 in 0.341s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:42:08 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-bd0b784d-cbaf-4c5c-864a-a8e655da58a6 tempest-VolumesDeleteCascade-381167990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.525s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:42:08 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-bd0b784d-cbaf-4c5c-864a-a8e655da58a6 tempest-VolumesDeleteCascade-381167990 None] Create snapshot completed successfully Sep 23 14:42:09 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-37638775-552a-44a8-8ea9-258dd5f615da tempest-VolumesDeleteCascade-381167990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:42:09 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-37638775-552a-44a8-8ea9-258dd5f615da tempest-VolumesDeleteCascade-381167990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:42:09 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-37638775-552a-44a8-8ea9-258dd5f615da tempest-VolumesDeleteCascade-381167990 None] Creating offline snapshot d1702fb9-8981-47fc-ba85-5b7f47250e10 of volume 7173e226-2785-49f7-8999-ba2ba63af730 {{(pid=86310) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 14:42:09 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[47630412-ce6e-4b8f-a779-9b17920bcb1d]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:42:09 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-37638775-552a-44a8-8ea9-258dd5f615da tempest-VolumesDeleteCascade-381167990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7173e226-2785-49f7-8999-ba2ba63af730.06fd71a8-7590-4ed5-99f1-e8721e62ae68 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:42:09 devstack sudo[97813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7173e226-2785-49f7-8999-ba2ba63af730.06fd71a8-7590-4ed5-99f1-e8721e62ae68 Sep 23 14:42:09 devstack sudo[97813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:42:10 devstack sudo[97813]: pam_unix(sudo:session): session closed for user root Sep 23 14:42:10 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-37638775-552a-44a8-8ea9-258dd5f615da tempest-VolumesDeleteCascade-381167990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7173e226-2785-49f7-8999-ba2ba63af730.06fd71a8-7590-4ed5-99f1-e8721e62ae68" returned: 0 in 0.674s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:42:10 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-37638775-552a-44a8-8ea9-258dd5f615da tempest-VolumesDeleteCascade-381167990 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7173e226-2785-49f7-8999-ba2ba63af730(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 14:42:10 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-37638775-552a-44a8-8ea9-258dd5f615da tempest-VolumesDeleteCascade-381167990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7173e226-2785-49f7-8999-ba2ba63af730.06fd71a8-7590-4ed5-99f1-e8721e62ae68,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7173e226-2785-49f7-8999-ba2ba63af730.d1702fb9-8981-47fc-ba85-5b7f47250e10 1G {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:42:10 devstack sudo[97854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7173e226-2785-49f7-8999-ba2ba63af730.06fd71a8-7590-4ed5-99f1-e8721e62ae68,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7173e226-2785-49f7-8999-ba2ba63af730.d1702fb9-8981-47fc-ba85-5b7f47250e10 1G Sep 23 14:42:10 devstack sudo[97854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:42:10 devstack sudo[97854]: pam_unix(sudo:session): session closed for user root Sep 23 14:42:10 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-37638775-552a-44a8-8ea9-258dd5f615da tempest-VolumesDeleteCascade-381167990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7173e226-2785-49f7-8999-ba2ba63af730.06fd71a8-7590-4ed5-99f1-e8721e62ae68,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7173e226-2785-49f7-8999-ba2ba63af730.d1702fb9-8981-47fc-ba85-5b7f47250e10 1G" returned: 0 in 0.918s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:42:10 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-37638775-552a-44a8-8ea9-258dd5f615da tempest-VolumesDeleteCascade-381167990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7173e226-2785-49f7-8999-ba2ba63af730.06fd71a8-7590-4ed5-99f1-e8721e62ae68 -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7173e226-2785-49f7-8999-ba2ba63af730.d1702fb9-8981-47fc-ba85-5b7f47250e10 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:42:11 devstack sudo[97895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7173e226-2785-49f7-8999-ba2ba63af730.06fd71a8-7590-4ed5-99f1-e8721e62ae68 -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7173e226-2785-49f7-8999-ba2ba63af730.d1702fb9-8981-47fc-ba85-5b7f47250e10 Sep 23 14:42:11 devstack sudo[97895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:42:11 devstack sudo[97895]: pam_unix(sudo:session): session closed for user root Sep 23 14:42:11 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-37638775-552a-44a8-8ea9-258dd5f615da tempest-VolumesDeleteCascade-381167990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7173e226-2785-49f7-8999-ba2ba63af730.06fd71a8-7590-4ed5-99f1-e8721e62ae68 -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7173e226-2785-49f7-8999-ba2ba63af730.d1702fb9-8981-47fc-ba85-5b7f47250e10" returned: 0 in 0.504s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:42:11 devstack cinder-volume[86310]: WARNING cinder.volume.drivers.remotefs [None req-37638775-552a-44a8-8ea9-258dd5f615da tempest-VolumesDeleteCascade-381167990 None] /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7173e226-2785-49f7-8999-ba2ba63af730.d1702fb9-8981-47fc-ba85-5b7f47250e10 is being set with open permissions: ugo+rw Sep 23 14:42:11 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-37638775-552a-44a8-8ea9-258dd5f615da tempest-VolumesDeleteCascade-381167990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7173e226-2785-49f7-8999-ba2ba63af730.d1702fb9-8981-47fc-ba85-5b7f47250e10 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:42:11 devstack sudo[97902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7173e226-2785-49f7-8999-ba2ba63af730.d1702fb9-8981-47fc-ba85-5b7f47250e10 Sep 23 14:42:11 devstack sudo[97902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:42:11 devstack sudo[97902]: pam_unix(sudo:session): session closed for user root Sep 23 14:42:11 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-37638775-552a-44a8-8ea9-258dd5f615da tempest-VolumesDeleteCascade-381167990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7173e226-2785-49f7-8999-ba2ba63af730.d1702fb9-8981-47fc-ba85-5b7f47250e10" returned: 0 in 0.330s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:42:11 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-37638775-552a-44a8-8ea9-258dd5f615da tempest-VolumesDeleteCascade-381167990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.568s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:42:11 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-37638775-552a-44a8-8ea9-258dd5f615da tempest-VolumesDeleteCascade-381167990 None] Create snapshot completed successfully Sep 23 14:42:12 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-858d5c4d-bfa6-4156-92af-a5eb75a5523b tempest-VolumesDeleteCascade-381167990 None] Acquiring lock "cinder-7173e226-2785-49f7-8999-ba2ba63af730-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:42:12 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-858d5c4d-bfa6-4156-92af-a5eb75a5523b tempest-VolumesDeleteCascade-381167990 None] Lock "cinder-7173e226-2785-49f7-8999-ba2ba63af730-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:42:12 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-858d5c4d-bfa6-4156-92af-a5eb75a5523b tempest-VolumesDeleteCascade-381167990 None] Performing cascade delete. {{(pid=86310) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 23 14:42:12 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-858d5c4d-bfa6-4156-92af-a5eb75a5523b tempest-VolumesDeleteCascade-381167990 None] Acquiring lock "cinder-06fd71a8-7590-4ed5-99f1-e8721e62ae68-delete_snapshot" by "delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:42:12 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-858d5c4d-bfa6-4156-92af-a5eb75a5523b tempest-VolumesDeleteCascade-381167990 None] Lock "cinder-06fd71a8-7590-4ed5-99f1-e8721e62ae68-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:42:12 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-858d5c4d-bfa6-4156-92af-a5eb75a5523b tempest-VolumesDeleteCascade-381167990 None] Acquiring lock "cinder-quobyte-7173e226-2785-49f7-8999-ba2ba63af730" by "delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:42:12 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-858d5c4d-bfa6-4156-92af-a5eb75a5523b tempest-VolumesDeleteCascade-381167990 None] Lock "cinder-quobyte-7173e226-2785-49f7-8999-ba2ba63af730" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:42:12 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-858d5c4d-bfa6-4156-92af-a5eb75a5523b tempest-VolumesDeleteCascade-381167990 None] Acquiring lock "cinder-quobyte-06fd71a8-7590-4ed5-99f1-e8721e62ae68" by "_delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:42:12 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-858d5c4d-bfa6-4156-92af-a5eb75a5523b tempest-VolumesDeleteCascade-381167990 None] Lock "cinder-quobyte-06fd71a8-7590-4ed5-99f1-e8721e62ae68" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:42:13 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-858d5c4d-bfa6-4156-92af-a5eb75a5523b tempest-VolumesDeleteCascade-381167990 None] Deleting offline snapshot 06fd71a8-7590-4ed5-99f1-e8721e62ae68 of volume 7173e226-2785-49f7-8999-ba2ba63af730 {{(pid=86310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 14:42:13 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-858d5c4d-bfa6-4156-92af-a5eb75a5523b tempest-VolumesDeleteCascade-381167990 None] snapshot_file for this snap is: volume-7173e226-2785-49f7-8999-ba2ba63af730.06fd71a8-7590-4ed5-99f1-e8721e62ae68 {{(pid=86310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 14:42:13 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed52dd96-886c-493b-94f4-f72ea3e1ea46]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:42:13 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-858d5c4d-bfa6-4156-92af-a5eb75a5523b tempest-VolumesDeleteCascade-381167990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7173e226-2785-49f7-8999-ba2ba63af730.06fd71a8-7590-4ed5-99f1-e8721e62ae68 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:42:13 devstack sudo[97909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7173e226-2785-49f7-8999-ba2ba63af730.06fd71a8-7590-4ed5-99f1-e8721e62ae68 Sep 23 14:42:13 devstack sudo[97909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:42:13 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-8139b27f-421c-473a-8f40-f5772988c060 tempest-VolumesListTestJSON-550088439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:42:13 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-8139b27f-421c-473a-8f40-f5772988c060 tempest-VolumesListTestJSON-550088439 None] Flow 'volume_create_manager' (f1d1b865-dad4-45aa-a3c2-2043b262f191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:42:13 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-8139b27f-421c-473a-8f40-f5772988c060 tempest-VolumesListTestJSON-550088439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c704604-afe0-4f75-9a98-949f276a66da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:42:13 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-8139b27f-421c-473a-8f40-f5772988c060 tempest-VolumesListTestJSON-550088439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c704604-afe0-4f75-9a98-949f276a66da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:42:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-669400520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=570df365-6831-4fc0-a378-1eb8ed6f78dd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a41aafd06a574fffba8ae480c86e5beb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:42:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:42:13Z,use_quota=True,user_id='a8bae2ba4fe0481a92ba01b71dffe0c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:42:13 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-8139b27f-421c-473a-8f40-f5772988c060 tempest-VolumesListTestJSON-550088439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0da6d13e-48b5-45a6-9d62-3bfe925dc5d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:42:13 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-8139b27f-421c-473a-8f40-f5772988c060 tempest-VolumesListTestJSON-550088439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0da6d13e-48b5-45a6-9d62-3bfe925dc5d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:42:13 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-8139b27f-421c-473a-8f40-f5772988c060 tempest-VolumesListTestJSON-550088439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39c1d0e9-c88f-4590-9659-09ff39fcc8ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:42:13 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-8139b27f-421c-473a-8f40-f5772988c060 tempest-VolumesListTestJSON-550088439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39c1d0e9-c88f-4590-9659-09ff39fcc8ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '570df365-6831-4fc0-a378-1eb8ed6f78dd', 'volume_name': 'volume-570df365-6831-4fc0-a378-1eb8ed6f78dd', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:42:13 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-8139b27f-421c-473a-8f40-f5772988c060 tempest-VolumesListTestJSON-550088439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45697156-e7dc-4d96-9f50-970dd7a3e10c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:42:13 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-8139b27f-421c-473a-8f40-f5772988c060 tempest-VolumesListTestJSON-550088439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45697156-e7dc-4d96-9f50-970dd7a3e10c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:42:13 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-8139b27f-421c-473a-8f40-f5772988c060 tempest-VolumesListTestJSON-550088439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69edd029-ed80-4c32-8755-2dde717398bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:42:13 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-8139b27f-421c-473a-8f40-f5772988c060 tempest-VolumesListTestJSON-550088439 None] Volume 570df365-6831-4fc0-a378-1eb8ed6f78dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-570df365-6831-4fc0-a378-1eb8ed6f78dd', 'volume_size': 1} Sep 23 14:42:13 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-8139b27f-421c-473a-8f40-f5772988c060 tempest-VolumesListTestJSON-550088439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:42:13 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-8139b27f-421c-473a-8f40-f5772988c060 tempest-VolumesListTestJSON-550088439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:42:13 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-8139b27f-421c-473a-8f40-f5772988c060 tempest-VolumesListTestJSON-550088439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:42:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-669400520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=570df365-6831-4fc0-a378-1eb8ed6f78dd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a41aafd06a574fffba8ae480c86e5beb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:42:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:42:13Z,use_quota=True,user_id='a8bae2ba4fe0481a92ba01b71dffe0c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:42:13 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-8139b27f-421c-473a-8f40-f5772988c060 tempest-VolumesListTestJSON-550088439 None] Creating volume 570df365-6831-4fc0-a378-1eb8ed6f78dd {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:42:13 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-8139b27f-421c-473a-8f40-f5772988c060 tempest-VolumesListTestJSON-550088439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:42:13 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-8139b27f-421c-473a-8f40-f5772988c060 tempest-VolumesListTestJSON-550088439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:42:13 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-8139b27f-421c-473a-8f40-f5772988c060 tempest-VolumesListTestJSON-550088439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:42:13 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-8139b27f-421c-473a-8f40-f5772988c060 tempest-VolumesListTestJSON-550088439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:42:13 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-8139b27f-421c-473a-8f40-f5772988c060 tempest-VolumesListTestJSON-550088439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:42:13 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-8139b27f-421c-473a-8f40-f5772988c060 tempest-VolumesListTestJSON-550088439 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:42:13 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-8139b27f-421c-473a-8f40-f5772988c060 tempest-VolumesListTestJSON-550088439 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:42:13 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8139b27f-421c-473a-8f40-f5772988c060 tempest-VolumesListTestJSON-550088439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-570df365-6831-4fc0-a378-1eb8ed6f78dd 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:42:13 devstack sudo[97911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-570df365-6831-4fc0-a378-1eb8ed6f78dd 1073741824 Sep 23 14:42:13 devstack sudo[97911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:42:13 devstack sudo[97909]: pam_unix(sudo:session): session closed for user root Sep 23 14:42:13 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-858d5c4d-bfa6-4156-92af-a5eb75a5523b tempest-VolumesDeleteCascade-381167990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7173e226-2785-49f7-8999-ba2ba63af730.06fd71a8-7590-4ed5-99f1-e8721e62ae68" returned: 0 in 0.694s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:42:13 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-858d5c4d-bfa6-4156-92af-a5eb75a5523b tempest-VolumesDeleteCascade-381167990 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7173e226-2785-49f7-8999-ba2ba63af730(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 14:42:13 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bebc819-59fe-4f26-b6f5-44bc5f6b096d]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:42:13 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-858d5c4d-bfa6-4156-92af-a5eb75a5523b tempest-VolumesDeleteCascade-381167990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7173e226-2785-49f7-8999-ba2ba63af730 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:42:14 devstack sudo[97919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7173e226-2785-49f7-8999-ba2ba63af730 Sep 23 14:42:14 devstack sudo[97919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:42:14 devstack sudo[97911]: pam_unix(sudo:session): session closed for user root Sep 23 14:42:14 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8139b27f-421c-473a-8f40-f5772988c060 tempest-VolumesListTestJSON-550088439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-570df365-6831-4fc0-a378-1eb8ed6f78dd 1073741824" returned: 0 in 0.885s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:42:14 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8139b27f-421c-473a-8f40-f5772988c060 tempest-VolumesListTestJSON-550088439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-570df365-6831-4fc0-a378-1eb8ed6f78dd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:42:14 devstack sudo[97923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-570df365-6831-4fc0-a378-1eb8ed6f78dd Sep 23 14:42:14 devstack sudo[97923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:42:14 devstack sudo[97919]: pam_unix(sudo:session): session closed for user root Sep 23 14:42:14 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-858d5c4d-bfa6-4156-92af-a5eb75a5523b tempest-VolumesDeleteCascade-381167990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7173e226-2785-49f7-8999-ba2ba63af730" returned: 0 in 0.854s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:42:14 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1b1fad1-d051-4213-bde5-81b6a279fed6]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:42:14 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-858d5c4d-bfa6-4156-92af-a5eb75a5523b tempest-VolumesDeleteCascade-381167990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7173e226-2785-49f7-8999-ba2ba63af730.d1702fb9-8981-47fc-ba85-5b7f47250e10 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:42:14 devstack sudo[97923]: pam_unix(sudo:session): session closed for user root Sep 23 14:42:14 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8139b27f-421c-473a-8f40-f5772988c060 tempest-VolumesListTestJSON-550088439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-570df365-6831-4fc0-a378-1eb8ed6f78dd" returned: 0 in 0.434s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:42:14 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-8139b27f-421c-473a-8f40-f5772988c060 tempest-VolumesListTestJSON-550088439 None] <== create_volume: return (1479ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:42:14 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-8139b27f-421c-473a-8f40-f5772988c060 tempest-VolumesListTestJSON-550088439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.487s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:42:14 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-8139b27f-421c-473a-8f40-f5772988c060 tempest-VolumesListTestJSON-550088439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69edd029-ed80-4c32-8755-2dde717398bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-570df365-6831-4fc0-a378-1eb8ed6f78dd', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:42:14 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-8139b27f-421c-473a-8f40-f5772988c060 tempest-VolumesListTestJSON-550088439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd2ac04c-b1ea-4df6-bb1a-29b71bbe0ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:42:14 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-8139b27f-421c-473a-8f40-f5772988c060 tempest-VolumesListTestJSON-550088439 None] Volume volume-570df365-6831-4fc0-a378-1eb8ed6f78dd (570df365-6831-4fc0-a378-1eb8ed6f78dd): created successfully Sep 23 14:42:15 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-8139b27f-421c-473a-8f40-f5772988c060 tempest-VolumesListTestJSON-550088439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd2ac04c-b1ea-4df6-bb1a-29b71bbe0ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:42:15 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-8139b27f-421c-473a-8f40-f5772988c060 tempest-VolumesListTestJSON-550088439 None] Flow 'volume_create_manager' (f1d1b865-dad4-45aa-a3c2-2043b262f191) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:42:15 devstack sudo[97928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7173e226-2785-49f7-8999-ba2ba63af730.d1702fb9-8981-47fc-ba85-5b7f47250e10 Sep 23 14:42:15 devstack sudo[97928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:42:15 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-8139b27f-421c-473a-8f40-f5772988c060 tempest-VolumesListTestJSON-550088439 None] Created volume successfully. Sep 23 14:42:15 devstack sudo[97928]: pam_unix(sudo:session): session closed for user root Sep 23 14:42:15 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-858d5c4d-bfa6-4156-92af-a5eb75a5523b tempest-VolumesDeleteCascade-381167990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7173e226-2785-49f7-8999-ba2ba63af730.d1702fb9-8981-47fc-ba85-5b7f47250e10" returned: 0 in 0.612s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:42:15 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-858d5c4d-bfa6-4156-92af-a5eb75a5523b tempest-VolumesDeleteCascade-381167990 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7173e226-2785-49f7-8999-ba2ba63af730(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 14:42:15 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0ef8825-462e-4d39-810f-4d4b062a8054]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:42:15 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-858d5c4d-bfa6-4156-92af-a5eb75a5523b tempest-VolumesDeleteCascade-381167990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7173e226-2785-49f7-8999-ba2ba63af730.06fd71a8-7590-4ed5-99f1-e8721e62ae68 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:42:15 devstack sudo[97935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7173e226-2785-49f7-8999-ba2ba63af730.06fd71a8-7590-4ed5-99f1-e8721e62ae68 Sep 23 14:42:15 devstack sudo[97935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:42:15 devstack sudo[97935]: pam_unix(sudo:session): session closed for user root Sep 23 14:42:15 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-858d5c4d-bfa6-4156-92af-a5eb75a5523b tempest-VolumesDeleteCascade-381167990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7173e226-2785-49f7-8999-ba2ba63af730.06fd71a8-7590-4ed5-99f1-e8721e62ae68" returned: 0 in 0.475s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:42:15 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-858d5c4d-bfa6-4156-92af-a5eb75a5523b tempest-VolumesDeleteCascade-381167990 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7173e226-2785-49f7-8999-ba2ba63af730(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 14:42:15 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[83d0d276-13e4-4093-9bfc-05e997bcffe0]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:42:15 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-858d5c4d-bfa6-4156-92af-a5eb75a5523b tempest-VolumesDeleteCascade-381167990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7173e226-2785-49f7-8999-ba2ba63af730 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:42:16 devstack sudo[97941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7173e226-2785-49f7-8999-ba2ba63af730 Sep 23 14:42:16 devstack sudo[97941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:42:16 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae2698a2-2033-4395-bdd8-4aa2d34d7eac tempest-VolumesListTestJSON-550088439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:42:16 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-ae2698a2-2033-4395-bdd8-4aa2d34d7eac tempest-VolumesListTestJSON-550088439 None] Flow 'volume_create_manager' (0186ee65-b5fa-468f-bced-f975801081ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:42:16 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-ae2698a2-2033-4395-bdd8-4aa2d34d7eac tempest-VolumesListTestJSON-550088439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cc6e0bb-c7ca-4d91-9fcf-9841145131fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:42:16 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-ae2698a2-2033-4395-bdd8-4aa2d34d7eac tempest-VolumesListTestJSON-550088439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cc6e0bb-c7ca-4d91-9fcf-9841145131fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:42:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-625855832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d753288c-4ce4-4f24-bd8f-8ae270f49d96,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a41aafd06a574fffba8ae480c86e5beb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:42:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:42:16Z,use_quota=True,user_id='a8bae2ba4fe0481a92ba01b71dffe0c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:42:16 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-ae2698a2-2033-4395-bdd8-4aa2d34d7eac tempest-VolumesListTestJSON-550088439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (996720f5-4655-4b23-9961-2cb0e850e00b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:42:16 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-ae2698a2-2033-4395-bdd8-4aa2d34d7eac tempest-VolumesListTestJSON-550088439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (996720f5-4655-4b23-9961-2cb0e850e00b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:42:16 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-ae2698a2-2033-4395-bdd8-4aa2d34d7eac tempest-VolumesListTestJSON-550088439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b05823d6-0004-4b13-981b-ca50be734c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:42:16 devstack sudo[97941]: pam_unix(sudo:session): session closed for user root Sep 23 14:42:16 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-ae2698a2-2033-4395-bdd8-4aa2d34d7eac tempest-VolumesListTestJSON-550088439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b05823d6-0004-4b13-981b-ca50be734c9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd753288c-4ce4-4f24-bd8f-8ae270f49d96', 'volume_name': 'volume-d753288c-4ce4-4f24-bd8f-8ae270f49d96', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:42:16 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-ae2698a2-2033-4395-bdd8-4aa2d34d7eac tempest-VolumesListTestJSON-550088439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (695e8ef8-baa2-480e-bbd8-5db37c4e25bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:42:16 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-ae2698a2-2033-4395-bdd8-4aa2d34d7eac tempest-VolumesListTestJSON-550088439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (695e8ef8-baa2-480e-bbd8-5db37c4e25bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:42:16 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-ae2698a2-2033-4395-bdd8-4aa2d34d7eac tempest-VolumesListTestJSON-550088439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25b41fae-94a1-46f5-a37b-47917ecba74a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:42:16 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-ae2698a2-2033-4395-bdd8-4aa2d34d7eac tempest-VolumesListTestJSON-550088439 None] Volume d753288c-4ce4-4f24-bd8f-8ae270f49d96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d753288c-4ce4-4f24-bd8f-8ae270f49d96', 'volume_size': 1} Sep 23 14:42:16 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-ae2698a2-2033-4395-bdd8-4aa2d34d7eac tempest-VolumesListTestJSON-550088439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:42:16 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-ae2698a2-2033-4395-bdd8-4aa2d34d7eac tempest-VolumesListTestJSON-550088439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:42:16 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-ae2698a2-2033-4395-bdd8-4aa2d34d7eac tempest-VolumesListTestJSON-550088439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:42:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-625855832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d753288c-4ce4-4f24-bd8f-8ae270f49d96,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a41aafd06a574fffba8ae480c86e5beb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:42:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:42:16Z,use_quota=True,user_id='a8bae2ba4fe0481a92ba01b71dffe0c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:42:16 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-ae2698a2-2033-4395-bdd8-4aa2d34d7eac tempest-VolumesListTestJSON-550088439 None] Creating volume d753288c-4ce4-4f24-bd8f-8ae270f49d96 {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:42:16 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-ae2698a2-2033-4395-bdd8-4aa2d34d7eac tempest-VolumesListTestJSON-550088439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:42:16 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-ae2698a2-2033-4395-bdd8-4aa2d34d7eac tempest-VolumesListTestJSON-550088439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:42:16 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-ae2698a2-2033-4395-bdd8-4aa2d34d7eac tempest-VolumesListTestJSON-550088439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:42:16 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-ae2698a2-2033-4395-bdd8-4aa2d34d7eac tempest-VolumesListTestJSON-550088439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:42:16 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-ae2698a2-2033-4395-bdd8-4aa2d34d7eac tempest-VolumesListTestJSON-550088439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:42:16 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-ae2698a2-2033-4395-bdd8-4aa2d34d7eac tempest-VolumesListTestJSON-550088439 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:42:16 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-ae2698a2-2033-4395-bdd8-4aa2d34d7eac tempest-VolumesListTestJSON-550088439 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:42:16 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ae2698a2-2033-4395-bdd8-4aa2d34d7eac tempest-VolumesListTestJSON-550088439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d753288c-4ce4-4f24-bd8f-8ae270f49d96 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:42:16 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-858d5c4d-bfa6-4156-92af-a5eb75a5523b tempest-VolumesDeleteCascade-381167990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7173e226-2785-49f7-8999-ba2ba63af730" returned: 0 in 0.699s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:42:16 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-858d5c4d-bfa6-4156-92af-a5eb75a5523b tempest-VolumesDeleteCascade-381167990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7173e226-2785-49f7-8999-ba2ba63af730.06fd71a8-7590-4ed5-99f1-e8721e62ae68 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:42:16 devstack sudo[97946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d753288c-4ce4-4f24-bd8f-8ae270f49d96 1073741824 Sep 23 14:42:16 devstack sudo[97946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:42:16 devstack sudo[97948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7173e226-2785-49f7-8999-ba2ba63af730.06fd71a8-7590-4ed5-99f1-e8721e62ae68 Sep 23 14:42:16 devstack sudo[97948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:42:17 devstack sudo[97948]: pam_unix(sudo:session): session closed for user root Sep 23 14:42:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-858d5c4d-bfa6-4156-92af-a5eb75a5523b tempest-VolumesDeleteCascade-381167990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7173e226-2785-49f7-8999-ba2ba63af730.06fd71a8-7590-4ed5-99f1-e8721e62ae68" returned: 0 in 0.591s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:42:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-858d5c4d-bfa6-4156-92af-a5eb75a5523b tempest-VolumesDeleteCascade-381167990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7173e226-2785-49f7-8999-ba2ba63af730.06fd71a8-7590-4ed5-99f1-e8721e62ae68 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:42:17 devstack sudo[97959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7173e226-2785-49f7-8999-ba2ba63af730.06fd71a8-7590-4ed5-99f1-e8721e62ae68 Sep 23 14:42:17 devstack sudo[97959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:42:17 devstack sudo[97946]: pam_unix(sudo:session): session closed for user root Sep 23 14:42:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ae2698a2-2033-4395-bdd8-4aa2d34d7eac tempest-VolumesListTestJSON-550088439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d753288c-4ce4-4f24-bd8f-8ae270f49d96 1073741824" returned: 0 in 0.800s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:42:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ae2698a2-2033-4395-bdd8-4aa2d34d7eac tempest-VolumesListTestJSON-550088439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d753288c-4ce4-4f24-bd8f-8ae270f49d96 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:42:17 devstack sudo[97961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d753288c-4ce4-4f24-bd8f-8ae270f49d96 Sep 23 14:42:17 devstack sudo[97961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:42:17 devstack sudo[97959]: pam_unix(sudo:session): session closed for user root Sep 23 14:42:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-858d5c4d-bfa6-4156-92af-a5eb75a5523b tempest-VolumesDeleteCascade-381167990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7173e226-2785-49f7-8999-ba2ba63af730.06fd71a8-7590-4ed5-99f1-e8721e62ae68" returned: 0 in 0.480s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:42:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-858d5c4d-bfa6-4156-92af-a5eb75a5523b tempest-VolumesDeleteCascade-381167990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7173e226-2785-49f7-8999-ba2ba63af730 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7173e226-2785-49f7-8999-ba2ba63af730.d1702fb9-8981-47fc-ba85-5b7f47250e10 -F qcow2 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:42:17 devstack sudo[97964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7173e226-2785-49f7-8999-ba2ba63af730 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7173e226-2785-49f7-8999-ba2ba63af730.d1702fb9-8981-47fc-ba85-5b7f47250e10 -F qcow2 Sep 23 14:42:17 devstack sudo[97964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:42:18 devstack sudo[97961]: pam_unix(sudo:session): session closed for user root Sep 23 14:42:18 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ae2698a2-2033-4395-bdd8-4aa2d34d7eac tempest-VolumesListTestJSON-550088439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d753288c-4ce4-4f24-bd8f-8ae270f49d96" returned: 0 in 0.464s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:42:18 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-ae2698a2-2033-4395-bdd8-4aa2d34d7eac tempest-VolumesListTestJSON-550088439 None] <== create_volume: return (1382ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:42:18 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-ae2698a2-2033-4395-bdd8-4aa2d34d7eac tempest-VolumesListTestJSON-550088439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.388s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:42:18 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-ae2698a2-2033-4395-bdd8-4aa2d34d7eac tempest-VolumesListTestJSON-550088439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25b41fae-94a1-46f5-a37b-47917ecba74a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d753288c-4ce4-4f24-bd8f-8ae270f49d96', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:42:18 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-ae2698a2-2033-4395-bdd8-4aa2d34d7eac tempest-VolumesListTestJSON-550088439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c85fc4d4-2cc0-4fa4-b0b7-f334624e0f50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:42:18 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-ae2698a2-2033-4395-bdd8-4aa2d34d7eac tempest-VolumesListTestJSON-550088439 None] Volume volume-d753288c-4ce4-4f24-bd8f-8ae270f49d96 (d753288c-4ce4-4f24-bd8f-8ae270f49d96): created successfully Sep 23 14:42:18 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-ae2698a2-2033-4395-bdd8-4aa2d34d7eac tempest-VolumesListTestJSON-550088439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c85fc4d4-2cc0-4fa4-b0b7-f334624e0f50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:42:18 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-ae2698a2-2033-4395-bdd8-4aa2d34d7eac tempest-VolumesListTestJSON-550088439 None] Flow 'volume_create_manager' (0186ee65-b5fa-468f-bced-f975801081ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:42:18 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-ae2698a2-2033-4395-bdd8-4aa2d34d7eac tempest-VolumesListTestJSON-550088439 None] Created volume successfully. Sep 23 14:42:18 devstack sudo[97964]: pam_unix(sudo:session): session closed for user root Sep 23 14:42:18 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-858d5c4d-bfa6-4156-92af-a5eb75a5523b tempest-VolumesDeleteCascade-381167990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7173e226-2785-49f7-8999-ba2ba63af730 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7173e226-2785-49f7-8999-ba2ba63af730.d1702fb9-8981-47fc-ba85-5b7f47250e10 -F qcow2" returned: 0 in 0.564s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:42:18 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-858d5c4d-bfa6-4156-92af-a5eb75a5523b tempest-VolumesDeleteCascade-381167990 None] Lock "cinder-quobyte-06fd71a8-7590-4ed5-99f1-e8721e62ae68" released by "_delete_snapshot" :: held 5.382s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:42:18 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-858d5c4d-bfa6-4156-92af-a5eb75a5523b tempest-VolumesDeleteCascade-381167990 None] Lock "cinder-quobyte-7173e226-2785-49f7-8999-ba2ba63af730" released by "delete_snapshot" :: held 5.433s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:42:18 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-858d5c4d-bfa6-4156-92af-a5eb75a5523b tempest-VolumesDeleteCascade-381167990 None] Created reservations ['c3647592-fc48-4bbe-945f-181d4560c7ff', 'ea0da8ef-7396-4e1d-bfe7-9602e16cfd57', '8f46de55-e59f-47c9-b126-e268f782a276', '6ff5a2c5-736a-420b-8468-bc54b13368ec'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:42:18 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-858d5c4d-bfa6-4156-92af-a5eb75a5523b tempest-VolumesDeleteCascade-381167990 None] Delete snapshot completed successfully. Sep 23 14:42:18 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-858d5c4d-bfa6-4156-92af-a5eb75a5523b tempest-VolumesDeleteCascade-381167990 None] Lock "cinder-06fd71a8-7590-4ed5-99f1-e8721e62ae68-delete_snapshot" released by "delete_snapshot" :: held 5.842s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:42:18 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-858d5c4d-bfa6-4156-92af-a5eb75a5523b tempest-VolumesDeleteCascade-381167990 None] Acquiring lock "cinder-d1702fb9-8981-47fc-ba85-5b7f47250e10-delete_snapshot" by "delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:42:18 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-858d5c4d-bfa6-4156-92af-a5eb75a5523b tempest-VolumesDeleteCascade-381167990 None] Lock "cinder-d1702fb9-8981-47fc-ba85-5b7f47250e10-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:42:18 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-858d5c4d-bfa6-4156-92af-a5eb75a5523b tempest-VolumesDeleteCascade-381167990 None] Acquiring lock "cinder-quobyte-7173e226-2785-49f7-8999-ba2ba63af730" by "delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:42:18 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-858d5c4d-bfa6-4156-92af-a5eb75a5523b tempest-VolumesDeleteCascade-381167990 None] Lock "cinder-quobyte-7173e226-2785-49f7-8999-ba2ba63af730" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:42:18 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-858d5c4d-bfa6-4156-92af-a5eb75a5523b tempest-VolumesDeleteCascade-381167990 None] Acquiring lock "cinder-quobyte-d1702fb9-8981-47fc-ba85-5b7f47250e10" by "_delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:42:18 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-858d5c4d-bfa6-4156-92af-a5eb75a5523b tempest-VolumesDeleteCascade-381167990 None] Lock "cinder-quobyte-d1702fb9-8981-47fc-ba85-5b7f47250e10" acquired by "_delete_snapshot" :: waited 0.045s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:42:18 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-858d5c4d-bfa6-4156-92af-a5eb75a5523b tempest-VolumesDeleteCascade-381167990 None] Deleting offline snapshot d1702fb9-8981-47fc-ba85-5b7f47250e10 of volume 7173e226-2785-49f7-8999-ba2ba63af730 {{(pid=86310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 14:42:18 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-858d5c4d-bfa6-4156-92af-a5eb75a5523b tempest-VolumesDeleteCascade-381167990 None] snapshot_file for this snap is: volume-7173e226-2785-49f7-8999-ba2ba63af730.d1702fb9-8981-47fc-ba85-5b7f47250e10 {{(pid=86310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 14:42:19 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[05bffd5c-1957-47e9-9480-e25ae056b28b]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:42:19 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-858d5c4d-bfa6-4156-92af-a5eb75a5523b tempest-VolumesDeleteCascade-381167990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7173e226-2785-49f7-8999-ba2ba63af730.d1702fb9-8981-47fc-ba85-5b7f47250e10 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:42:19 devstack sudo[97973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7173e226-2785-49f7-8999-ba2ba63af730.d1702fb9-8981-47fc-ba85-5b7f47250e10 Sep 23 14:42:19 devstack sudo[97973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:42:19 devstack sudo[97973]: pam_unix(sudo:session): session closed for user root Sep 23 14:42:19 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-858d5c4d-bfa6-4156-92af-a5eb75a5523b tempest-VolumesDeleteCascade-381167990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7173e226-2785-49f7-8999-ba2ba63af730.d1702fb9-8981-47fc-ba85-5b7f47250e10" returned: 0 in 0.688s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:42:19 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-858d5c4d-bfa6-4156-92af-a5eb75a5523b tempest-VolumesDeleteCascade-381167990 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7173e226-2785-49f7-8999-ba2ba63af730(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 14:42:19 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6cf60e8-780a-4bcd-9f69-262ae53fa52c]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:42:19 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-858d5c4d-bfa6-4156-92af-a5eb75a5523b tempest-VolumesDeleteCascade-381167990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7173e226-2785-49f7-8999-ba2ba63af730 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:42:19 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d6f07bf-70f0-4fa8-957b-236bdd40a3af tempest-VolumesListTestJSON-550088439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:42:19 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-5d6f07bf-70f0-4fa8-957b-236bdd40a3af tempest-VolumesListTestJSON-550088439 None] Flow 'volume_create_manager' (b1f55635-8d4a-4287-a2d3-6d220e0c542a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:42:19 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-5d6f07bf-70f0-4fa8-957b-236bdd40a3af tempest-VolumesListTestJSON-550088439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fae8639-82ff-40e1-8ef8-5bb0b49f026c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:42:19 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-5d6f07bf-70f0-4fa8-957b-236bdd40a3af tempest-VolumesListTestJSON-550088439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fae8639-82ff-40e1-8ef8-5bb0b49f026c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:42:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1517402235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d178ef3c-5ddb-4ae9-9a34-15e107f34d8b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a41aafd06a574fffba8ae480c86e5beb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:42:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:42:20Z,use_quota=True,user_id='a8bae2ba4fe0481a92ba01b71dffe0c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:42:19 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-5d6f07bf-70f0-4fa8-957b-236bdd40a3af tempest-VolumesListTestJSON-550088439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80e2bc48-f541-4e97-a297-96d518ca915e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:42:19 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-5d6f07bf-70f0-4fa8-957b-236bdd40a3af tempest-VolumesListTestJSON-550088439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80e2bc48-f541-4e97-a297-96d518ca915e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:42:19 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-5d6f07bf-70f0-4fa8-957b-236bdd40a3af tempest-VolumesListTestJSON-550088439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f57d128a-d6f9-4610-830f-755ac2aea985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:42:19 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-5d6f07bf-70f0-4fa8-957b-236bdd40a3af tempest-VolumesListTestJSON-550088439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f57d128a-d6f9-4610-830f-755ac2aea985) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd178ef3c-5ddb-4ae9-9a34-15e107f34d8b', 'volume_name': 'volume-d178ef3c-5ddb-4ae9-9a34-15e107f34d8b', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:42:19 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-5d6f07bf-70f0-4fa8-957b-236bdd40a3af tempest-VolumesListTestJSON-550088439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b12fb8d-746d-4476-85a7-81c48b6bdcb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:42:19 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-5d6f07bf-70f0-4fa8-957b-236bdd40a3af tempest-VolumesListTestJSON-550088439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b12fb8d-746d-4476-85a7-81c48b6bdcb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:42:20 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-5d6f07bf-70f0-4fa8-957b-236bdd40a3af tempest-VolumesListTestJSON-550088439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f69019a4-9dba-4fee-aa6a-f7c8f5176450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:42:20 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-5d6f07bf-70f0-4fa8-957b-236bdd40a3af tempest-VolumesListTestJSON-550088439 None] Volume d178ef3c-5ddb-4ae9-9a34-15e107f34d8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d178ef3c-5ddb-4ae9-9a34-15e107f34d8b', 'volume_size': 1} Sep 23 14:42:20 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-5d6f07bf-70f0-4fa8-957b-236bdd40a3af tempest-VolumesListTestJSON-550088439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:42:20 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-5d6f07bf-70f0-4fa8-957b-236bdd40a3af tempest-VolumesListTestJSON-550088439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:42:20 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-5d6f07bf-70f0-4fa8-957b-236bdd40a3af tempest-VolumesListTestJSON-550088439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:42:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1517402235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d178ef3c-5ddb-4ae9-9a34-15e107f34d8b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a41aafd06a574fffba8ae480c86e5beb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:42:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:42:20Z,use_quota=True,user_id='a8bae2ba4fe0481a92ba01b71dffe0c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:42:20 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-5d6f07bf-70f0-4fa8-957b-236bdd40a3af tempest-VolumesListTestJSON-550088439 None] Creating volume d178ef3c-5ddb-4ae9-9a34-15e107f34d8b {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:42:20 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-5d6f07bf-70f0-4fa8-957b-236bdd40a3af tempest-VolumesListTestJSON-550088439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:42:20 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-5d6f07bf-70f0-4fa8-957b-236bdd40a3af tempest-VolumesListTestJSON-550088439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:42:20 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-5d6f07bf-70f0-4fa8-957b-236bdd40a3af tempest-VolumesListTestJSON-550088439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:42:20 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-5d6f07bf-70f0-4fa8-957b-236bdd40a3af tempest-VolumesListTestJSON-550088439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:42:20 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-5d6f07bf-70f0-4fa8-957b-236bdd40a3af tempest-VolumesListTestJSON-550088439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:42:20 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-5d6f07bf-70f0-4fa8-957b-236bdd40a3af tempest-VolumesListTestJSON-550088439 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:42:20 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-5d6f07bf-70f0-4fa8-957b-236bdd40a3af tempest-VolumesListTestJSON-550088439 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:42:20 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-5d6f07bf-70f0-4fa8-957b-236bdd40a3af tempest-VolumesListTestJSON-550088439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d178ef3c-5ddb-4ae9-9a34-15e107f34d8b 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:42:20 devstack sudo[97978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7173e226-2785-49f7-8999-ba2ba63af730 Sep 23 14:42:20 devstack sudo[97978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:42:20 devstack sudo[97979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d178ef3c-5ddb-4ae9-9a34-15e107f34d8b 1073741824 Sep 23 14:42:20 devstack sudo[97979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:42:20 devstack sudo[97978]: pam_unix(sudo:session): session closed for user root Sep 23 14:42:20 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-858d5c4d-bfa6-4156-92af-a5eb75a5523b tempest-VolumesDeleteCascade-381167990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7173e226-2785-49f7-8999-ba2ba63af730" returned: 0 in 0.701s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:42:20 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-858d5c4d-bfa6-4156-92af-a5eb75a5523b tempest-VolumesDeleteCascade-381167990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7173e226-2785-49f7-8999-ba2ba63af730.d1702fb9-8981-47fc-ba85-5b7f47250e10 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:42:20 devstack sudo[97989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7173e226-2785-49f7-8999-ba2ba63af730.d1702fb9-8981-47fc-ba85-5b7f47250e10 Sep 23 14:42:20 devstack sudo[97989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:42:20 devstack sudo[97979]: pam_unix(sudo:session): session closed for user root Sep 23 14:42:20 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-5d6f07bf-70f0-4fa8-957b-236bdd40a3af tempest-VolumesListTestJSON-550088439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d178ef3c-5ddb-4ae9-9a34-15e107f34d8b 1073741824" returned: 0 in 0.659s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:42:20 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-5d6f07bf-70f0-4fa8-957b-236bdd40a3af tempest-VolumesListTestJSON-550088439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d178ef3c-5ddb-4ae9-9a34-15e107f34d8b {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:42:20 devstack sudo[97991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d178ef3c-5ddb-4ae9-9a34-15e107f34d8b Sep 23 14:42:20 devstack sudo[97991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:42:21 devstack sudo[97989]: pam_unix(sudo:session): session closed for user root Sep 23 14:42:21 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-858d5c4d-bfa6-4156-92af-a5eb75a5523b tempest-VolumesDeleteCascade-381167990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7173e226-2785-49f7-8999-ba2ba63af730.d1702fb9-8981-47fc-ba85-5b7f47250e10" returned: 0 in 0.707s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:42:21 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-858d5c4d-bfa6-4156-92af-a5eb75a5523b tempest-VolumesDeleteCascade-381167990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7173e226-2785-49f7-8999-ba2ba63af730.d1702fb9-8981-47fc-ba85-5b7f47250e10 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:42:21 devstack sudo[98011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7173e226-2785-49f7-8999-ba2ba63af730.d1702fb9-8981-47fc-ba85-5b7f47250e10 Sep 23 14:42:21 devstack sudo[98011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:42:21 devstack sudo[97991]: pam_unix(sudo:session): session closed for user root Sep 23 14:42:21 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-5d6f07bf-70f0-4fa8-957b-236bdd40a3af tempest-VolumesListTestJSON-550088439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d178ef3c-5ddb-4ae9-9a34-15e107f34d8b" returned: 0 in 0.482s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:42:21 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-5d6f07bf-70f0-4fa8-957b-236bdd40a3af tempest-VolumesListTestJSON-550088439 None] <== create_volume: return (1245ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:42:21 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-5d6f07bf-70f0-4fa8-957b-236bdd40a3af tempest-VolumesListTestJSON-550088439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.255s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:42:21 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-5d6f07bf-70f0-4fa8-957b-236bdd40a3af tempest-VolumesListTestJSON-550088439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f69019a4-9dba-4fee-aa6a-f7c8f5176450) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d178ef3c-5ddb-4ae9-9a34-15e107f34d8b', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:42:21 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-5d6f07bf-70f0-4fa8-957b-236bdd40a3af tempest-VolumesListTestJSON-550088439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (757b5e27-70e1-41ee-abde-dc82b4be34e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:42:21 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-5d6f07bf-70f0-4fa8-957b-236bdd40a3af tempest-VolumesListTestJSON-550088439 None] Volume volume-d178ef3c-5ddb-4ae9-9a34-15e107f34d8b (d178ef3c-5ddb-4ae9-9a34-15e107f34d8b): created successfully Sep 23 14:42:21 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-5d6f07bf-70f0-4fa8-957b-236bdd40a3af tempest-VolumesListTestJSON-550088439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (757b5e27-70e1-41ee-abde-dc82b4be34e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:42:21 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-5d6f07bf-70f0-4fa8-957b-236bdd40a3af tempest-VolumesListTestJSON-550088439 None] Flow 'volume_create_manager' (b1f55635-8d4a-4287-a2d3-6d220e0c542a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:42:21 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-5d6f07bf-70f0-4fa8-957b-236bdd40a3af tempest-VolumesListTestJSON-550088439 None] Created volume successfully. Sep 23 14:42:21 devstack sudo[98011]: pam_unix(sudo:session): session closed for user root Sep 23 14:42:21 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-858d5c4d-bfa6-4156-92af-a5eb75a5523b tempest-VolumesDeleteCascade-381167990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7173e226-2785-49f7-8999-ba2ba63af730.d1702fb9-8981-47fc-ba85-5b7f47250e10" returned: 0 in 0.645s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:42:21 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-858d5c4d-bfa6-4156-92af-a5eb75a5523b tempest-VolumesDeleteCascade-381167990 None] Lock "cinder-quobyte-d1702fb9-8981-47fc-ba85-5b7f47250e10" released by "_delete_snapshot" :: held 2.978s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:42:21 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-858d5c4d-bfa6-4156-92af-a5eb75a5523b tempest-VolumesDeleteCascade-381167990 None] Lock "cinder-quobyte-7173e226-2785-49f7-8999-ba2ba63af730" released by "delete_snapshot" :: held 3.044s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:42:22 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-858d5c4d-bfa6-4156-92af-a5eb75a5523b tempest-VolumesDeleteCascade-381167990 None] Created reservations ['b170faf6-39b3-492e-9cdc-98797c5718d7', '8f68a148-0ef0-4bb4-a0bb-19a0de2305b4', '62a50c12-472c-4fea-9e9d-b7df0c386369', '00048dfb-f12f-4abe-bb0a-56f5e58bad34'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:42:22 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-858d5c4d-bfa6-4156-92af-a5eb75a5523b tempest-VolumesDeleteCascade-381167990 None] Delete snapshot completed successfully. Sep 23 14:42:22 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-858d5c4d-bfa6-4156-92af-a5eb75a5523b tempest-VolumesDeleteCascade-381167990 None] Lock "cinder-d1702fb9-8981-47fc-ba85-5b7f47250e10-delete_snapshot" released by "delete_snapshot" :: held 3.421s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:42:22 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-858d5c4d-bfa6-4156-92af-a5eb75a5523b tempest-VolumesDeleteCascade-381167990 None] Snapshots deleted, issuing volume delete {{(pid=86310) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 23 14:42:22 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-858d5c4d-bfa6-4156-92af-a5eb75a5523b tempest-VolumesDeleteCascade-381167990 None] Acquiring lock "cinder-quobyte-7173e226-2785-49f7-8999-ba2ba63af730" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:42:22 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-858d5c4d-bfa6-4156-92af-a5eb75a5523b tempest-VolumesDeleteCascade-381167990 None] Lock "cinder-quobyte-7173e226-2785-49f7-8999-ba2ba63af730" acquired by "delete_volume" :: waited 0.020s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:42:22 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[e67e69fb-329f-48d9-a938-840bfbc25be5]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:42:22 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-858d5c4d-bfa6-4156-92af-a5eb75a5523b tempest-VolumesDeleteCascade-381167990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7173e226-2785-49f7-8999-ba2ba63af730 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:42:22 devstack sudo[98037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7173e226-2785-49f7-8999-ba2ba63af730 Sep 23 14:42:22 devstack sudo[98037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:42:22 devstack sudo[98037]: pam_unix(sudo:session): session closed for user root Sep 23 14:42:22 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-858d5c4d-bfa6-4156-92af-a5eb75a5523b tempest-VolumesDeleteCascade-381167990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7173e226-2785-49f7-8999-ba2ba63af730" returned: 0 in 0.451s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:42:22 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-858d5c4d-bfa6-4156-92af-a5eb75a5523b tempest-VolumesDeleteCascade-381167990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7173e226-2785-49f7-8999-ba2ba63af730 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:42:22 devstack sudo[98042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7173e226-2785-49f7-8999-ba2ba63af730 Sep 23 14:42:22 devstack sudo[98042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:42:23 devstack sudo[98042]: pam_unix(sudo:session): session closed for user root Sep 23 14:42:23 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-858d5c4d-bfa6-4156-92af-a5eb75a5523b tempest-VolumesDeleteCascade-381167990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7173e226-2785-49f7-8999-ba2ba63af730" returned: 0 in 0.308s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:42:23 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-858d5c4d-bfa6-4156-92af-a5eb75a5523b tempest-VolumesDeleteCascade-381167990 None] Lock "cinder-quobyte-7173e226-2785-49f7-8999-ba2ba63af730" released by "delete_volume" :: held 0.880s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:42:23 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-858d5c4d-bfa6-4156-92af-a5eb75a5523b tempest-VolumesDeleteCascade-381167990 None] Created reservations ['f1f80e44-c3b7-4b68-b84d-9f4c3bc78a37', 'aaa3825a-1907-4a0c-a083-c3ce67c3d58d', 'ebde937a-c371-4dee-a954-16478c10d6cf', 'b01cc000-9bdb-4b66-9abe-47448a6c1503'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:42:23 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-858d5c4d-bfa6-4156-92af-a5eb75a5523b tempest-VolumesDeleteCascade-381167990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:42:23 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-858d5c4d-bfa6-4156-92af-a5eb75a5523b tempest-VolumesDeleteCascade-381167990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:42:23 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-858d5c4d-bfa6-4156-92af-a5eb75a5523b tempest-VolumesDeleteCascade-381167990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:42:23 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-858d5c4d-bfa6-4156-92af-a5eb75a5523b tempest-VolumesDeleteCascade-381167990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:42:23 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-858d5c4d-bfa6-4156-92af-a5eb75a5523b tempest-VolumesDeleteCascade-381167990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:42:23 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-858d5c4d-bfa6-4156-92af-a5eb75a5523b tempest-VolumesDeleteCascade-381167990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:42:23 devstack sudo[98045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:42:23 devstack sudo[98045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:42:23 devstack sudo[98045]: pam_unix(sudo:session): session closed for user root Sep 23 14:42:23 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-858d5c4d-bfa6-4156-92af-a5eb75a5523b tempest-VolumesDeleteCascade-381167990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.267s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:42:23 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-858d5c4d-bfa6-4156-92af-a5eb75a5523b tempest-VolumesDeleteCascade-381167990 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:42:23 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-858d5c4d-bfa6-4156-92af-a5eb75a5523b tempest-VolumesDeleteCascade-381167990 None] Deleted volume successfully. Sep 23 14:42:23 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-858d5c4d-bfa6-4156-92af-a5eb75a5523b tempest-VolumesDeleteCascade-381167990 None] Lock "cinder-7173e226-2785-49f7-8999-ba2ba63af730-delete_volume" released by "delete_volume" :: held 10.823s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:42:24 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-957eac73-84fc-417d-9294-2fccdd96c60d tempest-VolumesListTestJSON-550088439 None] Acquiring lock "cinder-d178ef3c-5ddb-4ae9-9a34-15e107f34d8b-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:42:24 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-957eac73-84fc-417d-9294-2fccdd96c60d tempest-VolumesListTestJSON-550088439 None] Lock "cinder-d178ef3c-5ddb-4ae9-9a34-15e107f34d8b-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:42:24 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-957eac73-84fc-417d-9294-2fccdd96c60d tempest-VolumesListTestJSON-550088439 None] Acquiring lock "cinder-quobyte-d178ef3c-5ddb-4ae9-9a34-15e107f34d8b" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:42:24 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-957eac73-84fc-417d-9294-2fccdd96c60d tempest-VolumesListTestJSON-550088439 None] Lock "cinder-quobyte-d178ef3c-5ddb-4ae9-9a34-15e107f34d8b" acquired by "delete_volume" :: waited 0.026s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:42:24 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c43c9aa-5960-48ae-924d-ece9ee8d8e4f]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:42:24 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-957eac73-84fc-417d-9294-2fccdd96c60d tempest-VolumesListTestJSON-550088439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d178ef3c-5ddb-4ae9-9a34-15e107f34d8b {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:42:24 devstack sudo[98048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d178ef3c-5ddb-4ae9-9a34-15e107f34d8b Sep 23 14:42:24 devstack sudo[98048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:42:24 devstack sudo[98048]: pam_unix(sudo:session): session closed for user root Sep 23 14:42:24 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-957eac73-84fc-417d-9294-2fccdd96c60d tempest-VolumesListTestJSON-550088439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d178ef3c-5ddb-4ae9-9a34-15e107f34d8b" returned: 0 in 0.532s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:42:24 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-957eac73-84fc-417d-9294-2fccdd96c60d tempest-VolumesListTestJSON-550088439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d178ef3c-5ddb-4ae9-9a34-15e107f34d8b {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:42:25 devstack sudo[98070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d178ef3c-5ddb-4ae9-9a34-15e107f34d8b Sep 23 14:42:25 devstack sudo[98070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:42:25 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd1b16db-d613-4d46-83a6-cc70565c9580 tempest-VolumesDeleteCascade-381167990 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:42:25 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-dd1b16db-d613-4d46-83a6-cc70565c9580 tempest-VolumesDeleteCascade-381167990 None] Flow 'volume_create_manager' (07477f93-e895-4a1e-833c-3d1e15e16d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:42:25 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-dd1b16db-d613-4d46-83a6-cc70565c9580 tempest-VolumesDeleteCascade-381167990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4835129f-de5e-49b2-9596-e9bd7060a676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:42:25 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-dd1b16db-d613-4d46-83a6-cc70565c9580 tempest-VolumesDeleteCascade-381167990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4835129f-de5e-49b2-9596-e9bd7060a676) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:42:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1522181608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=444b13a3-3a07-48f8-be7f-2076cea42fa8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7e9344933224837864266db979e09dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:42:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:42:25Z,use_quota=True,user_id='9cf980bbae57413d81db599d78cdcfc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:42:25 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-dd1b16db-d613-4d46-83a6-cc70565c9580 tempest-VolumesDeleteCascade-381167990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02dcfac1-8564-4c0c-bd81-5a74e17d8429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:42:25 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-dd1b16db-d613-4d46-83a6-cc70565c9580 tempest-VolumesDeleteCascade-381167990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02dcfac1-8564-4c0c-bd81-5a74e17d8429) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:42:25 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-dd1b16db-d613-4d46-83a6-cc70565c9580 tempest-VolumesDeleteCascade-381167990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0015bb5e-e837-45d1-b209-e77b869e4239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:42:25 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-dd1b16db-d613-4d46-83a6-cc70565c9580 tempest-VolumesDeleteCascade-381167990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0015bb5e-e837-45d1-b209-e77b869e4239) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '444b13a3-3a07-48f8-be7f-2076cea42fa8', 'volume_name': 'volume-444b13a3-3a07-48f8-be7f-2076cea42fa8', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:42:25 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-dd1b16db-d613-4d46-83a6-cc70565c9580 tempest-VolumesDeleteCascade-381167990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f81fccb5-c028-48ef-bbcf-cc33d1cfa2e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:42:25 devstack sudo[98070]: pam_unix(sudo:session): session closed for user root Sep 23 14:42:25 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-dd1b16db-d613-4d46-83a6-cc70565c9580 tempest-VolumesDeleteCascade-381167990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f81fccb5-c028-48ef-bbcf-cc33d1cfa2e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:42:25 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-dd1b16db-d613-4d46-83a6-cc70565c9580 tempest-VolumesDeleteCascade-381167990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d7174b0-eb13-4e0e-a85f-4270e024ae75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:42:25 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-dd1b16db-d613-4d46-83a6-cc70565c9580 tempest-VolumesDeleteCascade-381167990 None] Volume 444b13a3-3a07-48f8-be7f-2076cea42fa8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-444b13a3-3a07-48f8-be7f-2076cea42fa8', 'volume_size': 1} Sep 23 14:42:25 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-dd1b16db-d613-4d46-83a6-cc70565c9580 tempest-VolumesDeleteCascade-381167990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:42:25 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-dd1b16db-d613-4d46-83a6-cc70565c9580 tempest-VolumesDeleteCascade-381167990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:42:25 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-dd1b16db-d613-4d46-83a6-cc70565c9580 tempest-VolumesDeleteCascade-381167990 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:42:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1522181608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=444b13a3-3a07-48f8-be7f-2076cea42fa8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7e9344933224837864266db979e09dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:42:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:42:25Z,use_quota=True,user_id='9cf980bbae57413d81db599d78cdcfc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:42:25 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-dd1b16db-d613-4d46-83a6-cc70565c9580 tempest-VolumesDeleteCascade-381167990 None] Creating volume 444b13a3-3a07-48f8-be7f-2076cea42fa8 {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:42:25 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-dd1b16db-d613-4d46-83a6-cc70565c9580 tempest-VolumesDeleteCascade-381167990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:42:25 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-dd1b16db-d613-4d46-83a6-cc70565c9580 tempest-VolumesDeleteCascade-381167990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:42:25 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-dd1b16db-d613-4d46-83a6-cc70565c9580 tempest-VolumesDeleteCascade-381167990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:42:25 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-dd1b16db-d613-4d46-83a6-cc70565c9580 tempest-VolumesDeleteCascade-381167990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:42:25 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-dd1b16db-d613-4d46-83a6-cc70565c9580 tempest-VolumesDeleteCascade-381167990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:42:25 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-dd1b16db-d613-4d46-83a6-cc70565c9580 tempest-VolumesDeleteCascade-381167990 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:42:25 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-dd1b16db-d613-4d46-83a6-cc70565c9580 tempest-VolumesDeleteCascade-381167990 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:42:25 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-dd1b16db-d613-4d46-83a6-cc70565c9580 tempest-VolumesDeleteCascade-381167990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-444b13a3-3a07-48f8-be7f-2076cea42fa8 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:42:25 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-957eac73-84fc-417d-9294-2fccdd96c60d tempest-VolumesListTestJSON-550088439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d178ef3c-5ddb-4ae9-9a34-15e107f34d8b" returned: 0 in 0.412s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:42:25 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-957eac73-84fc-417d-9294-2fccdd96c60d tempest-VolumesListTestJSON-550088439 None] Lock "cinder-quobyte-d178ef3c-5ddb-4ae9-9a34-15e107f34d8b" released by "delete_volume" :: held 1.012s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:42:25 devstack sudo[98073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-444b13a3-3a07-48f8-be7f-2076cea42fa8 1073741824 Sep 23 14:42:25 devstack sudo[98073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:42:25 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-957eac73-84fc-417d-9294-2fccdd96c60d tempest-VolumesListTestJSON-550088439 None] Created reservations ['5fa9622b-9fb8-459a-824a-d943116308a0', 'ddd9fc46-07db-4230-8012-0bc695409793', '79dad1f8-8cba-42d3-956e-20cd2f9f6079', '2348230c-4e7d-4563-9f29-3e6a9cca9e06'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:42:25 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-957eac73-84fc-417d-9294-2fccdd96c60d tempest-VolumesListTestJSON-550088439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:42:25 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-957eac73-84fc-417d-9294-2fccdd96c60d tempest-VolumesListTestJSON-550088439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:42:25 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-957eac73-84fc-417d-9294-2fccdd96c60d tempest-VolumesListTestJSON-550088439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:42:25 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-957eac73-84fc-417d-9294-2fccdd96c60d tempest-VolumesListTestJSON-550088439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:42:25 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-957eac73-84fc-417d-9294-2fccdd96c60d tempest-VolumesListTestJSON-550088439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:42:25 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-957eac73-84fc-417d-9294-2fccdd96c60d tempest-VolumesListTestJSON-550088439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:42:25 devstack sudo[98075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:42:25 devstack sudo[98075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:42:25 devstack sudo[98075]: pam_unix(sudo:session): session closed for user root Sep 23 14:42:25 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-957eac73-84fc-417d-9294-2fccdd96c60d tempest-VolumesListTestJSON-550088439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.294s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:42:25 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-957eac73-84fc-417d-9294-2fccdd96c60d tempest-VolumesListTestJSON-550088439 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:42:25 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-957eac73-84fc-417d-9294-2fccdd96c60d tempest-VolumesListTestJSON-550088439 None] Deleted volume successfully. Sep 23 14:42:25 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-957eac73-84fc-417d-9294-2fccdd96c60d tempest-VolumesListTestJSON-550088439 None] Lock "cinder-d178ef3c-5ddb-4ae9-9a34-15e107f34d8b-delete_volume" released by "delete_volume" :: held 1.610s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:42:25 devstack sudo[98073]: pam_unix(sudo:session): session closed for user root Sep 23 14:42:25 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-dd1b16db-d613-4d46-83a6-cc70565c9580 tempest-VolumesDeleteCascade-381167990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-444b13a3-3a07-48f8-be7f-2076cea42fa8 1073741824" returned: 0 in 0.583s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:42:25 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-dd1b16db-d613-4d46-83a6-cc70565c9580 tempest-VolumesDeleteCascade-381167990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-444b13a3-3a07-48f8-be7f-2076cea42fa8 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:42:26 devstack sudo[98082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-444b13a3-3a07-48f8-be7f-2076cea42fa8 Sep 23 14:42:26 devstack sudo[98082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:42:26 devstack sudo[98082]: pam_unix(sudo:session): session closed for user root Sep 23 14:42:26 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-dd1b16db-d613-4d46-83a6-cc70565c9580 tempest-VolumesDeleteCascade-381167990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-444b13a3-3a07-48f8-be7f-2076cea42fa8" returned: 0 in 0.281s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:42:26 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-dd1b16db-d613-4d46-83a6-cc70565c9580 tempest-VolumesDeleteCascade-381167990 None] <== create_volume: return (904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:42:26 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-dd1b16db-d613-4d46-83a6-cc70565c9580 tempest-VolumesDeleteCascade-381167990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.908s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:42:26 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-dd1b16db-d613-4d46-83a6-cc70565c9580 tempest-VolumesDeleteCascade-381167990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d7174b0-eb13-4e0e-a85f-4270e024ae75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-444b13a3-3a07-48f8-be7f-2076cea42fa8', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:42:26 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-dd1b16db-d613-4d46-83a6-cc70565c9580 tempest-VolumesDeleteCascade-381167990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11c71891-c293-46e9-ae59-87b60e19bb2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:42:26 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-dd1b16db-d613-4d46-83a6-cc70565c9580 tempest-VolumesDeleteCascade-381167990 None] Volume volume-444b13a3-3a07-48f8-be7f-2076cea42fa8 (444b13a3-3a07-48f8-be7f-2076cea42fa8): created successfully Sep 23 14:42:26 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-dd1b16db-d613-4d46-83a6-cc70565c9580 tempest-VolumesDeleteCascade-381167990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11c71891-c293-46e9-ae59-87b60e19bb2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:42:26 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-dd1b16db-d613-4d46-83a6-cc70565c9580 tempest-VolumesDeleteCascade-381167990 None] Flow 'volume_create_manager' (07477f93-e895-4a1e-833c-3d1e15e16d8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:42:26 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-dd1b16db-d613-4d46-83a6-cc70565c9580 tempest-VolumesDeleteCascade-381167990 None] Created volume successfully. Sep 23 14:42:26 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-8643d791-6d94-4f85-8232-57a7241d3bfb tempest-VolumesListTestJSON-550088439 None] Acquiring lock "cinder-d753288c-4ce4-4f24-bd8f-8ae270f49d96-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:42:26 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-8643d791-6d94-4f85-8232-57a7241d3bfb tempest-VolumesListTestJSON-550088439 None] Lock "cinder-d753288c-4ce4-4f24-bd8f-8ae270f49d96-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:42:26 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-8643d791-6d94-4f85-8232-57a7241d3bfb tempest-VolumesListTestJSON-550088439 None] Acquiring lock "cinder-quobyte-d753288c-4ce4-4f24-bd8f-8ae270f49d96" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:42:26 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-8643d791-6d94-4f85-8232-57a7241d3bfb tempest-VolumesListTestJSON-550088439 None] Lock "cinder-quobyte-d753288c-4ce4-4f24-bd8f-8ae270f49d96" acquired by "delete_volume" :: waited 0.023s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:42:26 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b689e6e-0a28-4b73-b187-7ccf97806cdd]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:42:26 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8643d791-6d94-4f85-8232-57a7241d3bfb tempest-VolumesListTestJSON-550088439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d753288c-4ce4-4f24-bd8f-8ae270f49d96 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:42:26 devstack sudo[98085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d753288c-4ce4-4f24-bd8f-8ae270f49d96 Sep 23 14:42:26 devstack sudo[98085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:42:27 devstack sudo[98085]: pam_unix(sudo:session): session closed for user root Sep 23 14:42:27 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8643d791-6d94-4f85-8232-57a7241d3bfb tempest-VolumesListTestJSON-550088439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d753288c-4ce4-4f24-bd8f-8ae270f49d96" returned: 0 in 0.383s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:42:27 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8643d791-6d94-4f85-8232-57a7241d3bfb tempest-VolumesListTestJSON-550088439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d753288c-4ce4-4f24-bd8f-8ae270f49d96 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:42:27 devstack sudo[98090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d753288c-4ce4-4f24-bd8f-8ae270f49d96 Sep 23 14:42:27 devstack sudo[98090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:42:27 devstack sudo[98090]: pam_unix(sudo:session): session closed for user root Sep 23 14:42:27 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8643d791-6d94-4f85-8232-57a7241d3bfb tempest-VolumesListTestJSON-550088439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d753288c-4ce4-4f24-bd8f-8ae270f49d96" returned: 0 in 0.303s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:42:27 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-8643d791-6d94-4f85-8232-57a7241d3bfb tempest-VolumesListTestJSON-550088439 None] Lock "cinder-quobyte-d753288c-4ce4-4f24-bd8f-8ae270f49d96" released by "delete_volume" :: held 0.745s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:42:27 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-8643d791-6d94-4f85-8232-57a7241d3bfb tempest-VolumesListTestJSON-550088439 None] Created reservations ['297a5f0a-e57d-4b27-a698-8f0e26085d61', 'c2a6b1ea-6f7d-4ba2-ba74-99c083b7e911', '4732c37c-877b-4177-a2d7-9168c219830f', 'ff000f16-2625-4456-b81a-c7050aaacf16'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:42:27 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-7873f6bd-cfee-46bd-a371-b9bd83b5b2c4 tempest-VolumesDeleteCascade-381167990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:42:27 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-7873f6bd-cfee-46bd-a371-b9bd83b5b2c4 tempest-VolumesDeleteCascade-381167990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:42:27 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-7873f6bd-cfee-46bd-a371-b9bd83b5b2c4 tempest-VolumesDeleteCascade-381167990 None] Creating offline snapshot 6f3d1bd4-cf68-40ac-a4f0-d763380f6b21 of volume 444b13a3-3a07-48f8-be7f-2076cea42fa8 {{(pid=86310) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 14:42:27 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaebb22e-0f15-4c39-b915-6eadd74a3886]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:42:27 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-7873f6bd-cfee-46bd-a371-b9bd83b5b2c4 tempest-VolumesDeleteCascade-381167990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-444b13a3-3a07-48f8-be7f-2076cea42fa8 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:42:27 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-8643d791-6d94-4f85-8232-57a7241d3bfb tempest-VolumesListTestJSON-550088439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:42:27 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-8643d791-6d94-4f85-8232-57a7241d3bfb tempest-VolumesListTestJSON-550088439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:42:27 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-8643d791-6d94-4f85-8232-57a7241d3bfb tempest-VolumesListTestJSON-550088439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:42:27 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-8643d791-6d94-4f85-8232-57a7241d3bfb tempest-VolumesListTestJSON-550088439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:42:27 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-8643d791-6d94-4f85-8232-57a7241d3bfb tempest-VolumesListTestJSON-550088439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:42:27 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8643d791-6d94-4f85-8232-57a7241d3bfb tempest-VolumesListTestJSON-550088439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:42:27 devstack sudo[98097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:42:27 devstack sudo[98097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:42:27 devstack sudo[98096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-444b13a3-3a07-48f8-be7f-2076cea42fa8 Sep 23 14:42:27 devstack sudo[98096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:42:27 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-6bc144bf-9a16-474b-a210-e3fb7c285a61 tempest-VolumesListTestJSON-550088439 None] Acquiring lock "cinder-570df365-6831-4fc0-a378-1eb8ed6f78dd-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:42:27 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-6bc144bf-9a16-474b-a210-e3fb7c285a61 tempest-VolumesListTestJSON-550088439 None] Lock "cinder-570df365-6831-4fc0-a378-1eb8ed6f78dd-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:42:27 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-6bc144bf-9a16-474b-a210-e3fb7c285a61 tempest-VolumesListTestJSON-550088439 None] Acquiring lock "cinder-quobyte-570df365-6831-4fc0-a378-1eb8ed6f78dd" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:42:27 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-6bc144bf-9a16-474b-a210-e3fb7c285a61 tempest-VolumesListTestJSON-550088439 None] Lock "cinder-quobyte-570df365-6831-4fc0-a378-1eb8ed6f78dd" acquired by "delete_volume" :: waited 0.018s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:42:28 devstack sudo[98097]: pam_unix(sudo:session): session closed for user root Sep 23 14:42:28 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8643d791-6d94-4f85-8232-57a7241d3bfb tempest-VolumesListTestJSON-550088439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.378s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:42:28 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-8643d791-6d94-4f85-8232-57a7241d3bfb tempest-VolumesListTestJSON-550088439 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:42:28 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[673cf798-070c-47dd-9625-ba3ecb75ba0a]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:42:28 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-6bc144bf-9a16-474b-a210-e3fb7c285a61 tempest-VolumesListTestJSON-550088439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-570df365-6831-4fc0-a378-1eb8ed6f78dd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:42:28 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-8643d791-6d94-4f85-8232-57a7241d3bfb tempest-VolumesListTestJSON-550088439 None] Deleted volume successfully. Sep 23 14:42:28 devstack sudo[98096]: pam_unix(sudo:session): session closed for user root Sep 23 14:42:28 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-7873f6bd-cfee-46bd-a371-b9bd83b5b2c4 tempest-VolumesDeleteCascade-381167990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-444b13a3-3a07-48f8-be7f-2076cea42fa8" returned: 0 in 0.452s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:42:28 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-7873f6bd-cfee-46bd-a371-b9bd83b5b2c4 tempest-VolumesDeleteCascade-381167990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-444b13a3-3a07-48f8-be7f-2076cea42fa8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-444b13a3-3a07-48f8-be7f-2076cea42fa8.6f3d1bd4-cf68-40ac-a4f0-d763380f6b21 1G {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:42:28 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-8643d791-6d94-4f85-8232-57a7241d3bfb tempest-VolumesListTestJSON-550088439 None] Lock "cinder-d753288c-4ce4-4f24-bd8f-8ae270f49d96-delete_volume" released by "delete_volume" :: held 1.450s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:42:28 devstack sudo[98105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-444b13a3-3a07-48f8-be7f-2076cea42fa8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-444b13a3-3a07-48f8-be7f-2076cea42fa8.6f3d1bd4-cf68-40ac-a4f0-d763380f6b21 1G Sep 23 14:42:28 devstack sudo[98105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:42:28 devstack sudo[98104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-570df365-6831-4fc0-a378-1eb8ed6f78dd Sep 23 14:42:28 devstack sudo[98104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:42:28 devstack sudo[98104]: pam_unix(sudo:session): session closed for user root Sep 23 14:42:28 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-6bc144bf-9a16-474b-a210-e3fb7c285a61 tempest-VolumesListTestJSON-550088439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-570df365-6831-4fc0-a378-1eb8ed6f78dd" returned: 0 in 0.442s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:42:28 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-6bc144bf-9a16-474b-a210-e3fb7c285a61 tempest-VolumesListTestJSON-550088439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-570df365-6831-4fc0-a378-1eb8ed6f78dd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:42:28 devstack sudo[98114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-570df365-6831-4fc0-a378-1eb8ed6f78dd Sep 23 14:42:28 devstack sudo[98114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:42:28 devstack sudo[98105]: pam_unix(sudo:session): session closed for user root Sep 23 14:42:28 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-7873f6bd-cfee-46bd-a371-b9bd83b5b2c4 tempest-VolumesDeleteCascade-381167990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-444b13a3-3a07-48f8-be7f-2076cea42fa8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-444b13a3-3a07-48f8-be7f-2076cea42fa8.6f3d1bd4-cf68-40ac-a4f0-d763380f6b21 1G" returned: 0 in 0.541s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:42:28 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-7873f6bd-cfee-46bd-a371-b9bd83b5b2c4 tempest-VolumesDeleteCascade-381167990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-444b13a3-3a07-48f8-be7f-2076cea42fa8 -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-444b13a3-3a07-48f8-be7f-2076cea42fa8.6f3d1bd4-cf68-40ac-a4f0-d763380f6b21 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:42:28 devstack sudo[98116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-444b13a3-3a07-48f8-be7f-2076cea42fa8 -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-444b13a3-3a07-48f8-be7f-2076cea42fa8.6f3d1bd4-cf68-40ac-a4f0-d763380f6b21 Sep 23 14:42:28 devstack sudo[98116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:42:28 devstack sudo[98114]: pam_unix(sudo:session): session closed for user root Sep 23 14:42:28 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-6bc144bf-9a16-474b-a210-e3fb7c285a61 tempest-VolumesListTestJSON-550088439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-570df365-6831-4fc0-a378-1eb8ed6f78dd" returned: 0 in 0.349s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:42:28 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-6bc144bf-9a16-474b-a210-e3fb7c285a61 tempest-VolumesListTestJSON-550088439 None] Lock "cinder-quobyte-570df365-6831-4fc0-a378-1eb8ed6f78dd" released by "delete_volume" :: held 0.848s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:42:28 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-6bc144bf-9a16-474b-a210-e3fb7c285a61 tempest-VolumesListTestJSON-550088439 None] Created reservations ['2403ea85-a8af-4410-ba69-2007e1b67b4c', '8c559946-70d4-4b71-b6b2-a1cf428a4f54', '3b046e0b-9b9b-4cae-ad3c-6f6414b09fd1', '5fa5573e-8fb7-42e9-bcde-feb5e669d09e'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:42:29 devstack sudo[98116]: pam_unix(sudo:session): session closed for user root Sep 23 14:42:29 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-7873f6bd-cfee-46bd-a371-b9bd83b5b2c4 tempest-VolumesDeleteCascade-381167990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-444b13a3-3a07-48f8-be7f-2076cea42fa8 -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-444b13a3-3a07-48f8-be7f-2076cea42fa8.6f3d1bd4-cf68-40ac-a4f0-d763380f6b21" returned: 0 in 0.426s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:42:29 devstack cinder-volume[86310]: WARNING cinder.volume.drivers.remotefs [None req-7873f6bd-cfee-46bd-a371-b9bd83b5b2c4 tempest-VolumesDeleteCascade-381167990 None] /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-444b13a3-3a07-48f8-be7f-2076cea42fa8.6f3d1bd4-cf68-40ac-a4f0-d763380f6b21 is being set with open permissions: ugo+rw Sep 23 14:42:29 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-7873f6bd-cfee-46bd-a371-b9bd83b5b2c4 tempest-VolumesDeleteCascade-381167990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-444b13a3-3a07-48f8-be7f-2076cea42fa8.6f3d1bd4-cf68-40ac-a4f0-d763380f6b21 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:42:29 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-6bc144bf-9a16-474b-a210-e3fb7c285a61 tempest-VolumesListTestJSON-550088439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:42:29 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-6bc144bf-9a16-474b-a210-e3fb7c285a61 tempest-VolumesListTestJSON-550088439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:42:29 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-6bc144bf-9a16-474b-a210-e3fb7c285a61 tempest-VolumesListTestJSON-550088439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:42:29 devstack sudo[98122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-444b13a3-3a07-48f8-be7f-2076cea42fa8.6f3d1bd4-cf68-40ac-a4f0-d763380f6b21 Sep 23 14:42:29 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-6bc144bf-9a16-474b-a210-e3fb7c285a61 tempest-VolumesListTestJSON-550088439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:42:29 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-6bc144bf-9a16-474b-a210-e3fb7c285a61 tempest-VolumesListTestJSON-550088439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:42:29 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-6bc144bf-9a16-474b-a210-e3fb7c285a61 tempest-VolumesListTestJSON-550088439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:42:29 devstack sudo[98122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:42:29 devstack sudo[98124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:42:29 devstack sudo[98124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:42:29 devstack sudo[98124]: pam_unix(sudo:session): session closed for user root Sep 23 14:42:29 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-6bc144bf-9a16-474b-a210-e3fb7c285a61 tempest-VolumesListTestJSON-550088439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.317s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:42:29 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-6bc144bf-9a16-474b-a210-e3fb7c285a61 tempest-VolumesListTestJSON-550088439 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:42:29 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-6bc144bf-9a16-474b-a210-e3fb7c285a61 tempest-VolumesListTestJSON-550088439 None] Deleted volume successfully. Sep 23 14:42:29 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-6bc144bf-9a16-474b-a210-e3fb7c285a61 tempest-VolumesListTestJSON-550088439 None] Lock "cinder-570df365-6831-4fc0-a378-1eb8ed6f78dd-delete_volume" released by "delete_volume" :: held 1.546s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:42:29 devstack sudo[98122]: pam_unix(sudo:session): session closed for user root Sep 23 14:42:29 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-7873f6bd-cfee-46bd-a371-b9bd83b5b2c4 tempest-VolumesDeleteCascade-381167990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-444b13a3-3a07-48f8-be7f-2076cea42fa8.6f3d1bd4-cf68-40ac-a4f0-d763380f6b21" returned: 0 in 0.541s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:42:29 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-7873f6bd-cfee-46bd-a371-b9bd83b5b2c4 tempest-VolumesDeleteCascade-381167990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-444b13a3-3a07-48f8-be7f-2076cea42fa8.info {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:42:29 devstack sudo[98128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-444b13a3-3a07-48f8-be7f-2076cea42fa8.info Sep 23 14:42:29 devstack sudo[98128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:42:30 devstack sudo[98128]: pam_unix(sudo:session): session closed for user root Sep 23 14:42:30 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-7873f6bd-cfee-46bd-a371-b9bd83b5b2c4 tempest-VolumesDeleteCascade-381167990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-444b13a3-3a07-48f8-be7f-2076cea42fa8.info" returned: 0 in 0.421s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:42:30 devstack cinder-volume[86310]: WARNING cinder.volume.drivers.remotefs [None req-7873f6bd-cfee-46bd-a371-b9bd83b5b2c4 tempest-VolumesDeleteCascade-381167990 None] /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-444b13a3-3a07-48f8-be7f-2076cea42fa8.info is being set with open permissions: ugo+rw Sep 23 14:42:30 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-7873f6bd-cfee-46bd-a371-b9bd83b5b2c4 tempest-VolumesDeleteCascade-381167990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-444b13a3-3a07-48f8-be7f-2076cea42fa8.info {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:42:30 devstack sudo[98138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-444b13a3-3a07-48f8-be7f-2076cea42fa8.info Sep 23 14:42:30 devstack sudo[98138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:42:30 devstack sudo[98138]: pam_unix(sudo:session): session closed for user root Sep 23 14:42:30 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-7873f6bd-cfee-46bd-a371-b9bd83b5b2c4 tempest-VolumesDeleteCascade-381167990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-444b13a3-3a07-48f8-be7f-2076cea42fa8.info" returned: 0 in 0.295s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:42:30 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-7873f6bd-cfee-46bd-a371-b9bd83b5b2c4 tempest-VolumesDeleteCascade-381167990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.840s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:42:30 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-7873f6bd-cfee-46bd-a371-b9bd83b5b2c4 tempest-VolumesDeleteCascade-381167990 None] Create snapshot completed successfully Sep 23 14:42:31 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc4546e1-3a30-44f9-bf7d-cab7581e6295 tempest-VolumesDeleteCascade-381167990 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:42:31 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-dc4546e1-3a30-44f9-bf7d-cab7581e6295 tempest-VolumesDeleteCascade-381167990 None] Flow 'volume_create_manager' (381409b4-ef8f-48c3-8424-1f38fa1b8e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:42:31 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-dc4546e1-3a30-44f9-bf7d-cab7581e6295 tempest-VolumesDeleteCascade-381167990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bb5d4da-2eda-43b4-88ec-5fd2d919eaa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:42:31 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-dc4546e1-3a30-44f9-bf7d-cab7581e6295 tempest-VolumesDeleteCascade-381167990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bb5d4da-2eda-43b4-88ec-5fd2d919eaa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:42:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-808405291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20669154-0b26-4040-a592-47affcf6811a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7e9344933224837864266db979e09dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:42:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=6f3d1bd4-cf68-40ac-a4f0-d763380f6b21,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:42:32Z,use_quota=True,user_id='9cf980bbae57413d81db599d78cdcfc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:42:31 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-dc4546e1-3a30-44f9-bf7d-cab7581e6295 tempest-VolumesDeleteCascade-381167990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d507189d-0850-47b0-a14a-ebfd34db9ddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:42:31 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-dc4546e1-3a30-44f9-bf7d-cab7581e6295 tempest-VolumesDeleteCascade-381167990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d507189d-0850-47b0-a14a-ebfd34db9ddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:42:31 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-dc4546e1-3a30-44f9-bf7d-cab7581e6295 tempest-VolumesDeleteCascade-381167990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb66e589-afe1-4335-823a-c07727ff42bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:42:31 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-dc4546e1-3a30-44f9-bf7d-cab7581e6295 tempest-VolumesDeleteCascade-381167990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb66e589-afe1-4335-823a-c07727ff42bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '20669154-0b26-4040-a592-47affcf6811a', 'volume_name': 'volume-20669154-0b26-4040-a592-47affcf6811a', 'volume_size': 1, 'snapshot_id': '6f3d1bd4-cf68-40ac-a4f0-d763380f6b21'}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:42:31 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-dc4546e1-3a30-44f9-bf7d-cab7581e6295 tempest-VolumesDeleteCascade-381167990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b50b510b-57c8-42e4-9041-52e0bcaef659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:42:31 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-dc4546e1-3a30-44f9-bf7d-cab7581e6295 tempest-VolumesDeleteCascade-381167990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b50b510b-57c8-42e4-9041-52e0bcaef659) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:42:31 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-dc4546e1-3a30-44f9-bf7d-cab7581e6295 tempest-VolumesDeleteCascade-381167990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8f0b7df-69b1-4cbd-a958-b3cf3e57db64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:42:31 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-dc4546e1-3a30-44f9-bf7d-cab7581e6295 tempest-VolumesDeleteCascade-381167990 None] Volume 20669154-0b26-4040-a592-47affcf6811a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-20669154-0b26-4040-a592-47affcf6811a', 'volume_size': 1, 'snapshot_id': '6f3d1bd4-cf68-40ac-a4f0-d763380f6b21'} Sep 23 14:42:31 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-dc4546e1-3a30-44f9-bf7d-cab7581e6295 tempest-VolumesDeleteCascade-381167990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:42:31 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-dc4546e1-3a30-44f9-bf7d-cab7581e6295 tempest-VolumesDeleteCascade-381167990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:42:31 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-dc4546e1-3a30-44f9-bf7d-cab7581e6295 tempest-VolumesDeleteCascade-381167990 None] Acquiring lock "cinder-quobyte-6f3d1bd4-cf68-40ac-a4f0-d763380f6b21-20669154-0b26-4040-a592-47affcf6811a" by "_create_volume_from_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:42:31 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-dc4546e1-3a30-44f9-bf7d-cab7581e6295 tempest-VolumesDeleteCascade-381167990 None] Lock "cinder-quobyte-6f3d1bd4-cf68-40ac-a4f0-d763380f6b21-20669154-0b26-4040-a592-47affcf6811a" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:42:31 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-dc4546e1-3a30-44f9-bf7d-cab7581e6295 tempest-VolumesDeleteCascade-381167990 None] Creating volume 20669154-0b26-4040-a592-47affcf6811a from snapshot 6f3d1bd4-cf68-40ac-a4f0-d763380f6b21 {{(pid=86310) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 23 14:42:31 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-dc4546e1-3a30-44f9-bf7d-cab7581e6295 tempest-VolumesDeleteCascade-381167990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:42:31 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-dc4546e1-3a30-44f9-bf7d-cab7581e6295 tempest-VolumesDeleteCascade-381167990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:42:31 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-dc4546e1-3a30-44f9-bf7d-cab7581e6295 tempest-VolumesDeleteCascade-381167990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:42:31 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-dc4546e1-3a30-44f9-bf7d-cab7581e6295 tempest-VolumesDeleteCascade-381167990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:42:31 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-dc4546e1-3a30-44f9-bf7d-cab7581e6295 tempest-VolumesDeleteCascade-381167990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:42:31 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-dc4546e1-3a30-44f9-bf7d-cab7581e6295 tempest-VolumesDeleteCascade-381167990 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:42:31 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-dc4546e1-3a30-44f9-bf7d-cab7581e6295 tempest-VolumesDeleteCascade-381167990 None] Acquiring lock "cinder-quobyte-20669154-0b26-4040-a592-47affcf6811a" by "_copy_volume_from_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:42:31 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-dc4546e1-3a30-44f9-bf7d-cab7581e6295 tempest-VolumesDeleteCascade-381167990 None] Lock "cinder-quobyte-20669154-0b26-4040-a592-47affcf6811a" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:42:31 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-dc4546e1-3a30-44f9-bf7d-cab7581e6295 tempest-VolumesDeleteCascade-381167990 None] snapshot: 6f3d1bd4-cf68-40ac-a4f0-d763380f6b21, volume: 20669154-0b26-4040-a592-47affcf6811a, {{(pid=86310) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 23 14:42:31 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-dc4546e1-3a30-44f9-bf7d-cab7581e6295 tempest-VolumesDeleteCascade-381167990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:42:31 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-dc4546e1-3a30-44f9-bf7d-cab7581e6295 tempest-VolumesDeleteCascade-381167990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:42:31 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-dc4546e1-3a30-44f9-bf7d-cab7581e6295 tempest-VolumesDeleteCascade-381167990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:42:31 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-dc4546e1-3a30-44f9-bf7d-cab7581e6295 tempest-VolumesDeleteCascade-381167990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:42:31 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-dc4546e1-3a30-44f9-bf7d-cab7581e6295 tempest-VolumesDeleteCascade-381167990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:42:32 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec8592bd-b67d-4dc1-936b-ff58712a9176]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:42:32 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-dc4546e1-3a30-44f9-bf7d-cab7581e6295 tempest-VolumesDeleteCascade-381167990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-444b13a3-3a07-48f8-be7f-2076cea42fa8.6f3d1bd4-cf68-40ac-a4f0-d763380f6b21 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:42:32 devstack sudo[98166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-444b13a3-3a07-48f8-be7f-2076cea42fa8.6f3d1bd4-cf68-40ac-a4f0-d763380f6b21 Sep 23 14:42:32 devstack sudo[98166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:42:32 devstack sudo[98166]: pam_unix(sudo:session): session closed for user root Sep 23 14:42:32 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-dc4546e1-3a30-44f9-bf7d-cab7581e6295 tempest-VolumesDeleteCascade-381167990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-444b13a3-3a07-48f8-be7f-2076cea42fa8.6f3d1bd4-cf68-40ac-a4f0-d763380f6b21" returned: 0 in 0.844s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:42:32 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-dc4546e1-3a30-44f9-bf7d-cab7581e6295 tempest-VolumesDeleteCascade-381167990 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-444b13a3-3a07-48f8-be7f-2076cea42fa8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 14:42:32 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2bdaa82-7352-4fbe-a1fc-92ebe38f6dcf]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:42:32 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-dc4546e1-3a30-44f9-bf7d-cab7581e6295 tempest-VolumesDeleteCascade-381167990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-444b13a3-3a07-48f8-be7f-2076cea42fa8 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:42:33 devstack sudo[98209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-444b13a3-3a07-48f8-be7f-2076cea42fa8 Sep 23 14:42:33 devstack sudo[98209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:42:33 devstack sudo[98209]: pam_unix(sudo:session): session closed for user root Sep 23 14:42:33 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-dc4546e1-3a30-44f9-bf7d-cab7581e6295 tempest-VolumesDeleteCascade-381167990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-444b13a3-3a07-48f8-be7f-2076cea42fa8" returned: 0 in 1.019s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:42:33 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-dc4546e1-3a30-44f9-bf7d-cab7581e6295 tempest-VolumesDeleteCascade-381167990 None] will copy from snapshot at /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-444b13a3-3a07-48f8-be7f-2076cea42fa8 {{(pid=86310) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 23 14:42:33 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-dc4546e1-3a30-44f9-bf7d-cab7581e6295 tempest-VolumesDeleteCascade-381167990 None] Creating direct copy from snapshot {{(pid=86310) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 23 14:42:33 devstack cinder-volume[86310]: DEBUG cinder.utils [None req-dc4546e1-3a30-44f9-bf7d-cab7581e6295 tempest-VolumesDeleteCascade-381167990 None] Path /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-20669154-0b26-4040-a592-47affcf6811a not found in is_blk_device check {{(pid=86310) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 23 14:42:33 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-dc4546e1-3a30-44f9-bf7d-cab7581e6295 tempest-VolumesDeleteCascade-381167990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-444b13a3-3a07-48f8-be7f-2076cea42fa8 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-20669154-0b26-4040-a592-47affcf6811a {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:42:34 devstack sudo[98257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-444b13a3-3a07-48f8-be7f-2076cea42fa8 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-20669154-0b26-4040-a592-47affcf6811a Sep 23 14:42:34 devstack sudo[98257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:42:40 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-76183bdf-1535-4ae3-aaff-9e12ebc41c1d tempest-TestServerVolumeAttachScenarioOldVersion-347886582 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:42:40 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-76183bdf-1535-4ae3-aaff-9e12ebc41c1d tempest-TestServerVolumeAttachScenarioOldVersion-347886582 None] Flow 'volume_create_manager' (2634fc5c-545b-4082-8f9c-e124811c6c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:42:40 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-76183bdf-1535-4ae3-aaff-9e12ebc41c1d tempest-TestServerVolumeAttachScenarioOldVersion-347886582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47fe6d7c-4564-4807-af54-f1b10ffd7f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:42:40 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-76183bdf-1535-4ae3-aaff-9e12ebc41c1d tempest-TestServerVolumeAttachScenarioOldVersion-347886582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47fe6d7c-4564-4807-af54-f1b10ffd7f1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:42:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-591303048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bec2589-cc46-4ff9-bf30-b3346b165374,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c667520504b4f07bd66eec38b6c7234',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:42:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:42:40Z,use_quota=True,user_id='44dd42d235ee47d0a9bfdc46e7661bda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:42:40 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-76183bdf-1535-4ae3-aaff-9e12ebc41c1d tempest-TestServerVolumeAttachScenarioOldVersion-347886582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f601f9d-1683-41f7-8531-5166db4eab34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:42:40 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-76183bdf-1535-4ae3-aaff-9e12ebc41c1d tempest-TestServerVolumeAttachScenarioOldVersion-347886582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f601f9d-1683-41f7-8531-5166db4eab34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:42:40 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-76183bdf-1535-4ae3-aaff-9e12ebc41c1d tempest-TestServerVolumeAttachScenarioOldVersion-347886582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efb00375-60db-434e-8001-1c3bc5f3e8cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:42:40 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-76183bdf-1535-4ae3-aaff-9e12ebc41c1d tempest-TestServerVolumeAttachScenarioOldVersion-347886582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efb00375-60db-434e-8001-1c3bc5f3e8cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9bec2589-cc46-4ff9-bf30-b3346b165374', 'volume_name': 'volume-9bec2589-cc46-4ff9-bf30-b3346b165374', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:42:40 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-76183bdf-1535-4ae3-aaff-9e12ebc41c1d tempest-TestServerVolumeAttachScenarioOldVersion-347886582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (692ede8a-4d60-450a-a80b-a47e44b41540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:42:40 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-76183bdf-1535-4ae3-aaff-9e12ebc41c1d tempest-TestServerVolumeAttachScenarioOldVersion-347886582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (692ede8a-4d60-450a-a80b-a47e44b41540) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:42:40 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-76183bdf-1535-4ae3-aaff-9e12ebc41c1d tempest-TestServerVolumeAttachScenarioOldVersion-347886582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd469063-53cd-4fcf-91be-04b75173ddd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:42:40 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-76183bdf-1535-4ae3-aaff-9e12ebc41c1d tempest-TestServerVolumeAttachScenarioOldVersion-347886582 None] Volume 9bec2589-cc46-4ff9-bf30-b3346b165374: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9bec2589-cc46-4ff9-bf30-b3346b165374', 'volume_size': 1} Sep 23 14:42:40 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-76183bdf-1535-4ae3-aaff-9e12ebc41c1d tempest-TestServerVolumeAttachScenarioOldVersion-347886582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:42:42 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-41c25fee-b956-4d43-9d3e-1346cf7c2960 tempest-TestMinimumBasicScenario-596633662 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:42:42 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-41c25fee-b956-4d43-9d3e-1346cf7c2960 tempest-TestMinimumBasicScenario-596633662 None] Flow 'volume_create_manager' (b40a1bad-5b56-493c-bd2a-1960bc3cd61c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:42:42 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-41c25fee-b956-4d43-9d3e-1346cf7c2960 tempest-TestMinimumBasicScenario-596633662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04cd13f0-796e-4969-a7ea-17391affc297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:42:42 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-41c25fee-b956-4d43-9d3e-1346cf7c2960 tempest-TestMinimumBasicScenario-596633662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04cd13f0-796e-4969-a7ea-17391affc297) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:42:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-956441231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=300dcc93-73bc-41c8-a80e-1673383aa69f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd953160e78848738e08b936a20e5af4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:42:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:42:42Z,use_quota=True,user_id='53983ac8d77e49e2ac9d342beee0d5fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:42:42 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-41c25fee-b956-4d43-9d3e-1346cf7c2960 tempest-TestMinimumBasicScenario-596633662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (584c2390-cd23-46bb-bc9e-68f6174741fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:42:42 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-41c25fee-b956-4d43-9d3e-1346cf7c2960 tempest-TestMinimumBasicScenario-596633662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (584c2390-cd23-46bb-bc9e-68f6174741fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:42:42 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-41c25fee-b956-4d43-9d3e-1346cf7c2960 tempest-TestMinimumBasicScenario-596633662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22e470d4-d203-49a4-a547-c837b31543ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:42:42 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-41c25fee-b956-4d43-9d3e-1346cf7c2960 tempest-TestMinimumBasicScenario-596633662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22e470d4-d203-49a4-a547-c837b31543ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '300dcc93-73bc-41c8-a80e-1673383aa69f', 'volume_name': 'volume-300dcc93-73bc-41c8-a80e-1673383aa69f', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:42:42 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-41c25fee-b956-4d43-9d3e-1346cf7c2960 tempest-TestMinimumBasicScenario-596633662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4406a799-fe15-4824-a8ec-e6aead070935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:42:42 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-41c25fee-b956-4d43-9d3e-1346cf7c2960 tempest-TestMinimumBasicScenario-596633662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4406a799-fe15-4824-a8ec-e6aead070935) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:42:42 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-41c25fee-b956-4d43-9d3e-1346cf7c2960 tempest-TestMinimumBasicScenario-596633662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8eea3dd-c078-4885-8e6d-fd8d709eaf7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:42:42 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-41c25fee-b956-4d43-9d3e-1346cf7c2960 tempest-TestMinimumBasicScenario-596633662 None] Volume 300dcc93-73bc-41c8-a80e-1673383aa69f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-300dcc93-73bc-41c8-a80e-1673383aa69f', 'volume_size': 1} Sep 23 14:42:42 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-41c25fee-b956-4d43-9d3e-1346cf7c2960 tempest-TestMinimumBasicScenario-596633662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:42:44 devstack sudo[98257]: pam_unix(sudo:session): session closed for user root Sep 23 14:42:44 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-dc4546e1-3a30-44f9-bf7d-cab7581e6295 tempest-VolumesDeleteCascade-381167990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-444b13a3-3a07-48f8-be7f-2076cea42fa8 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-20669154-0b26-4040-a592-47affcf6811a" returned: 0 in 10.866s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:42:44 devstack cinder-volume[86310]: DEBUG cinder.image.image_utils [None req-dc4546e1-3a30-44f9-bf7d-cab7581e6295 tempest-VolumesDeleteCascade-381167990 None] Image conversion details: src /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-444b13a3-3a07-48f8-be7f-2076cea42fa8, size 1024.00 MB, duration 10.87 sec, destination /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-20669154-0b26-4040-a592-47affcf6811a {{(pid=86310) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 14:42:44 devstack cinder-volume[86310]: INFO cinder.image.image_utils [None req-dc4546e1-3a30-44f9-bf7d-cab7581e6295 tempest-VolumesDeleteCascade-381167990 None] Converted 1024.00 MB image at 94.23 MB/s Sep 23 14:42:44 devstack cinder-volume[86310]: WARNING cinder.volume.drivers.remotefs [None req-dc4546e1-3a30-44f9-bf7d-cab7581e6295 tempest-VolumesDeleteCascade-381167990 None] /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-20669154-0b26-4040-a592-47affcf6811a is being set with open permissions: ugo+rw Sep 23 14:42:44 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-dc4546e1-3a30-44f9-bf7d-cab7581e6295 tempest-VolumesDeleteCascade-381167990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-20669154-0b26-4040-a592-47affcf6811a {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:42:44 devstack sudo[98278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-20669154-0b26-4040-a592-47affcf6811a Sep 23 14:42:44 devstack sudo[98278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:42:45 devstack sudo[98278]: pam_unix(sudo:session): session closed for user root Sep 23 14:42:45 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-dc4546e1-3a30-44f9-bf7d-cab7581e6295 tempest-VolumesDeleteCascade-381167990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-20669154-0b26-4040-a592-47affcf6811a" returned: 0 in 0.291s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:42:45 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-dc4546e1-3a30-44f9-bf7d-cab7581e6295 tempest-VolumesDeleteCascade-381167990 None] Lock "cinder-quobyte-20669154-0b26-4040-a592-47affcf6811a" released by "_copy_volume_from_snapshot" :: held 13.210s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:42:45 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-dc4546e1-3a30-44f9-bf7d-cab7581e6295 tempest-VolumesDeleteCascade-381167990 None] Lock "cinder-quobyte-6f3d1bd4-cf68-40ac-a4f0-d763380f6b21-20669154-0b26-4040-a592-47affcf6811a" released by "_create_volume_from_snapshot" :: held 13.402s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:42:45 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-dc4546e1-3a30-44f9-bf7d-cab7581e6295 tempest-VolumesDeleteCascade-381167990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.420s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:42:45 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-76183bdf-1535-4ae3-aaff-9e12ebc41c1d tempest-TestServerVolumeAttachScenarioOldVersion-347886582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.735s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:42:45 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-76183bdf-1535-4ae3-aaff-9e12ebc41c1d tempest-TestServerVolumeAttachScenarioOldVersion-347886582 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:42:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-591303048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bec2589-cc46-4ff9-bf30-b3346b165374,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c667520504b4f07bd66eec38b6c7234',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:42:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:42:40Z,use_quota=True,user_id='44dd42d235ee47d0a9bfdc46e7661bda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:42:45 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-76183bdf-1535-4ae3-aaff-9e12ebc41c1d tempest-TestServerVolumeAttachScenarioOldVersion-347886582 None] Creating volume 9bec2589-cc46-4ff9-bf30-b3346b165374 {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:42:45 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-76183bdf-1535-4ae3-aaff-9e12ebc41c1d tempest-TestServerVolumeAttachScenarioOldVersion-347886582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:42:45 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-76183bdf-1535-4ae3-aaff-9e12ebc41c1d tempest-TestServerVolumeAttachScenarioOldVersion-347886582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:42:45 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-76183bdf-1535-4ae3-aaff-9e12ebc41c1d tempest-TestServerVolumeAttachScenarioOldVersion-347886582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:42:45 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-76183bdf-1535-4ae3-aaff-9e12ebc41c1d tempest-TestServerVolumeAttachScenarioOldVersion-347886582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:42:45 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-76183bdf-1535-4ae3-aaff-9e12ebc41c1d tempest-TestServerVolumeAttachScenarioOldVersion-347886582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:42:45 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-76183bdf-1535-4ae3-aaff-9e12ebc41c1d tempest-TestServerVolumeAttachScenarioOldVersion-347886582 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:42:45 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-76183bdf-1535-4ae3-aaff-9e12ebc41c1d tempest-TestServerVolumeAttachScenarioOldVersion-347886582 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:42:45 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-76183bdf-1535-4ae3-aaff-9e12ebc41c1d tempest-TestServerVolumeAttachScenarioOldVersion-347886582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-9bec2589-cc46-4ff9-bf30-b3346b165374 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:42:45 devstack sudo[98281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-9bec2589-cc46-4ff9-bf30-b3346b165374 1073741824 Sep 23 14:42:45 devstack sudo[98281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:42:45 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-dc4546e1-3a30-44f9-bf7d-cab7581e6295 tempest-VolumesDeleteCascade-381167990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8f0b7df-69b1-4cbd-a958-b3cf3e57db64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20669154-0b26-4040-a592-47affcf6811a', 'volume_size': 1, 'snapshot_id': '6f3d1bd4-cf68-40ac-a4f0-d763380f6b21'}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:42:45 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-dc4546e1-3a30-44f9-bf7d-cab7581e6295 tempest-VolumesDeleteCascade-381167990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6b9fa86-42ea-4601-820f-185da935eb69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:42:45 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-dc4546e1-3a30-44f9-bf7d-cab7581e6295 tempest-VolumesDeleteCascade-381167990 None] Volume volume-20669154-0b26-4040-a592-47affcf6811a (20669154-0b26-4040-a592-47affcf6811a): created successfully Sep 23 14:42:45 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-dc4546e1-3a30-44f9-bf7d-cab7581e6295 tempest-VolumesDeleteCascade-381167990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6b9fa86-42ea-4601-820f-185da935eb69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:42:45 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-dc4546e1-3a30-44f9-bf7d-cab7581e6295 tempest-VolumesDeleteCascade-381167990 None] Flow 'volume_create_manager' (381409b4-ef8f-48c3-8424-1f38fa1b8e2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:42:45 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-dc4546e1-3a30-44f9-bf7d-cab7581e6295 tempest-VolumesDeleteCascade-381167990 None] Created volume successfully. Sep 23 14:42:45 devstack sudo[98281]: pam_unix(sudo:session): session closed for user root Sep 23 14:42:45 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-76183bdf-1535-4ae3-aaff-9e12ebc41c1d tempest-TestServerVolumeAttachScenarioOldVersion-347886582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-9bec2589-cc46-4ff9-bf30-b3346b165374 1073741824" returned: 0 in 0.656s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:42:46 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-76183bdf-1535-4ae3-aaff-9e12ebc41c1d tempest-TestServerVolumeAttachScenarioOldVersion-347886582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-9bec2589-cc46-4ff9-bf30-b3346b165374 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:42:46 devstack sudo[98287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-9bec2589-cc46-4ff9-bf30-b3346b165374 Sep 23 14:42:46 devstack sudo[98287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:42:46 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-d2d193bd-08d5-4fb3-b0ba-21efa703db1e tempest-VolumesDeleteCascade-381167990 None] Acquiring lock "cinder-444b13a3-3a07-48f8-be7f-2076cea42fa8-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:42:46 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-d2d193bd-08d5-4fb3-b0ba-21efa703db1e tempest-VolumesDeleteCascade-381167990 None] Lock "cinder-444b13a3-3a07-48f8-be7f-2076cea42fa8-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:42:46 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-d2d193bd-08d5-4fb3-b0ba-21efa703db1e tempest-VolumesDeleteCascade-381167990 None] Performing cascade delete. {{(pid=86310) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 23 14:42:46 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-d2d193bd-08d5-4fb3-b0ba-21efa703db1e tempest-VolumesDeleteCascade-381167990 None] Acquiring lock "cinder-6f3d1bd4-cf68-40ac-a4f0-d763380f6b21-delete_snapshot" by "delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:42:46 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-d2d193bd-08d5-4fb3-b0ba-21efa703db1e tempest-VolumesDeleteCascade-381167990 None] Lock "cinder-6f3d1bd4-cf68-40ac-a4f0-d763380f6b21-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:42:46 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-d2d193bd-08d5-4fb3-b0ba-21efa703db1e tempest-VolumesDeleteCascade-381167990 None] Acquiring lock "cinder-quobyte-444b13a3-3a07-48f8-be7f-2076cea42fa8" by "delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:42:46 devstack sudo[98287]: pam_unix(sudo:session): session closed for user root Sep 23 14:42:46 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-76183bdf-1535-4ae3-aaff-9e12ebc41c1d tempest-TestServerVolumeAttachScenarioOldVersion-347886582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-9bec2589-cc46-4ff9-bf30-b3346b165374" returned: 0 in 0.366s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:42:46 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-76183bdf-1535-4ae3-aaff-9e12ebc41c1d tempest-TestServerVolumeAttachScenarioOldVersion-347886582 None] <== create_volume: return (1095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:42:46 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-76183bdf-1535-4ae3-aaff-9e12ebc41c1d tempest-TestServerVolumeAttachScenarioOldVersion-347886582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.104s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:42:46 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-d2d193bd-08d5-4fb3-b0ba-21efa703db1e tempest-VolumesDeleteCascade-381167990 None] Lock "cinder-quobyte-444b13a3-3a07-48f8-be7f-2076cea42fa8" acquired by "delete_snapshot" :: waited 0.046s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:42:46 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-d2d193bd-08d5-4fb3-b0ba-21efa703db1e tempest-VolumesDeleteCascade-381167990 None] Acquiring lock "cinder-quobyte-6f3d1bd4-cf68-40ac-a4f0-d763380f6b21" by "_delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:42:46 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-41c25fee-b956-4d43-9d3e-1346cf7c2960 tempest-TestMinimumBasicScenario-596633662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.009s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:42:46 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-41c25fee-b956-4d43-9d3e-1346cf7c2960 tempest-TestMinimumBasicScenario-596633662 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:42:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-956441231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=300dcc93-73bc-41c8-a80e-1673383aa69f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd953160e78848738e08b936a20e5af4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:42:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:42:42Z,use_quota=True,user_id='53983ac8d77e49e2ac9d342beee0d5fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:42:46 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-41c25fee-b956-4d43-9d3e-1346cf7c2960 tempest-TestMinimumBasicScenario-596633662 None] Creating volume 300dcc93-73bc-41c8-a80e-1673383aa69f {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:42:46 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-41c25fee-b956-4d43-9d3e-1346cf7c2960 tempest-TestMinimumBasicScenario-596633662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:42:46 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-41c25fee-b956-4d43-9d3e-1346cf7c2960 tempest-TestMinimumBasicScenario-596633662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:42:46 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-41c25fee-b956-4d43-9d3e-1346cf7c2960 tempest-TestMinimumBasicScenario-596633662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:42:46 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-41c25fee-b956-4d43-9d3e-1346cf7c2960 tempest-TestMinimumBasicScenario-596633662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:42:46 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-41c25fee-b956-4d43-9d3e-1346cf7c2960 tempest-TestMinimumBasicScenario-596633662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:42:46 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-41c25fee-b956-4d43-9d3e-1346cf7c2960 tempest-TestMinimumBasicScenario-596633662 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:42:46 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-41c25fee-b956-4d43-9d3e-1346cf7c2960 tempest-TestMinimumBasicScenario-596633662 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:42:46 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-41c25fee-b956-4d43-9d3e-1346cf7c2960 tempest-TestMinimumBasicScenario-596633662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-300dcc93-73bc-41c8-a80e-1673383aa69f 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:42:46 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-76183bdf-1535-4ae3-aaff-9e12ebc41c1d tempest-TestServerVolumeAttachScenarioOldVersion-347886582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd469063-53cd-4fcf-91be-04b75173ddd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bec2589-cc46-4ff9-bf30-b3346b165374', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:42:46 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-76183bdf-1535-4ae3-aaff-9e12ebc41c1d tempest-TestServerVolumeAttachScenarioOldVersion-347886582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15b2a300-ba4c-4acb-971f-fe54ef6b4098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:42:46 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-d2d193bd-08d5-4fb3-b0ba-21efa703db1e tempest-VolumesDeleteCascade-381167990 None] Lock "cinder-quobyte-6f3d1bd4-cf68-40ac-a4f0-d763380f6b21" acquired by "_delete_snapshot" :: waited 0.059s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:42:46 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-d2d193bd-08d5-4fb3-b0ba-21efa703db1e tempest-VolumesDeleteCascade-381167990 None] Deleting offline snapshot 6f3d1bd4-cf68-40ac-a4f0-d763380f6b21 of volume 444b13a3-3a07-48f8-be7f-2076cea42fa8 {{(pid=86310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 14:42:46 devstack sudo[98290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-300dcc93-73bc-41c8-a80e-1673383aa69f 1073741824 Sep 23 14:42:46 devstack sudo[98290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:42:46 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-d2d193bd-08d5-4fb3-b0ba-21efa703db1e tempest-VolumesDeleteCascade-381167990 None] snapshot_file for this snap is: volume-444b13a3-3a07-48f8-be7f-2076cea42fa8.6f3d1bd4-cf68-40ac-a4f0-d763380f6b21 {{(pid=86310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 14:42:46 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-76183bdf-1535-4ae3-aaff-9e12ebc41c1d tempest-TestServerVolumeAttachScenarioOldVersion-347886582 None] Volume volume-9bec2589-cc46-4ff9-bf30-b3346b165374 (9bec2589-cc46-4ff9-bf30-b3346b165374): created successfully Sep 23 14:42:46 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-76183bdf-1535-4ae3-aaff-9e12ebc41c1d tempest-TestServerVolumeAttachScenarioOldVersion-347886582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15b2a300-ba4c-4acb-971f-fe54ef6b4098) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:42:46 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-76183bdf-1535-4ae3-aaff-9e12ebc41c1d tempest-TestServerVolumeAttachScenarioOldVersion-347886582 None] Flow 'volume_create_manager' (2634fc5c-545b-4082-8f9c-e124811c6c92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:42:46 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[efd50f2c-9f0e-4fd4-8ad2-fe1bd447bb1d]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:42:46 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d2d193bd-08d5-4fb3-b0ba-21efa703db1e tempest-VolumesDeleteCascade-381167990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-444b13a3-3a07-48f8-be7f-2076cea42fa8.6f3d1bd4-cf68-40ac-a4f0-d763380f6b21 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:42:46 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-76183bdf-1535-4ae3-aaff-9e12ebc41c1d tempest-TestServerVolumeAttachScenarioOldVersion-347886582 None] Created volume successfully. Sep 23 14:42:46 devstack sudo[98292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-444b13a3-3a07-48f8-be7f-2076cea42fa8.6f3d1bd4-cf68-40ac-a4f0-d763380f6b21 Sep 23 14:42:46 devstack sudo[98292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:42:47 devstack sudo[98290]: pam_unix(sudo:session): session closed for user root Sep 23 14:42:47 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-41c25fee-b956-4d43-9d3e-1346cf7c2960 tempest-TestMinimumBasicScenario-596633662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-300dcc93-73bc-41c8-a80e-1673383aa69f 1073741824" returned: 0 in 0.680s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:42:47 devstack sudo[98292]: pam_unix(sudo:session): session closed for user root Sep 23 14:42:47 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d2d193bd-08d5-4fb3-b0ba-21efa703db1e tempest-VolumesDeleteCascade-381167990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-444b13a3-3a07-48f8-be7f-2076cea42fa8.6f3d1bd4-cf68-40ac-a4f0-d763380f6b21" returned: 0 in 0.575s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:42:47 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-d2d193bd-08d5-4fb3-b0ba-21efa703db1e tempest-VolumesDeleteCascade-381167990 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-444b13a3-3a07-48f8-be7f-2076cea42fa8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 14:42:47 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[1630e721-3201-473c-90af-eac2d7a88b3c]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:42:47 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d2d193bd-08d5-4fb3-b0ba-21efa703db1e tempest-VolumesDeleteCascade-381167990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-444b13a3-3a07-48f8-be7f-2076cea42fa8 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:42:47 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-41c25fee-b956-4d43-9d3e-1346cf7c2960 tempest-TestMinimumBasicScenario-596633662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-300dcc93-73bc-41c8-a80e-1673383aa69f {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:42:47 devstack sudo[98303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-300dcc93-73bc-41c8-a80e-1673383aa69f Sep 23 14:42:47 devstack sudo[98303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:42:47 devstack sudo[98302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-444b13a3-3a07-48f8-be7f-2076cea42fa8 Sep 23 14:42:47 devstack sudo[98302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:42:47 devstack sudo[98303]: pam_unix(sudo:session): session closed for user root Sep 23 14:42:47 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-41c25fee-b956-4d43-9d3e-1346cf7c2960 tempest-TestMinimumBasicScenario-596633662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-300dcc93-73bc-41c8-a80e-1673383aa69f" returned: 0 in 0.525s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:42:47 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-41c25fee-b956-4d43-9d3e-1346cf7c2960 tempest-TestMinimumBasicScenario-596633662 None] <== create_volume: return (1304ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:42:47 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-41c25fee-b956-4d43-9d3e-1346cf7c2960 tempest-TestMinimumBasicScenario-596633662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.307s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:42:47 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-41c25fee-b956-4d43-9d3e-1346cf7c2960 tempest-TestMinimumBasicScenario-596633662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8eea3dd-c078-4885-8e6d-fd8d709eaf7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-300dcc93-73bc-41c8-a80e-1673383aa69f', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:42:47 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-41c25fee-b956-4d43-9d3e-1346cf7c2960 tempest-TestMinimumBasicScenario-596633662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e89cdb04-f89e-425f-b0ae-c72a4eedd098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:42:47 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-41c25fee-b956-4d43-9d3e-1346cf7c2960 tempest-TestMinimumBasicScenario-596633662 None] Volume volume-300dcc93-73bc-41c8-a80e-1673383aa69f (300dcc93-73bc-41c8-a80e-1673383aa69f): created successfully Sep 23 14:42:47 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-41c25fee-b956-4d43-9d3e-1346cf7c2960 tempest-TestMinimumBasicScenario-596633662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e89cdb04-f89e-425f-b0ae-c72a4eedd098) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:42:47 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-41c25fee-b956-4d43-9d3e-1346cf7c2960 tempest-TestMinimumBasicScenario-596633662 None] Flow 'volume_create_manager' (b40a1bad-5b56-493c-bd2a-1960bc3cd61c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:42:47 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-41c25fee-b956-4d43-9d3e-1346cf7c2960 tempest-TestMinimumBasicScenario-596633662 None] Created volume successfully. Sep 23 14:42:48 devstack sudo[98302]: pam_unix(sudo:session): session closed for user root Sep 23 14:42:48 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d2d193bd-08d5-4fb3-b0ba-21efa703db1e tempest-VolumesDeleteCascade-381167990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-444b13a3-3a07-48f8-be7f-2076cea42fa8" returned: 0 in 0.915s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:42:48 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d2d193bd-08d5-4fb3-b0ba-21efa703db1e tempest-VolumesDeleteCascade-381167990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-444b13a3-3a07-48f8-be7f-2076cea42fa8.6f3d1bd4-cf68-40ac-a4f0-d763380f6b21 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:42:48 devstack sudo[98330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-444b13a3-3a07-48f8-be7f-2076cea42fa8.6f3d1bd4-cf68-40ac-a4f0-d763380f6b21 Sep 23 14:42:48 devstack sudo[98330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:42:48 devstack sudo[98330]: pam_unix(sudo:session): session closed for user root Sep 23 14:42:48 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d2d193bd-08d5-4fb3-b0ba-21efa703db1e tempest-VolumesDeleteCascade-381167990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-444b13a3-3a07-48f8-be7f-2076cea42fa8.6f3d1bd4-cf68-40ac-a4f0-d763380f6b21" returned: 0 in 0.544s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:42:48 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d2d193bd-08d5-4fb3-b0ba-21efa703db1e tempest-VolumesDeleteCascade-381167990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-444b13a3-3a07-48f8-be7f-2076cea42fa8.6f3d1bd4-cf68-40ac-a4f0-d763380f6b21 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:42:48 devstack sudo[98343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-444b13a3-3a07-48f8-be7f-2076cea42fa8.6f3d1bd4-cf68-40ac-a4f0-d763380f6b21 Sep 23 14:42:48 devstack sudo[98343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:42:48 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [req-50135f2b-d563-466e-b03b-aec550ffcca8 req-73bb026f-75f5-49c3-a235-3bad15849da2 tempest-TestServerVolumeAttachScenarioOldVersion-347886582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:42:48 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [req-50135f2b-d563-466e-b03b-aec550ffcca8 req-73bb026f-75f5-49c3-a235-3bad15849da2 tempest-TestServerVolumeAttachScenarioOldVersion-347886582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:42:48 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [req-50135f2b-d563-466e-b03b-aec550ffcca8 req-73bb026f-75f5-49c3-a235-3bad15849da2 tempest-TestServerVolumeAttachScenarioOldVersion-347886582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:42:48 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [req-50135f2b-d563-466e-b03b-aec550ffcca8 req-73bb026f-75f5-49c3-a235-3bad15849da2 tempest-TestServerVolumeAttachScenarioOldVersion-347886582 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362', 'name': 'volume-9bec2589-cc46-4ff9-bf30-b3346b165374', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f6ef0eb0-df2e-41e6-833e-7cecaeab093c', 'enforce_multipath': True} {{(pid=86310) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 14:42:48 devstack cinder-volume[86310]: INFO cinder.volume.manager [req-50135f2b-d563-466e-b03b-aec550ffcca8 req-73bb026f-75f5-49c3-a235-3bad15849da2 tempest-TestServerVolumeAttachScenarioOldVersion-347886582 None] attachment_update completed successfully. Sep 23 14:42:49 devstack sudo[98343]: pam_unix(sudo:session): session closed for user root Sep 23 14:42:49 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d2d193bd-08d5-4fb3-b0ba-21efa703db1e tempest-VolumesDeleteCascade-381167990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-444b13a3-3a07-48f8-be7f-2076cea42fa8.6f3d1bd4-cf68-40ac-a4f0-d763380f6b21" returned: 0 in 0.377s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:42:49 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-d2d193bd-08d5-4fb3-b0ba-21efa703db1e tempest-VolumesDeleteCascade-381167990 None] Lock "cinder-quobyte-6f3d1bd4-cf68-40ac-a4f0-d763380f6b21" released by "_delete_snapshot" :: held 2.583s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:42:49 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-d2d193bd-08d5-4fb3-b0ba-21efa703db1e tempest-VolumesDeleteCascade-381167990 None] Lock "cinder-quobyte-444b13a3-3a07-48f8-be7f-2076cea42fa8" released by "delete_snapshot" :: held 2.667s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:42:49 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-d2d193bd-08d5-4fb3-b0ba-21efa703db1e tempest-VolumesDeleteCascade-381167990 None] Created reservations ['65c32e28-be62-448f-b036-9a2a4c9026ab', '88ab42be-9b5c-4c3a-92d5-02aee8cecc6b', '0a86e8c7-c285-411c-a8ba-215309e4da4f', '99045a78-a75d-4589-af38-ededd3bf5194'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:42:49 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-d2d193bd-08d5-4fb3-b0ba-21efa703db1e tempest-VolumesDeleteCascade-381167990 None] Delete snapshot completed successfully. Sep 23 14:42:49 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-d2d193bd-08d5-4fb3-b0ba-21efa703db1e tempest-VolumesDeleteCascade-381167990 None] Lock "cinder-6f3d1bd4-cf68-40ac-a4f0-d763380f6b21-delete_snapshot" released by "delete_snapshot" :: held 2.998s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:42:49 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-d2d193bd-08d5-4fb3-b0ba-21efa703db1e tempest-VolumesDeleteCascade-381167990 None] Snapshots deleted, issuing volume delete {{(pid=86310) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 23 14:42:49 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-d2d193bd-08d5-4fb3-b0ba-21efa703db1e tempest-VolumesDeleteCascade-381167990 None] Acquiring lock "cinder-quobyte-444b13a3-3a07-48f8-be7f-2076cea42fa8" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:42:49 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-d2d193bd-08d5-4fb3-b0ba-21efa703db1e tempest-VolumesDeleteCascade-381167990 None] Lock "cinder-quobyte-444b13a3-3a07-48f8-be7f-2076cea42fa8" acquired by "delete_volume" :: waited 0.022s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:42:49 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed3cf153-f33b-4491-99d8-eedbf0ae6e39]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:42:49 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d2d193bd-08d5-4fb3-b0ba-21efa703db1e tempest-VolumesDeleteCascade-381167990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-444b13a3-3a07-48f8-be7f-2076cea42fa8 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:42:49 devstack sudo[98761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-444b13a3-3a07-48f8-be7f-2076cea42fa8 Sep 23 14:42:49 devstack sudo[98761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:42:49 devstack sudo[98761]: pam_unix(sudo:session): session closed for user root Sep 23 14:42:50 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d2d193bd-08d5-4fb3-b0ba-21efa703db1e tempest-VolumesDeleteCascade-381167990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-444b13a3-3a07-48f8-be7f-2076cea42fa8" returned: 0 in 0.547s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:42:50 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d2d193bd-08d5-4fb3-b0ba-21efa703db1e tempest-VolumesDeleteCascade-381167990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-444b13a3-3a07-48f8-be7f-2076cea42fa8 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:42:50 devstack sudo[98776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-444b13a3-3a07-48f8-be7f-2076cea42fa8 Sep 23 14:42:50 devstack sudo[98776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:42:50 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [req-e6593949-b713-4a62-9ff9-26e91a056c15 req-820c02d2-2ca1-4897-877e-004edec92199 tempest-TestMinimumBasicScenario-596633662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:42:50 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [req-e6593949-b713-4a62-9ff9-26e91a056c15 req-820c02d2-2ca1-4897-877e-004edec92199 tempest-TestMinimumBasicScenario-596633662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:42:50 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [req-e6593949-b713-4a62-9ff9-26e91a056c15 req-820c02d2-2ca1-4897-877e-004edec92199 tempest-TestMinimumBasicScenario-596633662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:42:50 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [req-e6593949-b713-4a62-9ff9-26e91a056c15 req-820c02d2-2ca1-4897-877e-004edec92199 tempest-TestMinimumBasicScenario-596633662 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362', 'name': 'volume-300dcc93-73bc-41c8-a80e-1673383aa69f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9fcfc7f2-df53-46c3-8ea5-d18ed8dd6f12', 'enforce_multipath': True} {{(pid=86310) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 14:42:50 devstack cinder-volume[86310]: INFO cinder.volume.manager [req-e6593949-b713-4a62-9ff9-26e91a056c15 req-820c02d2-2ca1-4897-877e-004edec92199 tempest-TestMinimumBasicScenario-596633662 None] attachment_update completed successfully. Sep 23 14:42:50 devstack sudo[98776]: pam_unix(sudo:session): session closed for user root Sep 23 14:42:50 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d2d193bd-08d5-4fb3-b0ba-21efa703db1e tempest-VolumesDeleteCascade-381167990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-444b13a3-3a07-48f8-be7f-2076cea42fa8" returned: 0 in 0.378s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:42:50 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-d2d193bd-08d5-4fb3-b0ba-21efa703db1e tempest-VolumesDeleteCascade-381167990 None] Lock "cinder-quobyte-444b13a3-3a07-48f8-be7f-2076cea42fa8" released by "delete_volume" :: held 1.038s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:42:50 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-d2d193bd-08d5-4fb3-b0ba-21efa703db1e tempest-VolumesDeleteCascade-381167990 None] Created reservations ['0c90d4e3-9bc3-4d81-a21d-325a083f8472', 'e7d0e3cf-5b59-4e26-b098-4b9b7fcaeb4a', 'bf35db7a-f565-4fcd-80fa-dce4c5ace29b', '8ba67757-538d-456e-8a60-1616ae554bcb'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:42:50 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-d2d193bd-08d5-4fb3-b0ba-21efa703db1e tempest-VolumesDeleteCascade-381167990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:42:50 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-d2d193bd-08d5-4fb3-b0ba-21efa703db1e tempest-VolumesDeleteCascade-381167990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:42:50 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-d2d193bd-08d5-4fb3-b0ba-21efa703db1e tempest-VolumesDeleteCascade-381167990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:42:50 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-d2d193bd-08d5-4fb3-b0ba-21efa703db1e tempest-VolumesDeleteCascade-381167990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:42:50 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-d2d193bd-08d5-4fb3-b0ba-21efa703db1e tempest-VolumesDeleteCascade-381167990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:42:50 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d2d193bd-08d5-4fb3-b0ba-21efa703db1e tempest-VolumesDeleteCascade-381167990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:42:50 devstack sudo[98781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:42:50 devstack sudo[98781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:42:50 devstack sudo[98781]: pam_unix(sudo:session): session closed for user root Sep 23 14:42:50 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d2d193bd-08d5-4fb3-b0ba-21efa703db1e tempest-VolumesDeleteCascade-381167990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.401s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:42:50 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-d2d193bd-08d5-4fb3-b0ba-21efa703db1e tempest-VolumesDeleteCascade-381167990 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:42:50 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-d2d193bd-08d5-4fb3-b0ba-21efa703db1e tempest-VolumesDeleteCascade-381167990 None] Deleted volume successfully. Sep 23 14:42:51 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-d2d193bd-08d5-4fb3-b0ba-21efa703db1e tempest-VolumesDeleteCascade-381167990 None] Lock "cinder-444b13a3-3a07-48f8-be7f-2076cea42fa8-delete_volume" released by "delete_volume" :: held 4.809s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:42:51 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-2ad00756-4868-4b65-ab89-93efd883452a tempest-VolumesDeleteCascade-381167990 None] Acquiring lock "cinder-20669154-0b26-4040-a592-47affcf6811a-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:42:51 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-2ad00756-4868-4b65-ab89-93efd883452a tempest-VolumesDeleteCascade-381167990 None] Lock "cinder-20669154-0b26-4040-a592-47affcf6811a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:42:51 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-2ad00756-4868-4b65-ab89-93efd883452a tempest-VolumesDeleteCascade-381167990 None] Acquiring lock "cinder-quobyte-20669154-0b26-4040-a592-47affcf6811a" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:42:51 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-2ad00756-4868-4b65-ab89-93efd883452a tempest-VolumesDeleteCascade-381167990 None] Lock "cinder-quobyte-20669154-0b26-4040-a592-47affcf6811a" acquired by "delete_volume" :: waited 0.018s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:42:51 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[46dd7963-96ea-4a1f-ac0f-8e4822a1d18a]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:42:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-2ad00756-4868-4b65-ab89-93efd883452a tempest-VolumesDeleteCascade-381167990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-20669154-0b26-4040-a592-47affcf6811a {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:42:51 devstack sudo[98784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-20669154-0b26-4040-a592-47affcf6811a Sep 23 14:42:51 devstack sudo[98784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:42:51 devstack cinder-volume[86310]: DEBUG oslo_service.periodic_task [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86310) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 14:42:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:42:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:42:51 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:42:51 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:42:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:42:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:42:51 devstack sudo[98786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:42:51 devstack sudo[98786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:42:51 devstack sudo[98784]: pam_unix(sudo:session): session closed for user root Sep 23 14:42:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-2ad00756-4868-4b65-ab89-93efd883452a tempest-VolumesDeleteCascade-381167990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-20669154-0b26-4040-a592-47affcf6811a" returned: 0 in 0.452s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:42:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-2ad00756-4868-4b65-ab89-93efd883452a tempest-VolumesDeleteCascade-381167990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-20669154-0b26-4040-a592-47affcf6811a {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:42:51 devstack sudo[98791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-20669154-0b26-4040-a592-47affcf6811a Sep 23 14:42:51 devstack sudo[98791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:42:51 devstack sudo[98786]: pam_unix(sudo:session): session closed for user root Sep 23 14:42:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.400s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:42:51 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:42:51 devstack cinder-volume[86310]: DEBUG oslo_service.periodic_task [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Running periodic task VolumeManager._thread_info {{(pid=86310) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 14:42:51 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] thread count: 28 {{(pid=86310) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 14:42:51 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] thread info: [<_MainThread(MainThread, started 128854208852096)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86310) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 14:42:52 devstack sudo[98791]: pam_unix(sudo:session): session closed for user root Sep 23 14:42:52 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-2ad00756-4868-4b65-ab89-93efd883452a tempest-VolumesDeleteCascade-381167990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-20669154-0b26-4040-a592-47affcf6811a" returned: 0 in 0.386s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:42:52 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-2ad00756-4868-4b65-ab89-93efd883452a tempest-VolumesDeleteCascade-381167990 None] Lock "cinder-quobyte-20669154-0b26-4040-a592-47affcf6811a" released by "delete_volume" :: held 0.898s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:42:52 devstack cinder-volume[86310]: DEBUG dbcounter [-] [86310] Writing DB stats cinder:UPDATE=98,cinder:SELECT=98,cinder:DELETE=10,cinder:INSERT=27 {{(pid=86310) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 14:42:52 devstack cinder-volume[86310]: DEBUG dbcounter [-] [86310] Writing DB stats cinder:UPDATE=118,cinder:INSERT=24,cinder:SELECT=91,cinder:DELETE=9 {{(pid=86310) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 14:42:52 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-2ad00756-4868-4b65-ab89-93efd883452a tempest-VolumesDeleteCascade-381167990 None] Created reservations ['ddc19c7c-8e1e-4824-9cd7-2c9228e0680a', '37509d6a-2487-4269-8a55-410384debfbf', 'd0c4333a-d568-4973-a501-845ca64227e5', '5c640aa9-6879-44b1-8293-8d3d63a2965f'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:42:52 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-2ad00756-4868-4b65-ab89-93efd883452a tempest-VolumesDeleteCascade-381167990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:42:52 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-2ad00756-4868-4b65-ab89-93efd883452a tempest-VolumesDeleteCascade-381167990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:42:52 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-2ad00756-4868-4b65-ab89-93efd883452a tempest-VolumesDeleteCascade-381167990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:42:52 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-2ad00756-4868-4b65-ab89-93efd883452a tempest-VolumesDeleteCascade-381167990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:42:52 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-2ad00756-4868-4b65-ab89-93efd883452a tempest-VolumesDeleteCascade-381167990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:42:52 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-2ad00756-4868-4b65-ab89-93efd883452a tempest-VolumesDeleteCascade-381167990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:42:52 devstack sudo[98796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:42:52 devstack sudo[98796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:42:52 devstack sudo[98796]: pam_unix(sudo:session): session closed for user root Sep 23 14:42:52 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-2ad00756-4868-4b65-ab89-93efd883452a tempest-VolumesDeleteCascade-381167990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.505s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:42:52 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-2ad00756-4868-4b65-ab89-93efd883452a tempest-VolumesDeleteCascade-381167990 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:42:52 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-2ad00756-4868-4b65-ab89-93efd883452a tempest-VolumesDeleteCascade-381167990 None] Deleted volume successfully. Sep 23 14:42:52 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-2ad00756-4868-4b65-ab89-93efd883452a tempest-VolumesDeleteCascade-381167990 None] Lock "cinder-20669154-0b26-4040-a592-47affcf6811a-delete_volume" released by "delete_volume" :: held 1.801s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:42:52 devstack cinder-volume[86310]: INFO cinder.volume.manager [req-4b59e08f-da28-477b-8a95-917fc0617e3a req-964bb533-114e-41e7-a927-f7e04564aab6 tempest-TestServerVolumeAttachScenarioOldVersion-347886582 None] Terminate volume connection completed successfully. Sep 23 14:42:52 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [req-4b59e08f-da28-477b-8a95-917fc0617e3a req-964bb533-114e-41e7-a927-f7e04564aab6 tempest-TestServerVolumeAttachScenarioOldVersion-347886582 None] Deleting attachment f6ef0eb0-df2e-41e6-833e-7cecaeab093c. {{(pid=86310) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 14:42:53 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-586944fd-6c0f-4023-bfda-359b5db1b9f4 tempest-TestServerVolumeAttachScenarioOldVersion-347886582 None] Acquiring lock "cinder-9bec2589-cc46-4ff9-bf30-b3346b165374-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:42:53 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-586944fd-6c0f-4023-bfda-359b5db1b9f4 tempest-TestServerVolumeAttachScenarioOldVersion-347886582 None] Lock "cinder-9bec2589-cc46-4ff9-bf30-b3346b165374-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:42:54 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-586944fd-6c0f-4023-bfda-359b5db1b9f4 tempest-TestServerVolumeAttachScenarioOldVersion-347886582 None] Acquiring lock "cinder-quobyte-9bec2589-cc46-4ff9-bf30-b3346b165374" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:42:54 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-586944fd-6c0f-4023-bfda-359b5db1b9f4 tempest-TestServerVolumeAttachScenarioOldVersion-347886582 None] Lock "cinder-quobyte-9bec2589-cc46-4ff9-bf30-b3346b165374" acquired by "delete_volume" :: waited 0.026s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:42:54 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e3a9350-7cfe-4137-b230-b65f297e528a]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:42:54 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-586944fd-6c0f-4023-bfda-359b5db1b9f4 tempest-TestServerVolumeAttachScenarioOldVersion-347886582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-9bec2589-cc46-4ff9-bf30-b3346b165374 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:42:54 devstack sudo[98801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-9bec2589-cc46-4ff9-bf30-b3346b165374 Sep 23 14:42:54 devstack sudo[98801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:42:54 devstack sudo[98801]: pam_unix(sudo:session): session closed for user root Sep 23 14:42:54 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-586944fd-6c0f-4023-bfda-359b5db1b9f4 tempest-TestServerVolumeAttachScenarioOldVersion-347886582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-9bec2589-cc46-4ff9-bf30-b3346b165374" returned: 0 in 0.508s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:42:54 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-586944fd-6c0f-4023-bfda-359b5db1b9f4 tempest-TestServerVolumeAttachScenarioOldVersion-347886582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-9bec2589-cc46-4ff9-bf30-b3346b165374 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:42:54 devstack sudo[98806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-9bec2589-cc46-4ff9-bf30-b3346b165374 Sep 23 14:42:54 devstack sudo[98806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:42:54 devstack sudo[98806]: pam_unix(sudo:session): session closed for user root Sep 23 14:42:54 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-586944fd-6c0f-4023-bfda-359b5db1b9f4 tempest-TestServerVolumeAttachScenarioOldVersion-347886582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-9bec2589-cc46-4ff9-bf30-b3346b165374" returned: 0 in 0.352s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:42:54 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-586944fd-6c0f-4023-bfda-359b5db1b9f4 tempest-TestServerVolumeAttachScenarioOldVersion-347886582 None] Lock "cinder-quobyte-9bec2589-cc46-4ff9-bf30-b3346b165374" released by "delete_volume" :: held 0.921s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:42:55 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-586944fd-6c0f-4023-bfda-359b5db1b9f4 tempest-TestServerVolumeAttachScenarioOldVersion-347886582 None] Created reservations ['faa42e48-58b2-49e2-8ee0-a2ef79164184', '61d3c189-86a7-44aa-aaf7-4814bd007bc1', '21b31356-6230-4fd4-8d46-3a44087514f6', '7c24d3f1-6f01-4491-ba41-b135afeb62fb'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:42:55 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-586944fd-6c0f-4023-bfda-359b5db1b9f4 tempest-TestServerVolumeAttachScenarioOldVersion-347886582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:42:55 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-586944fd-6c0f-4023-bfda-359b5db1b9f4 tempest-TestServerVolumeAttachScenarioOldVersion-347886582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:42:55 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-586944fd-6c0f-4023-bfda-359b5db1b9f4 tempest-TestServerVolumeAttachScenarioOldVersion-347886582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:42:55 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-586944fd-6c0f-4023-bfda-359b5db1b9f4 tempest-TestServerVolumeAttachScenarioOldVersion-347886582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:42:55 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-586944fd-6c0f-4023-bfda-359b5db1b9f4 tempest-TestServerVolumeAttachScenarioOldVersion-347886582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:42:55 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-586944fd-6c0f-4023-bfda-359b5db1b9f4 tempest-TestServerVolumeAttachScenarioOldVersion-347886582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:42:55 devstack sudo[98809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:42:55 devstack sudo[98809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:42:55 devstack sudo[98809]: pam_unix(sudo:session): session closed for user root Sep 23 14:42:55 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-586944fd-6c0f-4023-bfda-359b5db1b9f4 tempest-TestServerVolumeAttachScenarioOldVersion-347886582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.525s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:42:55 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-586944fd-6c0f-4023-bfda-359b5db1b9f4 tempest-TestServerVolumeAttachScenarioOldVersion-347886582 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:42:55 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-586944fd-6c0f-4023-bfda-359b5db1b9f4 tempest-TestServerVolumeAttachScenarioOldVersion-347886582 None] Deleted volume successfully. Sep 23 14:42:55 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-586944fd-6c0f-4023-bfda-359b5db1b9f4 tempest-TestServerVolumeAttachScenarioOldVersion-347886582 None] Lock "cinder-9bec2589-cc46-4ff9-bf30-b3346b165374-delete_volume" released by "delete_volume" :: held 1.797s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:42:56 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2c69705-acb2-42a2-80a9-b2e7c2c4b661 tempest-VolumesSnapshotTestJSON-2026192373 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:42:56 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-c2c69705-acb2-42a2-80a9-b2e7c2c4b661 tempest-VolumesSnapshotTestJSON-2026192373 None] Flow 'volume_create_manager' (ec383560-f5a0-4947-8788-2b535059f987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:42:56 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-c2c69705-acb2-42a2-80a9-b2e7c2c4b661 tempest-VolumesSnapshotTestJSON-2026192373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3a9f32c-6f20-4060-a06a-bf5a9f86e0a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:42:56 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-c2c69705-acb2-42a2-80a9-b2e7c2c4b661 tempest-VolumesSnapshotTestJSON-2026192373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3a9f32c-6f20-4060-a06a-bf5a9f86e0a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:42:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1643333526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89074cb5-5a6e-47bb-9cd8-b9049d7cc04a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc37b3f0f14743f98ec5678b6b1d8d57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:42:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:42:57Z,use_quota=True,user_id='2befd5b4c0e64f129ca6768bb143e6ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:42:56 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-c2c69705-acb2-42a2-80a9-b2e7c2c4b661 tempest-VolumesSnapshotTestJSON-2026192373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (095877e2-97bf-4f40-97ec-9179c567b326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:42:56 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-c2c69705-acb2-42a2-80a9-b2e7c2c4b661 tempest-VolumesSnapshotTestJSON-2026192373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (095877e2-97bf-4f40-97ec-9179c567b326) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:42:56 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-c2c69705-acb2-42a2-80a9-b2e7c2c4b661 tempest-VolumesSnapshotTestJSON-2026192373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de6deb35-4164-4995-b6dc-0ddb8c4c426a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:42:56 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-c2c69705-acb2-42a2-80a9-b2e7c2c4b661 tempest-VolumesSnapshotTestJSON-2026192373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de6deb35-4164-4995-b6dc-0ddb8c4c426a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89074cb5-5a6e-47bb-9cd8-b9049d7cc04a', 'volume_name': 'volume-89074cb5-5a6e-47bb-9cd8-b9049d7cc04a', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:42:56 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-c2c69705-acb2-42a2-80a9-b2e7c2c4b661 tempest-VolumesSnapshotTestJSON-2026192373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3993a4db-b251-440c-a0ec-697bb4552981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:42:56 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-c2c69705-acb2-42a2-80a9-b2e7c2c4b661 tempest-VolumesSnapshotTestJSON-2026192373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3993a4db-b251-440c-a0ec-697bb4552981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:42:56 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-c2c69705-acb2-42a2-80a9-b2e7c2c4b661 tempest-VolumesSnapshotTestJSON-2026192373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (961ec0e5-b8a6-4421-8a77-4d6d7485af2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:42:56 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-c2c69705-acb2-42a2-80a9-b2e7c2c4b661 tempest-VolumesSnapshotTestJSON-2026192373 None] Volume 89074cb5-5a6e-47bb-9cd8-b9049d7cc04a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89074cb5-5a6e-47bb-9cd8-b9049d7cc04a', 'volume_size': 1} Sep 23 14:42:56 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-c2c69705-acb2-42a2-80a9-b2e7c2c4b661 tempest-VolumesSnapshotTestJSON-2026192373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:42:56 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-c2c69705-acb2-42a2-80a9-b2e7c2c4b661 tempest-VolumesSnapshotTestJSON-2026192373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:42:56 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-c2c69705-acb2-42a2-80a9-b2e7c2c4b661 tempest-VolumesSnapshotTestJSON-2026192373 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:42:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1643333526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89074cb5-5a6e-47bb-9cd8-b9049d7cc04a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc37b3f0f14743f98ec5678b6b1d8d57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:42:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:42:57Z,use_quota=True,user_id='2befd5b4c0e64f129ca6768bb143e6ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:42:56 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-c2c69705-acb2-42a2-80a9-b2e7c2c4b661 tempest-VolumesSnapshotTestJSON-2026192373 None] Creating volume 89074cb5-5a6e-47bb-9cd8-b9049d7cc04a {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:42:56 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-c2c69705-acb2-42a2-80a9-b2e7c2c4b661 tempest-VolumesSnapshotTestJSON-2026192373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:42:56 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-c2c69705-acb2-42a2-80a9-b2e7c2c4b661 tempest-VolumesSnapshotTestJSON-2026192373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:42:56 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-c2c69705-acb2-42a2-80a9-b2e7c2c4b661 tempest-VolumesSnapshotTestJSON-2026192373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:42:57 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-c2c69705-acb2-42a2-80a9-b2e7c2c4b661 tempest-VolumesSnapshotTestJSON-2026192373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:42:57 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-c2c69705-acb2-42a2-80a9-b2e7c2c4b661 tempest-VolumesSnapshotTestJSON-2026192373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:42:57 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-c2c69705-acb2-42a2-80a9-b2e7c2c4b661 tempest-VolumesSnapshotTestJSON-2026192373 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:42:57 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-c2c69705-acb2-42a2-80a9-b2e7c2c4b661 tempest-VolumesSnapshotTestJSON-2026192373 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:42:57 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-c2c69705-acb2-42a2-80a9-b2e7c2c4b661 tempest-VolumesSnapshotTestJSON-2026192373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-89074cb5-5a6e-47bb-9cd8-b9049d7cc04a 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:42:57 devstack sudo[98833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-89074cb5-5a6e-47bb-9cd8-b9049d7cc04a 1073741824 Sep 23 14:42:57 devstack sudo[98833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:42:57 devstack sudo[98833]: pam_unix(sudo:session): session closed for user root Sep 23 14:42:57 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-c2c69705-acb2-42a2-80a9-b2e7c2c4b661 tempest-VolumesSnapshotTestJSON-2026192373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-89074cb5-5a6e-47bb-9cd8-b9049d7cc04a 1073741824" returned: 0 in 0.790s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:42:57 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-c2c69705-acb2-42a2-80a9-b2e7c2c4b661 tempest-VolumesSnapshotTestJSON-2026192373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-89074cb5-5a6e-47bb-9cd8-b9049d7cc04a {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:42:57 devstack sudo[98847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-89074cb5-5a6e-47bb-9cd8-b9049d7cc04a Sep 23 14:42:57 devstack sudo[98847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:42:58 devstack sudo[98847]: pam_unix(sudo:session): session closed for user root Sep 23 14:42:58 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-c2c69705-acb2-42a2-80a9-b2e7c2c4b661 tempest-VolumesSnapshotTestJSON-2026192373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-89074cb5-5a6e-47bb-9cd8-b9049d7cc04a" returned: 0 in 0.480s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:42:58 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-c2c69705-acb2-42a2-80a9-b2e7c2c4b661 tempest-VolumesSnapshotTestJSON-2026192373 None] <== create_volume: return (1373ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:42:58 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-c2c69705-acb2-42a2-80a9-b2e7c2c4b661 tempest-VolumesSnapshotTestJSON-2026192373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.375s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:42:58 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-c2c69705-acb2-42a2-80a9-b2e7c2c4b661 tempest-VolumesSnapshotTestJSON-2026192373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (961ec0e5-b8a6-4421-8a77-4d6d7485af2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89074cb5-5a6e-47bb-9cd8-b9049d7cc04a', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:42:58 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-c2c69705-acb2-42a2-80a9-b2e7c2c4b661 tempest-VolumesSnapshotTestJSON-2026192373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c40d1a80-38ac-4be3-aeac-61f445ad1402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:42:58 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-c2c69705-acb2-42a2-80a9-b2e7c2c4b661 tempest-VolumesSnapshotTestJSON-2026192373 None] Volume volume-89074cb5-5a6e-47bb-9cd8-b9049d7cc04a (89074cb5-5a6e-47bb-9cd8-b9049d7cc04a): created successfully Sep 23 14:42:58 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-c2c69705-acb2-42a2-80a9-b2e7c2c4b661 tempest-VolumesSnapshotTestJSON-2026192373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c40d1a80-38ac-4be3-aeac-61f445ad1402) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:42:58 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-c2c69705-acb2-42a2-80a9-b2e7c2c4b661 tempest-VolumesSnapshotTestJSON-2026192373 None] Flow 'volume_create_manager' (ec383560-f5a0-4947-8788-2b535059f987) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:42:58 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-c2c69705-acb2-42a2-80a9-b2e7c2c4b661 tempest-VolumesSnapshotTestJSON-2026192373 None] Created volume successfully. Sep 23 14:42:59 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-be9a0835-28c0-4a8b-9134-97c3d27e8255 tempest-VolumesSnapshotTestJSON-2026192373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:42:59 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-be9a0835-28c0-4a8b-9134-97c3d27e8255 tempest-VolumesSnapshotTestJSON-2026192373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:42:59 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-be9a0835-28c0-4a8b-9134-97c3d27e8255 tempest-VolumesSnapshotTestJSON-2026192373 None] Creating offline snapshot 0d36c42d-cfb8-4a02-921e-b66f13f41131 of volume 89074cb5-5a6e-47bb-9cd8-b9049d7cc04a {{(pid=86310) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 14:42:59 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[10de89e9-2a8e-4894-b615-ea902194baba]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:42:59 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-be9a0835-28c0-4a8b-9134-97c3d27e8255 tempest-VolumesSnapshotTestJSON-2026192373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-89074cb5-5a6e-47bb-9cd8-b9049d7cc04a {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:43:00 devstack sudo[98853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-89074cb5-5a6e-47bb-9cd8-b9049d7cc04a Sep 23 14:43:00 devstack sudo[98853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:43:00 devstack sudo[98853]: pam_unix(sudo:session): session closed for user root Sep 23 14:43:00 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-be9a0835-28c0-4a8b-9134-97c3d27e8255 tempest-VolumesSnapshotTestJSON-2026192373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-89074cb5-5a6e-47bb-9cd8-b9049d7cc04a" returned: 0 in 0.523s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:43:00 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-be9a0835-28c0-4a8b-9134-97c3d27e8255 tempest-VolumesSnapshotTestJSON-2026192373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-89074cb5-5a6e-47bb-9cd8-b9049d7cc04a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-89074cb5-5a6e-47bb-9cd8-b9049d7cc04a.0d36c42d-cfb8-4a02-921e-b66f13f41131 1G {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:43:00 devstack sudo[98858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-89074cb5-5a6e-47bb-9cd8-b9049d7cc04a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-89074cb5-5a6e-47bb-9cd8-b9049d7cc04a.0d36c42d-cfb8-4a02-921e-b66f13f41131 1G Sep 23 14:43:00 devstack sudo[98858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:43:01 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c4e7caf-0e67-4ea0-92e4-c8c20b093738 tempest-VolumesTransfersV357Test-87851659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:43:01 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-2c4e7caf-0e67-4ea0-92e4-c8c20b093738 tempest-VolumesTransfersV357Test-87851659 None] Flow 'volume_create_manager' (fc238251-710e-47c9-9bda-66eb6271b71e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:43:01 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-2c4e7caf-0e67-4ea0-92e4-c8c20b093738 tempest-VolumesTransfersV357Test-87851659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (084dd24c-5fcf-4233-8981-de2ef1e0cc01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:43:01 devstack sudo[98858]: pam_unix(sudo:session): session closed for user root Sep 23 14:43:01 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-2c4e7caf-0e67-4ea0-92e4-c8c20b093738 tempest-VolumesTransfersV357Test-87851659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (084dd24c-5fcf-4233-8981-de2ef1e0cc01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:43:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1381714838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70fe1679-0759-4a57-8435-e9fb2b18ff1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e886ee8bddce412c851d636d6ea9b6e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:43:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:43:01Z,use_quota=True,user_id='a1f1cf88262f45ab8aad8c145bdbd12c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:43:01 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-2c4e7caf-0e67-4ea0-92e4-c8c20b093738 tempest-VolumesTransfersV357Test-87851659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dda2684e-2fa5-4826-8a70-ecbd865add47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:43:01 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-2c4e7caf-0e67-4ea0-92e4-c8c20b093738 tempest-VolumesTransfersV357Test-87851659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dda2684e-2fa5-4826-8a70-ecbd865add47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:43:01 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-2c4e7caf-0e67-4ea0-92e4-c8c20b093738 tempest-VolumesTransfersV357Test-87851659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33a568c4-b4e5-4bca-9216-e255d6494787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:43:01 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-2c4e7caf-0e67-4ea0-92e4-c8c20b093738 tempest-VolumesTransfersV357Test-87851659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33a568c4-b4e5-4bca-9216-e255d6494787) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70fe1679-0759-4a57-8435-e9fb2b18ff1e', 'volume_name': 'volume-70fe1679-0759-4a57-8435-e9fb2b18ff1e', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:43:01 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-2c4e7caf-0e67-4ea0-92e4-c8c20b093738 tempest-VolumesTransfersV357Test-87851659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d791618f-b19b-46a6-8e0b-ce957f5ebb36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:43:01 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-2c4e7caf-0e67-4ea0-92e4-c8c20b093738 tempest-VolumesTransfersV357Test-87851659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d791618f-b19b-46a6-8e0b-ce957f5ebb36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:43:01 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-2c4e7caf-0e67-4ea0-92e4-c8c20b093738 tempest-VolumesTransfersV357Test-87851659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b281a0f-7629-4664-8f11-306c9ce791cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:43:01 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-2c4e7caf-0e67-4ea0-92e4-c8c20b093738 tempest-VolumesTransfersV357Test-87851659 None] Volume 70fe1679-0759-4a57-8435-e9fb2b18ff1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70fe1679-0759-4a57-8435-e9fb2b18ff1e', 'volume_size': 1} Sep 23 14:43:01 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-2c4e7caf-0e67-4ea0-92e4-c8c20b093738 tempest-VolumesTransfersV357Test-87851659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:43:01 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-be9a0835-28c0-4a8b-9134-97c3d27e8255 tempest-VolumesSnapshotTestJSON-2026192373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-89074cb5-5a6e-47bb-9cd8-b9049d7cc04a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-89074cb5-5a6e-47bb-9cd8-b9049d7cc04a.0d36c42d-cfb8-4a02-921e-b66f13f41131 1G" returned: 0 in 0.710s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:43:01 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-be9a0835-28c0-4a8b-9134-97c3d27e8255 tempest-VolumesSnapshotTestJSON-2026192373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89074cb5-5a6e-47bb-9cd8-b9049d7cc04a -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-89074cb5-5a6e-47bb-9cd8-b9049d7cc04a.0d36c42d-cfb8-4a02-921e-b66f13f41131 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:43:01 devstack sudo[98864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89074cb5-5a6e-47bb-9cd8-b9049d7cc04a -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-89074cb5-5a6e-47bb-9cd8-b9049d7cc04a.0d36c42d-cfb8-4a02-921e-b66f13f41131 Sep 23 14:43:01 devstack sudo[98864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:43:01 devstack sudo[98864]: pam_unix(sudo:session): session closed for user root Sep 23 14:43:01 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-be9a0835-28c0-4a8b-9134-97c3d27e8255 tempest-VolumesSnapshotTestJSON-2026192373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89074cb5-5a6e-47bb-9cd8-b9049d7cc04a -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-89074cb5-5a6e-47bb-9cd8-b9049d7cc04a.0d36c42d-cfb8-4a02-921e-b66f13f41131" returned: 0 in 0.350s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:43:01 devstack cinder-volume[86310]: WARNING cinder.volume.drivers.remotefs [None req-be9a0835-28c0-4a8b-9134-97c3d27e8255 tempest-VolumesSnapshotTestJSON-2026192373 None] /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-89074cb5-5a6e-47bb-9cd8-b9049d7cc04a.0d36c42d-cfb8-4a02-921e-b66f13f41131 is being set with open permissions: ugo+rw Sep 23 14:43:01 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-be9a0835-28c0-4a8b-9134-97c3d27e8255 tempest-VolumesSnapshotTestJSON-2026192373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-89074cb5-5a6e-47bb-9cd8-b9049d7cc04a.0d36c42d-cfb8-4a02-921e-b66f13f41131 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:43:01 devstack sudo[98869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-89074cb5-5a6e-47bb-9cd8-b9049d7cc04a.0d36c42d-cfb8-4a02-921e-b66f13f41131 Sep 23 14:43:01 devstack sudo[98869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:43:01 devstack sudo[98869]: pam_unix(sudo:session): session closed for user root Sep 23 14:43:01 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-be9a0835-28c0-4a8b-9134-97c3d27e8255 tempest-VolumesSnapshotTestJSON-2026192373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-89074cb5-5a6e-47bb-9cd8-b9049d7cc04a.0d36c42d-cfb8-4a02-921e-b66f13f41131" returned: 0 in 0.316s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:43:01 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-be9a0835-28c0-4a8b-9134-97c3d27e8255 tempest-VolumesSnapshotTestJSON-2026192373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-89074cb5-5a6e-47bb-9cd8-b9049d7cc04a.info {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:43:01 devstack sudo[98872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-89074cb5-5a6e-47bb-9cd8-b9049d7cc04a.info Sep 23 14:43:01 devstack sudo[98872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:43:02 devstack sudo[98872]: pam_unix(sudo:session): session closed for user root Sep 23 14:43:02 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-be9a0835-28c0-4a8b-9134-97c3d27e8255 tempest-VolumesSnapshotTestJSON-2026192373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-89074cb5-5a6e-47bb-9cd8-b9049d7cc04a.info" returned: 0 in 0.278s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:43:02 devstack cinder-volume[86310]: WARNING cinder.volume.drivers.remotefs [None req-be9a0835-28c0-4a8b-9134-97c3d27e8255 tempest-VolumesSnapshotTestJSON-2026192373 None] /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-89074cb5-5a6e-47bb-9cd8-b9049d7cc04a.info is being set with open permissions: ugo+rw Sep 23 14:43:02 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-be9a0835-28c0-4a8b-9134-97c3d27e8255 tempest-VolumesSnapshotTestJSON-2026192373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-89074cb5-5a6e-47bb-9cd8-b9049d7cc04a.info {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:43:02 devstack sudo[98875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-89074cb5-5a6e-47bb-9cd8-b9049d7cc04a.info Sep 23 14:43:02 devstack sudo[98875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:43:02 devstack sudo[98875]: pam_unix(sudo:session): session closed for user root Sep 23 14:43:02 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-be9a0835-28c0-4a8b-9134-97c3d27e8255 tempest-VolumesSnapshotTestJSON-2026192373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-89074cb5-5a6e-47bb-9cd8-b9049d7cc04a.info" returned: 0 in 0.340s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:43:02 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-be9a0835-28c0-4a8b-9134-97c3d27e8255 tempest-VolumesSnapshotTestJSON-2026192373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.652s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:43:02 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-2c4e7caf-0e67-4ea0-92e4-c8c20b093738 tempest-VolumesTransfersV357Test-87851659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.380s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:43:02 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-2c4e7caf-0e67-4ea0-92e4-c8c20b093738 tempest-VolumesTransfersV357Test-87851659 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:43:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1381714838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70fe1679-0759-4a57-8435-e9fb2b18ff1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e886ee8bddce412c851d636d6ea9b6e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:43:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:43:01Z,use_quota=True,user_id='a1f1cf88262f45ab8aad8c145bdbd12c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:43:02 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-2c4e7caf-0e67-4ea0-92e4-c8c20b093738 tempest-VolumesTransfersV357Test-87851659 None] Creating volume 70fe1679-0759-4a57-8435-e9fb2b18ff1e {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:43:02 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-2c4e7caf-0e67-4ea0-92e4-c8c20b093738 tempest-VolumesTransfersV357Test-87851659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:43:02 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-2c4e7caf-0e67-4ea0-92e4-c8c20b093738 tempest-VolumesTransfersV357Test-87851659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:43:02 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-2c4e7caf-0e67-4ea0-92e4-c8c20b093738 tempest-VolumesTransfersV357Test-87851659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:43:02 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-2c4e7caf-0e67-4ea0-92e4-c8c20b093738 tempest-VolumesTransfersV357Test-87851659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:43:02 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-2c4e7caf-0e67-4ea0-92e4-c8c20b093738 tempest-VolumesTransfersV357Test-87851659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:43:02 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-2c4e7caf-0e67-4ea0-92e4-c8c20b093738 tempest-VolumesTransfersV357Test-87851659 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:43:02 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-2c4e7caf-0e67-4ea0-92e4-c8c20b093738 tempest-VolumesTransfersV357Test-87851659 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:43:02 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-2c4e7caf-0e67-4ea0-92e4-c8c20b093738 tempest-VolumesTransfersV357Test-87851659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-70fe1679-0759-4a57-8435-e9fb2b18ff1e 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:43:02 devstack sudo[98880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-70fe1679-0759-4a57-8435-e9fb2b18ff1e 1073741824 Sep 23 14:43:02 devstack sudo[98880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:43:02 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-be9a0835-28c0-4a8b-9134-97c3d27e8255 tempest-VolumesSnapshotTestJSON-2026192373 None] Create snapshot completed successfully Sep 23 14:43:03 devstack sudo[98880]: pam_unix(sudo:session): session closed for user root Sep 23 14:43:03 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-2c4e7caf-0e67-4ea0-92e4-c8c20b093738 tempest-VolumesTransfersV357Test-87851659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-70fe1679-0759-4a57-8435-e9fb2b18ff1e 1073741824" returned: 0 in 0.668s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:43:03 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-1644d328-7cb3-4136-802d-ed07466ad016 tempest-VolumesSnapshotTestJSON-2026192373 None] Acquiring lock "cinder-0d36c42d-cfb8-4a02-921e-b66f13f41131-delete_snapshot" by "delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:43:03 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-2c4e7caf-0e67-4ea0-92e4-c8c20b093738 tempest-VolumesTransfersV357Test-87851659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-70fe1679-0759-4a57-8435-e9fb2b18ff1e {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:43:03 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-1644d328-7cb3-4136-802d-ed07466ad016 tempest-VolumesSnapshotTestJSON-2026192373 None] Lock "cinder-0d36c42d-cfb8-4a02-921e-b66f13f41131-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:43:03 devstack sudo[98889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-70fe1679-0759-4a57-8435-e9fb2b18ff1e Sep 23 14:43:03 devstack sudo[98889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:43:03 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-1644d328-7cb3-4136-802d-ed07466ad016 tempest-VolumesSnapshotTestJSON-2026192373 None] Acquiring lock "cinder-quobyte-89074cb5-5a6e-47bb-9cd8-b9049d7cc04a" by "delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:43:03 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-1644d328-7cb3-4136-802d-ed07466ad016 tempest-VolumesSnapshotTestJSON-2026192373 None] Lock "cinder-quobyte-89074cb5-5a6e-47bb-9cd8-b9049d7cc04a" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:43:03 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-1644d328-7cb3-4136-802d-ed07466ad016 tempest-VolumesSnapshotTestJSON-2026192373 None] Acquiring lock "cinder-quobyte-0d36c42d-cfb8-4a02-921e-b66f13f41131" by "_delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:43:03 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-1644d328-7cb3-4136-802d-ed07466ad016 tempest-VolumesSnapshotTestJSON-2026192373 None] Lock "cinder-quobyte-0d36c42d-cfb8-4a02-921e-b66f13f41131" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:43:03 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-1644d328-7cb3-4136-802d-ed07466ad016 tempest-VolumesSnapshotTestJSON-2026192373 None] Deleting offline snapshot 0d36c42d-cfb8-4a02-921e-b66f13f41131 of volume 89074cb5-5a6e-47bb-9cd8-b9049d7cc04a {{(pid=86310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 14:43:03 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-1644d328-7cb3-4136-802d-ed07466ad016 tempest-VolumesSnapshotTestJSON-2026192373 None] snapshot_file for this snap is: volume-89074cb5-5a6e-47bb-9cd8-b9049d7cc04a.0d36c42d-cfb8-4a02-921e-b66f13f41131 {{(pid=86310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 14:43:03 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[aec89c38-e09f-404f-868f-cd5734dcf96f]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:43:03 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-1644d328-7cb3-4136-802d-ed07466ad016 tempest-VolumesSnapshotTestJSON-2026192373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-89074cb5-5a6e-47bb-9cd8-b9049d7cc04a.0d36c42d-cfb8-4a02-921e-b66f13f41131 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:43:03 devstack sudo[98891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-89074cb5-5a6e-47bb-9cd8-b9049d7cc04a.0d36c42d-cfb8-4a02-921e-b66f13f41131 Sep 23 14:43:03 devstack sudo[98891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:43:03 devstack sudo[98889]: pam_unix(sudo:session): session closed for user root Sep 23 14:43:03 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-2c4e7caf-0e67-4ea0-92e4-c8c20b093738 tempest-VolumesTransfersV357Test-87851659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-70fe1679-0759-4a57-8435-e9fb2b18ff1e" returned: 0 in 0.386s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:43:03 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-2c4e7caf-0e67-4ea0-92e4-c8c20b093738 tempest-VolumesTransfersV357Test-87851659 None] <== create_volume: return (1129ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:43:03 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-2c4e7caf-0e67-4ea0-92e4-c8c20b093738 tempest-VolumesTransfersV357Test-87851659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.133s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:43:03 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-2c4e7caf-0e67-4ea0-92e4-c8c20b093738 tempest-VolumesTransfersV357Test-87851659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b281a0f-7629-4664-8f11-306c9ce791cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70fe1679-0759-4a57-8435-e9fb2b18ff1e', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:43:03 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-2c4e7caf-0e67-4ea0-92e4-c8c20b093738 tempest-VolumesTransfersV357Test-87851659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e3f469b-d25c-456c-91aa-31b883f45b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:43:03 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-2c4e7caf-0e67-4ea0-92e4-c8c20b093738 tempest-VolumesTransfersV357Test-87851659 None] Volume volume-70fe1679-0759-4a57-8435-e9fb2b18ff1e (70fe1679-0759-4a57-8435-e9fb2b18ff1e): created successfully Sep 23 14:43:03 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-2c4e7caf-0e67-4ea0-92e4-c8c20b093738 tempest-VolumesTransfersV357Test-87851659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e3f469b-d25c-456c-91aa-31b883f45b97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:43:03 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-2c4e7caf-0e67-4ea0-92e4-c8c20b093738 tempest-VolumesTransfersV357Test-87851659 None] Flow 'volume_create_manager' (fc238251-710e-47c9-9bda-66eb6271b71e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:43:03 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-2c4e7caf-0e67-4ea0-92e4-c8c20b093738 tempest-VolumesTransfersV357Test-87851659 None] Created volume successfully. Sep 23 14:43:04 devstack sudo[98891]: pam_unix(sudo:session): session closed for user root Sep 23 14:43:04 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-1644d328-7cb3-4136-802d-ed07466ad016 tempest-VolumesSnapshotTestJSON-2026192373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-89074cb5-5a6e-47bb-9cd8-b9049d7cc04a.0d36c42d-cfb8-4a02-921e-b66f13f41131" returned: 0 in 0.506s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:43:04 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-1644d328-7cb3-4136-802d-ed07466ad016 tempest-VolumesSnapshotTestJSON-2026192373 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-89074cb5-5a6e-47bb-9cd8-b9049d7cc04a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 14:43:04 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7769f28-42eb-4896-ac0f-022f02518bc4]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:43:04 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-1644d328-7cb3-4136-802d-ed07466ad016 tempest-VolumesSnapshotTestJSON-2026192373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-89074cb5-5a6e-47bb-9cd8-b9049d7cc04a {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:43:04 devstack sudo[98897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-89074cb5-5a6e-47bb-9cd8-b9049d7cc04a Sep 23 14:43:04 devstack sudo[98897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:43:04 devstack sudo[98897]: pam_unix(sudo:session): session closed for user root Sep 23 14:43:04 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-1644d328-7cb3-4136-802d-ed07466ad016 tempest-VolumesSnapshotTestJSON-2026192373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-89074cb5-5a6e-47bb-9cd8-b9049d7cc04a" returned: 0 in 0.451s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:43:04 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-1644d328-7cb3-4136-802d-ed07466ad016 tempest-VolumesSnapshotTestJSON-2026192373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-89074cb5-5a6e-47bb-9cd8-b9049d7cc04a.0d36c42d-cfb8-4a02-921e-b66f13f41131 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:43:04 devstack sudo[98902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-89074cb5-5a6e-47bb-9cd8-b9049d7cc04a.0d36c42d-cfb8-4a02-921e-b66f13f41131 Sep 23 14:43:04 devstack sudo[98902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:43:04 devstack sudo[98902]: pam_unix(sudo:session): session closed for user root Sep 23 14:43:04 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-1644d328-7cb3-4136-802d-ed07466ad016 tempest-VolumesSnapshotTestJSON-2026192373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-89074cb5-5a6e-47bb-9cd8-b9049d7cc04a.0d36c42d-cfb8-4a02-921e-b66f13f41131" returned: 0 in 0.448s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:43:04 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-1644d328-7cb3-4136-802d-ed07466ad016 tempest-VolumesSnapshotTestJSON-2026192373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-89074cb5-5a6e-47bb-9cd8-b9049d7cc04a.0d36c42d-cfb8-4a02-921e-b66f13f41131 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:43:05 devstack sudo[98907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-89074cb5-5a6e-47bb-9cd8-b9049d7cc04a.0d36c42d-cfb8-4a02-921e-b66f13f41131 Sep 23 14:43:05 devstack sudo[98907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:43:05 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-0b5ba494-a167-45ea-930b-186b2dcfacd8 tempest-VolumesTransfersV357Test-1952142828 None] Transfer volume completed successfully. Sep 23 14:43:05 devstack sudo[98907]: pam_unix(sudo:session): session closed for user root Sep 23 14:43:05 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-1644d328-7cb3-4136-802d-ed07466ad016 tempest-VolumesSnapshotTestJSON-2026192373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-89074cb5-5a6e-47bb-9cd8-b9049d7cc04a.0d36c42d-cfb8-4a02-921e-b66f13f41131" returned: 0 in 0.432s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:43:05 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-1644d328-7cb3-4136-802d-ed07466ad016 tempest-VolumesSnapshotTestJSON-2026192373 None] Lock "cinder-quobyte-0d36c42d-cfb8-4a02-921e-b66f13f41131" released by "_delete_snapshot" :: held 2.036s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:43:05 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-1644d328-7cb3-4136-802d-ed07466ad016 tempest-VolumesSnapshotTestJSON-2026192373 None] Lock "cinder-quobyte-89074cb5-5a6e-47bb-9cd8-b9049d7cc04a" released by "delete_snapshot" :: held 2.070s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:43:05 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-1644d328-7cb3-4136-802d-ed07466ad016 tempest-VolumesSnapshotTestJSON-2026192373 None] Created reservations ['832d1ed9-76c1-4ad4-a73e-68f37a709ab6', '9672b887-bed3-4923-9674-930c9dd7ff04', '41a1db57-bcef-4924-b753-95bc7d7d7bcd', '72bf4dab-9b08-4e0b-b420-f3ab187f5b7d'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:43:05 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-1644d328-7cb3-4136-802d-ed07466ad016 tempest-VolumesSnapshotTestJSON-2026192373 None] Delete snapshot completed successfully. Sep 23 14:43:05 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-1644d328-7cb3-4136-802d-ed07466ad016 tempest-VolumesSnapshotTestJSON-2026192373 None] Lock "cinder-0d36c42d-cfb8-4a02-921e-b66f13f41131-delete_snapshot" released by "delete_snapshot" :: held 2.303s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:43:05 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-a713cfc9-5e3e-4de9-be5b-2e5fb9ecc4fc tempest-VolumesTransfersV357Test-1552715069 None] Acquiring lock "cinder-70fe1679-0759-4a57-8435-e9fb2b18ff1e-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:43:05 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-a713cfc9-5e3e-4de9-be5b-2e5fb9ecc4fc tempest-VolumesTransfersV357Test-1552715069 None] Lock "cinder-70fe1679-0759-4a57-8435-e9fb2b18ff1e-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:43:05 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-a713cfc9-5e3e-4de9-be5b-2e5fb9ecc4fc tempest-VolumesTransfersV357Test-1552715069 None] Acquiring lock "cinder-quobyte-70fe1679-0759-4a57-8435-e9fb2b18ff1e" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:43:05 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-a713cfc9-5e3e-4de9-be5b-2e5fb9ecc4fc tempest-VolumesTransfersV357Test-1552715069 None] Lock "cinder-quobyte-70fe1679-0759-4a57-8435-e9fb2b18ff1e" acquired by "delete_volume" :: waited 0.015s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:43:05 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2896096-0261-48df-b90d-36747018c05c]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:43:05 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a713cfc9-5e3e-4de9-be5b-2e5fb9ecc4fc tempest-VolumesTransfersV357Test-1552715069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-70fe1679-0759-4a57-8435-e9fb2b18ff1e {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:43:06 devstack sudo[98910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-70fe1679-0759-4a57-8435-e9fb2b18ff1e Sep 23 14:43:06 devstack sudo[98910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:43:06 devstack sudo[98910]: pam_unix(sudo:session): session closed for user root Sep 23 14:43:06 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a713cfc9-5e3e-4de9-be5b-2e5fb9ecc4fc tempest-VolumesTransfersV357Test-1552715069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-70fe1679-0759-4a57-8435-e9fb2b18ff1e" returned: 0 in 0.433s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:43:06 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a713cfc9-5e3e-4de9-be5b-2e5fb9ecc4fc tempest-VolumesTransfersV357Test-1552715069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-70fe1679-0759-4a57-8435-e9fb2b18ff1e {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:43:06 devstack sudo[98916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-70fe1679-0759-4a57-8435-e9fb2b18ff1e Sep 23 14:43:06 devstack sudo[98916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:43:06 devstack sudo[98916]: pam_unix(sudo:session): session closed for user root Sep 23 14:43:06 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a713cfc9-5e3e-4de9-be5b-2e5fb9ecc4fc tempest-VolumesTransfersV357Test-1552715069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-70fe1679-0759-4a57-8435-e9fb2b18ff1e" returned: 0 in 0.308s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:43:06 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-a713cfc9-5e3e-4de9-be5b-2e5fb9ecc4fc tempest-VolumesTransfersV357Test-1552715069 None] Lock "cinder-quobyte-70fe1679-0759-4a57-8435-e9fb2b18ff1e" released by "delete_volume" :: held 0.816s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:43:06 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-a713cfc9-5e3e-4de9-be5b-2e5fb9ecc4fc tempest-VolumesTransfersV357Test-1552715069 None] Created reservations ['1a86feba-350d-487b-93d2-05272668dea0', '3de849ac-c9b2-4537-8157-824b516d0e9a', '48a8ed30-9bb0-4c42-b826-d2e3a6df5db3', 'a159357d-1aa3-4bfc-9920-cf295b365191'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:43:06 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-a713cfc9-5e3e-4de9-be5b-2e5fb9ecc4fc tempest-VolumesTransfersV357Test-1552715069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:43:06 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-a713cfc9-5e3e-4de9-be5b-2e5fb9ecc4fc tempest-VolumesTransfersV357Test-1552715069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:43:06 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-a713cfc9-5e3e-4de9-be5b-2e5fb9ecc4fc tempest-VolumesTransfersV357Test-1552715069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:43:06 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-a713cfc9-5e3e-4de9-be5b-2e5fb9ecc4fc tempest-VolumesTransfersV357Test-1552715069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:43:06 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-a713cfc9-5e3e-4de9-be5b-2e5fb9ecc4fc tempest-VolumesTransfersV357Test-1552715069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:43:06 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a713cfc9-5e3e-4de9-be5b-2e5fb9ecc4fc tempest-VolumesTransfersV357Test-1552715069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:43:06 devstack sudo[98919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:43:06 devstack sudo[98919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:43:07 devstack sudo[98919]: pam_unix(sudo:session): session closed for user root Sep 23 14:43:07 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-91dd8cc6-0713-4dac-88ae-6746a1b09106 tempest-VolumesSnapshotTestJSON-2026192373 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:43:07 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-91dd8cc6-0713-4dac-88ae-6746a1b09106 tempest-VolumesSnapshotTestJSON-2026192373 None] Flow 'volume_create_manager' (e99a0be3-5b31-46ff-afab-116035ea07cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:43:07 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-91dd8cc6-0713-4dac-88ae-6746a1b09106 tempest-VolumesSnapshotTestJSON-2026192373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46da6533-c667-40d5-a99f-41a685e19a95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:43:07 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a713cfc9-5e3e-4de9-be5b-2e5fb9ecc4fc tempest-VolumesTransfersV357Test-1552715069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.412s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:43:07 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-a713cfc9-5e3e-4de9-be5b-2e5fb9ecc4fc tempest-VolumesTransfersV357Test-1552715069 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:43:07 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-a713cfc9-5e3e-4de9-be5b-2e5fb9ecc4fc tempest-VolumesTransfersV357Test-1552715069 None] Deleted volume successfully. Sep 23 14:43:07 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-91dd8cc6-0713-4dac-88ae-6746a1b09106 tempest-VolumesSnapshotTestJSON-2026192373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46da6533-c667-40d5-a99f-41a685e19a95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:43:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-596097133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cc363e7-0e2e-4c0b-a194-5965540fe2d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc37b3f0f14743f98ec5678b6b1d8d57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:43:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:43:07Z,use_quota=True,user_id='2befd5b4c0e64f129ca6768bb143e6ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:43:07 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-91dd8cc6-0713-4dac-88ae-6746a1b09106 tempest-VolumesSnapshotTestJSON-2026192373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (520e9bd5-5c43-4e0c-aa54-4873454510e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:43:07 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-91dd8cc6-0713-4dac-88ae-6746a1b09106 tempest-VolumesSnapshotTestJSON-2026192373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (520e9bd5-5c43-4e0c-aa54-4873454510e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:43:07 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-91dd8cc6-0713-4dac-88ae-6746a1b09106 tempest-VolumesSnapshotTestJSON-2026192373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3792043b-f2fa-42ec-b892-dceb47e48b5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:43:07 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-91dd8cc6-0713-4dac-88ae-6746a1b09106 tempest-VolumesSnapshotTestJSON-2026192373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3792043b-f2fa-42ec-b892-dceb47e48b5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0cc363e7-0e2e-4c0b-a194-5965540fe2d7', 'volume_name': 'volume-0cc363e7-0e2e-4c0b-a194-5965540fe2d7', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:43:07 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-91dd8cc6-0713-4dac-88ae-6746a1b09106 tempest-VolumesSnapshotTestJSON-2026192373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0836d851-8541-44d5-9925-5fdcdc20a91e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:43:07 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-91dd8cc6-0713-4dac-88ae-6746a1b09106 tempest-VolumesSnapshotTestJSON-2026192373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0836d851-8541-44d5-9925-5fdcdc20a91e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:43:07 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-91dd8cc6-0713-4dac-88ae-6746a1b09106 tempest-VolumesSnapshotTestJSON-2026192373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2a56b65-14bc-410a-a814-57ffbae1f836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:43:07 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-91dd8cc6-0713-4dac-88ae-6746a1b09106 tempest-VolumesSnapshotTestJSON-2026192373 None] Volume 0cc363e7-0e2e-4c0b-a194-5965540fe2d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0cc363e7-0e2e-4c0b-a194-5965540fe2d7', 'volume_size': 1} Sep 23 14:43:07 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-91dd8cc6-0713-4dac-88ae-6746a1b09106 tempest-VolumesSnapshotTestJSON-2026192373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:43:07 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-91dd8cc6-0713-4dac-88ae-6746a1b09106 tempest-VolumesSnapshotTestJSON-2026192373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:43:07 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-91dd8cc6-0713-4dac-88ae-6746a1b09106 tempest-VolumesSnapshotTestJSON-2026192373 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:43:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-596097133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cc363e7-0e2e-4c0b-a194-5965540fe2d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc37b3f0f14743f98ec5678b6b1d8d57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:43:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:43:07Z,use_quota=True,user_id='2befd5b4c0e64f129ca6768bb143e6ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:43:07 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-91dd8cc6-0713-4dac-88ae-6746a1b09106 tempest-VolumesSnapshotTestJSON-2026192373 None] Creating volume 0cc363e7-0e2e-4c0b-a194-5965540fe2d7 {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:43:07 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-91dd8cc6-0713-4dac-88ae-6746a1b09106 tempest-VolumesSnapshotTestJSON-2026192373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:43:07 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-91dd8cc6-0713-4dac-88ae-6746a1b09106 tempest-VolumesSnapshotTestJSON-2026192373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:43:07 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-91dd8cc6-0713-4dac-88ae-6746a1b09106 tempest-VolumesSnapshotTestJSON-2026192373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:43:07 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-91dd8cc6-0713-4dac-88ae-6746a1b09106 tempest-VolumesSnapshotTestJSON-2026192373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:43:07 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-91dd8cc6-0713-4dac-88ae-6746a1b09106 tempest-VolumesSnapshotTestJSON-2026192373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:43:07 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-91dd8cc6-0713-4dac-88ae-6746a1b09106 tempest-VolumesSnapshotTestJSON-2026192373 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:43:07 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-91dd8cc6-0713-4dac-88ae-6746a1b09106 tempest-VolumesSnapshotTestJSON-2026192373 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:43:07 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-91dd8cc6-0713-4dac-88ae-6746a1b09106 tempest-VolumesSnapshotTestJSON-2026192373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-0cc363e7-0e2e-4c0b-a194-5965540fe2d7 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:43:07 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-a713cfc9-5e3e-4de9-be5b-2e5fb9ecc4fc tempest-VolumesTransfersV357Test-1552715069 None] Lock "cinder-70fe1679-0759-4a57-8435-e9fb2b18ff1e-delete_volume" released by "delete_volume" :: held 1.596s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:43:07 devstack sudo[98922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-0cc363e7-0e2e-4c0b-a194-5965540fe2d7 1073741824 Sep 23 14:43:07 devstack sudo[98922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:43:07 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-72b43b66-890b-4fb8-b3f3-f8d8db410951 tempest-VolumesTransfersV357Test-87851659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:43:07 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-72b43b66-890b-4fb8-b3f3-f8d8db410951 tempest-VolumesTransfersV357Test-87851659 None] Flow 'volume_create_manager' (735e73bc-a75d-4073-9972-de972a4781a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:43:07 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-72b43b66-890b-4fb8-b3f3-f8d8db410951 tempest-VolumesTransfersV357Test-87851659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e28c21b1-f901-4c21-98ad-941d9b0c9c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:43:07 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-72b43b66-890b-4fb8-b3f3-f8d8db410951 tempest-VolumesTransfersV357Test-87851659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e28c21b1-f901-4c21-98ad-941d9b0c9c40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:43:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1129103832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d9bc844-59df-4957-93ae-a1b1b5480348,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e886ee8bddce412c851d636d6ea9b6e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:43:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:43:08Z,use_quota=True,user_id='a1f1cf88262f45ab8aad8c145bdbd12c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:43:07 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-72b43b66-890b-4fb8-b3f3-f8d8db410951 tempest-VolumesTransfersV357Test-87851659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70c8810a-c6e7-4248-8392-a70e2c9d585c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:43:07 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-72b43b66-890b-4fb8-b3f3-f8d8db410951 tempest-VolumesTransfersV357Test-87851659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70c8810a-c6e7-4248-8392-a70e2c9d585c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:43:07 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-72b43b66-890b-4fb8-b3f3-f8d8db410951 tempest-VolumesTransfersV357Test-87851659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1893ecbf-c848-46b0-a159-8b8c55efa64b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:43:07 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-72b43b66-890b-4fb8-b3f3-f8d8db410951 tempest-VolumesTransfersV357Test-87851659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1893ecbf-c848-46b0-a159-8b8c55efa64b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d9bc844-59df-4957-93ae-a1b1b5480348', 'volume_name': 'volume-1d9bc844-59df-4957-93ae-a1b1b5480348', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:43:07 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-72b43b66-890b-4fb8-b3f3-f8d8db410951 tempest-VolumesTransfersV357Test-87851659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa6dc8f2-ff2c-48aa-be34-2e56b8cb98e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:43:07 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-72b43b66-890b-4fb8-b3f3-f8d8db410951 tempest-VolumesTransfersV357Test-87851659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa6dc8f2-ff2c-48aa-be34-2e56b8cb98e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:43:07 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-72b43b66-890b-4fb8-b3f3-f8d8db410951 tempest-VolumesTransfersV357Test-87851659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b72fe7e-6ddc-464d-bd05-50340dea7050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:43:07 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-72b43b66-890b-4fb8-b3f3-f8d8db410951 tempest-VolumesTransfersV357Test-87851659 None] Volume 1d9bc844-59df-4957-93ae-a1b1b5480348: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d9bc844-59df-4957-93ae-a1b1b5480348', 'volume_size': 1} Sep 23 14:43:07 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-72b43b66-890b-4fb8-b3f3-f8d8db410951 tempest-VolumesTransfersV357Test-87851659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:43:07 devstack sudo[98922]: pam_unix(sudo:session): session closed for user root Sep 23 14:43:07 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-91dd8cc6-0713-4dac-88ae-6746a1b09106 tempest-VolumesSnapshotTestJSON-2026192373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-0cc363e7-0e2e-4c0b-a194-5965540fe2d7 1073741824" returned: 0 in 0.574s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:43:08 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-91dd8cc6-0713-4dac-88ae-6746a1b09106 tempest-VolumesSnapshotTestJSON-2026192373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-0cc363e7-0e2e-4c0b-a194-5965540fe2d7 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:43:08 devstack sudo[98929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-0cc363e7-0e2e-4c0b-a194-5965540fe2d7 Sep 23 14:43:08 devstack sudo[98929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:43:08 devstack sudo[98929]: pam_unix(sudo:session): session closed for user root Sep 23 14:43:08 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-91dd8cc6-0713-4dac-88ae-6746a1b09106 tempest-VolumesSnapshotTestJSON-2026192373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-0cc363e7-0e2e-4c0b-a194-5965540fe2d7" returned: 0 in 0.250s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:43:08 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-91dd8cc6-0713-4dac-88ae-6746a1b09106 tempest-VolumesSnapshotTestJSON-2026192373 None] <== create_volume: return (877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:43:08 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-91dd8cc6-0713-4dac-88ae-6746a1b09106 tempest-VolumesSnapshotTestJSON-2026192373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:43:08 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-72b43b66-890b-4fb8-b3f3-f8d8db410951 tempest-VolumesTransfersV357Test-87851659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.469s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:43:08 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-72b43b66-890b-4fb8-b3f3-f8d8db410951 tempest-VolumesTransfersV357Test-87851659 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:43:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1129103832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d9bc844-59df-4957-93ae-a1b1b5480348,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e886ee8bddce412c851d636d6ea9b6e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:43:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:43:08Z,use_quota=True,user_id='a1f1cf88262f45ab8aad8c145bdbd12c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:43:08 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-72b43b66-890b-4fb8-b3f3-f8d8db410951 tempest-VolumesTransfersV357Test-87851659 None] Creating volume 1d9bc844-59df-4957-93ae-a1b1b5480348 {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:43:08 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-72b43b66-890b-4fb8-b3f3-f8d8db410951 tempest-VolumesTransfersV357Test-87851659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:43:08 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-72b43b66-890b-4fb8-b3f3-f8d8db410951 tempest-VolumesTransfersV357Test-87851659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:43:08 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-72b43b66-890b-4fb8-b3f3-f8d8db410951 tempest-VolumesTransfersV357Test-87851659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:43:08 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-72b43b66-890b-4fb8-b3f3-f8d8db410951 tempest-VolumesTransfersV357Test-87851659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:43:08 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-72b43b66-890b-4fb8-b3f3-f8d8db410951 tempest-VolumesTransfersV357Test-87851659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:43:08 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-72b43b66-890b-4fb8-b3f3-f8d8db410951 tempest-VolumesTransfersV357Test-87851659 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:43:08 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-72b43b66-890b-4fb8-b3f3-f8d8db410951 tempest-VolumesTransfersV357Test-87851659 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:43:08 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-72b43b66-890b-4fb8-b3f3-f8d8db410951 tempest-VolumesTransfersV357Test-87851659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-1d9bc844-59df-4957-93ae-a1b1b5480348 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:43:08 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-91dd8cc6-0713-4dac-88ae-6746a1b09106 tempest-VolumesSnapshotTestJSON-2026192373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2a56b65-14bc-410a-a814-57ffbae1f836) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cc363e7-0e2e-4c0b-a194-5965540fe2d7', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:43:08 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-91dd8cc6-0713-4dac-88ae-6746a1b09106 tempest-VolumesSnapshotTestJSON-2026192373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61706b0c-d224-493c-8e15-ccefe04368fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:43:08 devstack sudo[98933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-1d9bc844-59df-4957-93ae-a1b1b5480348 1073741824 Sep 23 14:43:08 devstack sudo[98933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:43:08 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-91dd8cc6-0713-4dac-88ae-6746a1b09106 tempest-VolumesSnapshotTestJSON-2026192373 None] Volume volume-0cc363e7-0e2e-4c0b-a194-5965540fe2d7 (0cc363e7-0e2e-4c0b-a194-5965540fe2d7): created successfully Sep 23 14:43:08 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-91dd8cc6-0713-4dac-88ae-6746a1b09106 tempest-VolumesSnapshotTestJSON-2026192373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61706b0c-d224-493c-8e15-ccefe04368fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:43:08 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-91dd8cc6-0713-4dac-88ae-6746a1b09106 tempest-VolumesSnapshotTestJSON-2026192373 None] Flow 'volume_create_manager' (e99a0be3-5b31-46ff-afab-116035ea07cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:43:08 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-91dd8cc6-0713-4dac-88ae-6746a1b09106 tempest-VolumesSnapshotTestJSON-2026192373 None] Created volume successfully. Sep 23 14:43:08 devstack sudo[98933]: pam_unix(sudo:session): session closed for user root Sep 23 14:43:08 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-72b43b66-890b-4fb8-b3f3-f8d8db410951 tempest-VolumesTransfersV357Test-87851659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-1d9bc844-59df-4957-93ae-a1b1b5480348 1073741824" returned: 0 in 0.451s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:43:08 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-72b43b66-890b-4fb8-b3f3-f8d8db410951 tempest-VolumesTransfersV357Test-87851659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-1d9bc844-59df-4957-93ae-a1b1b5480348 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:43:08 devstack sudo[98938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-1d9bc844-59df-4957-93ae-a1b1b5480348 Sep 23 14:43:08 devstack sudo[98938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:43:09 devstack sudo[98938]: pam_unix(sudo:session): session closed for user root Sep 23 14:43:09 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-72b43b66-890b-4fb8-b3f3-f8d8db410951 tempest-VolumesTransfersV357Test-87851659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-1d9bc844-59df-4957-93ae-a1b1b5480348" returned: 0 in 0.276s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:43:09 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-72b43b66-890b-4fb8-b3f3-f8d8db410951 tempest-VolumesTransfersV357Test-87851659 None] <== create_volume: return (770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:43:09 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-72b43b66-890b-4fb8-b3f3-f8d8db410951 tempest-VolumesTransfersV357Test-87851659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:43:09 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-72b43b66-890b-4fb8-b3f3-f8d8db410951 tempest-VolumesTransfersV357Test-87851659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b72fe7e-6ddc-464d-bd05-50340dea7050) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d9bc844-59df-4957-93ae-a1b1b5480348', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:43:09 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-72b43b66-890b-4fb8-b3f3-f8d8db410951 tempest-VolumesTransfersV357Test-87851659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3f4514a-df4a-4320-8a5b-caf1d400f1e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:43:09 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-72b43b66-890b-4fb8-b3f3-f8d8db410951 tempest-VolumesTransfersV357Test-87851659 None] Volume volume-1d9bc844-59df-4957-93ae-a1b1b5480348 (1d9bc844-59df-4957-93ae-a1b1b5480348): created successfully Sep 23 14:43:09 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-72b43b66-890b-4fb8-b3f3-f8d8db410951 tempest-VolumesTransfersV357Test-87851659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3f4514a-df4a-4320-8a5b-caf1d400f1e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:43:09 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-72b43b66-890b-4fb8-b3f3-f8d8db410951 tempest-VolumesTransfersV357Test-87851659 None] Flow 'volume_create_manager' (735e73bc-a75d-4073-9972-de972a4781a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:43:09 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-72b43b66-890b-4fb8-b3f3-f8d8db410951 tempest-VolumesTransfersV357Test-87851659 None] Created volume successfully. Sep 23 14:43:09 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-3713d589-fa31-4cc4-9bd0-d79bc3d095c6 tempest-VolumesSnapshotTestJSON-2026192373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:43:09 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-3713d589-fa31-4cc4-9bd0-d79bc3d095c6 tempest-VolumesSnapshotTestJSON-2026192373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:43:09 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-3713d589-fa31-4cc4-9bd0-d79bc3d095c6 tempest-VolumesSnapshotTestJSON-2026192373 None] Creating offline snapshot b9bcbae8-6403-46a2-af91-f79d67618753 of volume 0cc363e7-0e2e-4c0b-a194-5965540fe2d7 {{(pid=86310) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 14:43:09 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fb94cca-08b6-4b6c-9d12-12ce0258130d]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:43:09 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-3713d589-fa31-4cc4-9bd0-d79bc3d095c6 tempest-VolumesSnapshotTestJSON-2026192373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-0cc363e7-0e2e-4c0b-a194-5965540fe2d7 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:43:09 devstack sudo[98965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-0cc363e7-0e2e-4c0b-a194-5965540fe2d7 Sep 23 14:43:09 devstack sudo[98965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:43:09 devstack sudo[98965]: pam_unix(sudo:session): session closed for user root Sep 23 14:43:09 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-3713d589-fa31-4cc4-9bd0-d79bc3d095c6 tempest-VolumesSnapshotTestJSON-2026192373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-0cc363e7-0e2e-4c0b-a194-5965540fe2d7" returned: 0 in 0.449s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:43:09 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-3713d589-fa31-4cc4-9bd0-d79bc3d095c6 tempest-VolumesSnapshotTestJSON-2026192373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-0cc363e7-0e2e-4c0b-a194-5965540fe2d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-0cc363e7-0e2e-4c0b-a194-5965540fe2d7.b9bcbae8-6403-46a2-af91-f79d67618753 1G {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:43:09 devstack sudo[98970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-0cc363e7-0e2e-4c0b-a194-5965540fe2d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-0cc363e7-0e2e-4c0b-a194-5965540fe2d7.b9bcbae8-6403-46a2-af91-f79d67618753 1G Sep 23 14:43:09 devstack sudo[98970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:43:10 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-788bb464-5258-4135-81fd-44c485c37f83 tempest-VolumesTransfersV357Test-1552715069 None] Acquiring lock "cinder-1d9bc844-59df-4957-93ae-a1b1b5480348-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:43:10 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-788bb464-5258-4135-81fd-44c485c37f83 tempest-VolumesTransfersV357Test-1552715069 None] Lock "cinder-1d9bc844-59df-4957-93ae-a1b1b5480348-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:43:10 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-788bb464-5258-4135-81fd-44c485c37f83 tempest-VolumesTransfersV357Test-1552715069 None] Acquiring lock "cinder-quobyte-1d9bc844-59df-4957-93ae-a1b1b5480348" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:43:10 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-788bb464-5258-4135-81fd-44c485c37f83 tempest-VolumesTransfersV357Test-1552715069 None] Lock "cinder-quobyte-1d9bc844-59df-4957-93ae-a1b1b5480348" acquired by "delete_volume" :: waited 0.022s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:43:10 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[f65213c8-c350-4c29-b2c6-092a4a0237e1]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:43:10 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-788bb464-5258-4135-81fd-44c485c37f83 tempest-VolumesTransfersV357Test-1552715069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-1d9bc844-59df-4957-93ae-a1b1b5480348 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:43:10 devstack sudo[98975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-1d9bc844-59df-4957-93ae-a1b1b5480348 Sep 23 14:43:10 devstack sudo[98975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:43:10 devstack sudo[98970]: pam_unix(sudo:session): session closed for user root Sep 23 14:43:10 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-3713d589-fa31-4cc4-9bd0-d79bc3d095c6 tempest-VolumesSnapshotTestJSON-2026192373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-0cc363e7-0e2e-4c0b-a194-5965540fe2d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-0cc363e7-0e2e-4c0b-a194-5965540fe2d7.b9bcbae8-6403-46a2-af91-f79d67618753 1G" returned: 0 in 0.623s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:43:10 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-3713d589-fa31-4cc4-9bd0-d79bc3d095c6 tempest-VolumesSnapshotTestJSON-2026192373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0cc363e7-0e2e-4c0b-a194-5965540fe2d7 -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-0cc363e7-0e2e-4c0b-a194-5965540fe2d7.b9bcbae8-6403-46a2-af91-f79d67618753 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:43:10 devstack sudo[98979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0cc363e7-0e2e-4c0b-a194-5965540fe2d7 -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-0cc363e7-0e2e-4c0b-a194-5965540fe2d7.b9bcbae8-6403-46a2-af91-f79d67618753 Sep 23 14:43:10 devstack sudo[98979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:43:10 devstack sudo[98975]: pam_unix(sudo:session): session closed for user root Sep 23 14:43:10 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-788bb464-5258-4135-81fd-44c485c37f83 tempest-VolumesTransfersV357Test-1552715069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-1d9bc844-59df-4957-93ae-a1b1b5480348" returned: 0 in 0.477s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:43:10 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-788bb464-5258-4135-81fd-44c485c37f83 tempest-VolumesTransfersV357Test-1552715069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-1d9bc844-59df-4957-93ae-a1b1b5480348 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:43:10 devstack sudo[98986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-1d9bc844-59df-4957-93ae-a1b1b5480348 Sep 23 14:43:10 devstack sudo[98986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:43:10 devstack sudo[98979]: pam_unix(sudo:session): session closed for user root Sep 23 14:43:10 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-3713d589-fa31-4cc4-9bd0-d79bc3d095c6 tempest-VolumesSnapshotTestJSON-2026192373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0cc363e7-0e2e-4c0b-a194-5965540fe2d7 -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-0cc363e7-0e2e-4c0b-a194-5965540fe2d7.b9bcbae8-6403-46a2-af91-f79d67618753" returned: 0 in 0.411s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:43:10 devstack cinder-volume[86310]: WARNING cinder.volume.drivers.remotefs [None req-3713d589-fa31-4cc4-9bd0-d79bc3d095c6 tempest-VolumesSnapshotTestJSON-2026192373 None] /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-0cc363e7-0e2e-4c0b-a194-5965540fe2d7.b9bcbae8-6403-46a2-af91-f79d67618753 is being set with open permissions: ugo+rw Sep 23 14:43:10 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-3713d589-fa31-4cc4-9bd0-d79bc3d095c6 tempest-VolumesSnapshotTestJSON-2026192373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-0cc363e7-0e2e-4c0b-a194-5965540fe2d7.b9bcbae8-6403-46a2-af91-f79d67618753 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:43:11 devstack sudo[98993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-0cc363e7-0e2e-4c0b-a194-5965540fe2d7.b9bcbae8-6403-46a2-af91-f79d67618753 Sep 23 14:43:11 devstack sudo[98993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:43:11 devstack sudo[98986]: pam_unix(sudo:session): session closed for user root Sep 23 14:43:11 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-788bb464-5258-4135-81fd-44c485c37f83 tempest-VolumesTransfersV357Test-1552715069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-1d9bc844-59df-4957-93ae-a1b1b5480348" returned: 0 in 0.334s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:43:11 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-788bb464-5258-4135-81fd-44c485c37f83 tempest-VolumesTransfersV357Test-1552715069 None] Lock "cinder-quobyte-1d9bc844-59df-4957-93ae-a1b1b5480348" released by "delete_volume" :: held 0.869s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:43:11 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-788bb464-5258-4135-81fd-44c485c37f83 tempest-VolumesTransfersV357Test-1552715069 None] Created reservations ['fc2287c8-1da8-4a61-9c16-a6ee6795a53a', 'e4161af4-7392-4093-80f1-373967763b16', '3b69df69-0e79-496c-a57e-085026f8dacb', 'e61c15fe-bac7-45c3-b528-33e8efa58eec'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:43:11 devstack sudo[98993]: pam_unix(sudo:session): session closed for user root Sep 23 14:43:11 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-3713d589-fa31-4cc4-9bd0-d79bc3d095c6 tempest-VolumesSnapshotTestJSON-2026192373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-0cc363e7-0e2e-4c0b-a194-5965540fe2d7.b9bcbae8-6403-46a2-af91-f79d67618753" returned: 0 in 0.370s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:43:11 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-788bb464-5258-4135-81fd-44c485c37f83 tempest-VolumesTransfersV357Test-1552715069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:43:11 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-788bb464-5258-4135-81fd-44c485c37f83 tempest-VolumesTransfersV357Test-1552715069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:43:11 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-788bb464-5258-4135-81fd-44c485c37f83 tempest-VolumesTransfersV357Test-1552715069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:43:11 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-788bb464-5258-4135-81fd-44c485c37f83 tempest-VolumesTransfersV357Test-1552715069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:43:11 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-788bb464-5258-4135-81fd-44c485c37f83 tempest-VolumesTransfersV357Test-1552715069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:43:11 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-788bb464-5258-4135-81fd-44c485c37f83 tempest-VolumesTransfersV357Test-1552715069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:43:11 devstack sudo[98998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:43:11 devstack sudo[98998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:43:11 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-3713d589-fa31-4cc4-9bd0-d79bc3d095c6 tempest-VolumesSnapshotTestJSON-2026192373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-0cc363e7-0e2e-4c0b-a194-5965540fe2d7.info {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:43:11 devstack sudo[99000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-0cc363e7-0e2e-4c0b-a194-5965540fe2d7.info Sep 23 14:43:11 devstack sudo[99000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:43:11 devstack sudo[98998]: pam_unix(sudo:session): session closed for user root Sep 23 14:43:11 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-788bb464-5258-4135-81fd-44c485c37f83 tempest-VolumesTransfersV357Test-1552715069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.387s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:43:11 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-788bb464-5258-4135-81fd-44c485c37f83 tempest-VolumesTransfersV357Test-1552715069 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:43:11 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-788bb464-5258-4135-81fd-44c485c37f83 tempest-VolumesTransfersV357Test-1552715069 None] Deleted volume successfully. Sep 23 14:43:11 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-788bb464-5258-4135-81fd-44c485c37f83 tempest-VolumesTransfersV357Test-1552715069 None] Lock "cinder-1d9bc844-59df-4957-93ae-a1b1b5480348-delete_volume" released by "delete_volume" :: held 1.646s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:43:11 devstack sudo[99000]: pam_unix(sudo:session): session closed for user root Sep 23 14:43:11 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-3713d589-fa31-4cc4-9bd0-d79bc3d095c6 tempest-VolumesSnapshotTestJSON-2026192373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-0cc363e7-0e2e-4c0b-a194-5965540fe2d7.info" returned: 0 in 0.389s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:43:11 devstack cinder-volume[86310]: WARNING cinder.volume.drivers.remotefs [None req-3713d589-fa31-4cc4-9bd0-d79bc3d095c6 tempest-VolumesSnapshotTestJSON-2026192373 None] /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-0cc363e7-0e2e-4c0b-a194-5965540fe2d7.info is being set with open permissions: ugo+rw Sep 23 14:43:11 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-3713d589-fa31-4cc4-9bd0-d79bc3d095c6 tempest-VolumesSnapshotTestJSON-2026192373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-0cc363e7-0e2e-4c0b-a194-5965540fe2d7.info {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:43:11 devstack sudo[99004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-0cc363e7-0e2e-4c0b-a194-5965540fe2d7.info Sep 23 14:43:11 devstack sudo[99004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:43:12 devstack sudo[99004]: pam_unix(sudo:session): session closed for user root Sep 23 14:43:12 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-3713d589-fa31-4cc4-9bd0-d79bc3d095c6 tempest-VolumesSnapshotTestJSON-2026192373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-0cc363e7-0e2e-4c0b-a194-5965540fe2d7.info" returned: 0 in 0.273s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:43:12 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-3713d589-fa31-4cc4-9bd0-d79bc3d095c6 tempest-VolumesSnapshotTestJSON-2026192373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.692s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:43:12 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-3713d589-fa31-4cc4-9bd0-d79bc3d095c6 tempest-VolumesSnapshotTestJSON-2026192373 None] Create snapshot completed successfully Sep 23 14:43:13 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f2be5c9-4049-444d-82dd-d43288ae8d56 tempest-VolumesSnapshotTestJSON-2026192373 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:43:13 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-4f2be5c9-4049-444d-82dd-d43288ae8d56 tempest-VolumesSnapshotTestJSON-2026192373 None] Flow 'volume_create_manager' (6b2ab1a2-d614-4731-934f-b5b3655e9f54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:43:13 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-4f2be5c9-4049-444d-82dd-d43288ae8d56 tempest-VolumesSnapshotTestJSON-2026192373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f41fa279-9d4b-4ed7-8dde-f1666e3fa7fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:43:13 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-4f2be5c9-4049-444d-82dd-d43288ae8d56 tempest-VolumesSnapshotTestJSON-2026192373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f41fa279-9d4b-4ed7-8dde-f1666e3fa7fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:43:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-37866468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e83eb728-99ad-4ba1-9724-45f0b708d54e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc37b3f0f14743f98ec5678b6b1d8d57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:43:13Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=b9bcbae8-6403-46a2-af91-f79d67618753,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:43:13Z,use_quota=True,user_id='2befd5b4c0e64f129ca6768bb143e6ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:43:13 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-4f2be5c9-4049-444d-82dd-d43288ae8d56 tempest-VolumesSnapshotTestJSON-2026192373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1458fb3-63bd-4334-9bc1-4fa8075cd7a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:43:13 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-4f2be5c9-4049-444d-82dd-d43288ae8d56 tempest-VolumesSnapshotTestJSON-2026192373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1458fb3-63bd-4334-9bc1-4fa8075cd7a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:43:13 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-4f2be5c9-4049-444d-82dd-d43288ae8d56 tempest-VolumesSnapshotTestJSON-2026192373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (338acc3a-7821-44fd-ba28-7aa3a69be1b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:43:13 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-4f2be5c9-4049-444d-82dd-d43288ae8d56 tempest-VolumesSnapshotTestJSON-2026192373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (338acc3a-7821-44fd-ba28-7aa3a69be1b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e83eb728-99ad-4ba1-9724-45f0b708d54e', 'volume_name': 'volume-e83eb728-99ad-4ba1-9724-45f0b708d54e', 'volume_size': 2, 'snapshot_id': 'b9bcbae8-6403-46a2-af91-f79d67618753'}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:43:13 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-4f2be5c9-4049-444d-82dd-d43288ae8d56 tempest-VolumesSnapshotTestJSON-2026192373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (714396de-1aa1-41ae-93fe-11fc3643aa80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:43:13 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-4f2be5c9-4049-444d-82dd-d43288ae8d56 tempest-VolumesSnapshotTestJSON-2026192373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (714396de-1aa1-41ae-93fe-11fc3643aa80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:43:13 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-4f2be5c9-4049-444d-82dd-d43288ae8d56 tempest-VolumesSnapshotTestJSON-2026192373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09142f8c-4a11-4b4a-8ddc-ce914ba31cce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:43:13 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-4f2be5c9-4049-444d-82dd-d43288ae8d56 tempest-VolumesSnapshotTestJSON-2026192373 None] Volume e83eb728-99ad-4ba1-9724-45f0b708d54e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e83eb728-99ad-4ba1-9724-45f0b708d54e', 'volume_size': 2, 'snapshot_id': 'b9bcbae8-6403-46a2-af91-f79d67618753'} Sep 23 14:43:13 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-4f2be5c9-4049-444d-82dd-d43288ae8d56 tempest-VolumesSnapshotTestJSON-2026192373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:43:13 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-4f2be5c9-4049-444d-82dd-d43288ae8d56 tempest-VolumesSnapshotTestJSON-2026192373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:43:13 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-4f2be5c9-4049-444d-82dd-d43288ae8d56 tempest-VolumesSnapshotTestJSON-2026192373 None] Acquiring lock "cinder-quobyte-b9bcbae8-6403-46a2-af91-f79d67618753-e83eb728-99ad-4ba1-9724-45f0b708d54e" by "_create_volume_from_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:43:13 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-4f2be5c9-4049-444d-82dd-d43288ae8d56 tempest-VolumesSnapshotTestJSON-2026192373 None] Lock "cinder-quobyte-b9bcbae8-6403-46a2-af91-f79d67618753-e83eb728-99ad-4ba1-9724-45f0b708d54e" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:43:13 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-4f2be5c9-4049-444d-82dd-d43288ae8d56 tempest-VolumesSnapshotTestJSON-2026192373 None] Creating volume e83eb728-99ad-4ba1-9724-45f0b708d54e from snapshot b9bcbae8-6403-46a2-af91-f79d67618753 {{(pid=86310) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 23 14:43:13 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-4f2be5c9-4049-444d-82dd-d43288ae8d56 tempest-VolumesSnapshotTestJSON-2026192373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:43:13 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-4f2be5c9-4049-444d-82dd-d43288ae8d56 tempest-VolumesSnapshotTestJSON-2026192373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:43:13 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-4f2be5c9-4049-444d-82dd-d43288ae8d56 tempest-VolumesSnapshotTestJSON-2026192373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:43:13 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-4f2be5c9-4049-444d-82dd-d43288ae8d56 tempest-VolumesSnapshotTestJSON-2026192373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:43:13 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-4f2be5c9-4049-444d-82dd-d43288ae8d56 tempest-VolumesSnapshotTestJSON-2026192373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:43:13 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-4f2be5c9-4049-444d-82dd-d43288ae8d56 tempest-VolumesSnapshotTestJSON-2026192373 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:43:13 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-4f2be5c9-4049-444d-82dd-d43288ae8d56 tempest-VolumesSnapshotTestJSON-2026192373 None] Acquiring lock "cinder-quobyte-e83eb728-99ad-4ba1-9724-45f0b708d54e" by "_copy_volume_from_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:43:13 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-4f2be5c9-4049-444d-82dd-d43288ae8d56 tempest-VolumesSnapshotTestJSON-2026192373 None] Lock "cinder-quobyte-e83eb728-99ad-4ba1-9724-45f0b708d54e" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:43:13 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-4f2be5c9-4049-444d-82dd-d43288ae8d56 tempest-VolumesSnapshotTestJSON-2026192373 None] snapshot: b9bcbae8-6403-46a2-af91-f79d67618753, volume: e83eb728-99ad-4ba1-9724-45f0b708d54e, {{(pid=86310) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 23 14:43:13 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-4f2be5c9-4049-444d-82dd-d43288ae8d56 tempest-VolumesSnapshotTestJSON-2026192373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:43:13 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-4f2be5c9-4049-444d-82dd-d43288ae8d56 tempest-VolumesSnapshotTestJSON-2026192373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:43:13 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-4f2be5c9-4049-444d-82dd-d43288ae8d56 tempest-VolumesSnapshotTestJSON-2026192373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:43:13 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-4f2be5c9-4049-444d-82dd-d43288ae8d56 tempest-VolumesSnapshotTestJSON-2026192373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:43:13 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-4f2be5c9-4049-444d-82dd-d43288ae8d56 tempest-VolumesSnapshotTestJSON-2026192373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:43:13 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[74f467c1-00a9-4f19-ae97-f3855e1b5af6]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:43:13 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-4f2be5c9-4049-444d-82dd-d43288ae8d56 tempest-VolumesSnapshotTestJSON-2026192373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-0cc363e7-0e2e-4c0b-a194-5965540fe2d7.b9bcbae8-6403-46a2-af91-f79d67618753 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:43:13 devstack sudo[99008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-0cc363e7-0e2e-4c0b-a194-5965540fe2d7.b9bcbae8-6403-46a2-af91-f79d67618753 Sep 23 14:43:13 devstack sudo[99008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:43:13 devstack sudo[99008]: pam_unix(sudo:session): session closed for user root Sep 23 14:43:13 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-4f2be5c9-4049-444d-82dd-d43288ae8d56 tempest-VolumesSnapshotTestJSON-2026192373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-0cc363e7-0e2e-4c0b-a194-5965540fe2d7.b9bcbae8-6403-46a2-af91-f79d67618753" returned: 0 in 0.498s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:43:13 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-4f2be5c9-4049-444d-82dd-d43288ae8d56 tempest-VolumesSnapshotTestJSON-2026192373 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0cc363e7-0e2e-4c0b-a194-5965540fe2d7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 14:43:13 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5255062-93b7-4d9f-9a9d-999a48cc523f]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:43:13 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-4f2be5c9-4049-444d-82dd-d43288ae8d56 tempest-VolumesSnapshotTestJSON-2026192373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-0cc363e7-0e2e-4c0b-a194-5965540fe2d7 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:43:14 devstack sudo[99026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-0cc363e7-0e2e-4c0b-a194-5965540fe2d7 Sep 23 14:43:14 devstack sudo[99026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:43:14 devstack sudo[99026]: pam_unix(sudo:session): session closed for user root Sep 23 14:43:14 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-4f2be5c9-4049-444d-82dd-d43288ae8d56 tempest-VolumesSnapshotTestJSON-2026192373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-0cc363e7-0e2e-4c0b-a194-5965540fe2d7" returned: 0 in 0.611s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:43:14 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-4f2be5c9-4049-444d-82dd-d43288ae8d56 tempest-VolumesSnapshotTestJSON-2026192373 None] will copy from snapshot at /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-0cc363e7-0e2e-4c0b-a194-5965540fe2d7 {{(pid=86310) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 23 14:43:14 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-4f2be5c9-4049-444d-82dd-d43288ae8d56 tempest-VolumesSnapshotTestJSON-2026192373 None] Creating direct copy from snapshot {{(pid=86310) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 23 14:43:14 devstack cinder-volume[86310]: DEBUG cinder.utils [None req-4f2be5c9-4049-444d-82dd-d43288ae8d56 tempest-VolumesSnapshotTestJSON-2026192373 None] Path /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e83eb728-99ad-4ba1-9724-45f0b708d54e not found in is_blk_device check {{(pid=86310) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 23 14:43:14 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-4f2be5c9-4049-444d-82dd-d43288ae8d56 tempest-VolumesSnapshotTestJSON-2026192373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-0cc363e7-0e2e-4c0b-a194-5965540fe2d7 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e83eb728-99ad-4ba1-9724-45f0b708d54e {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:43:14 devstack sudo[99045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-0cc363e7-0e2e-4c0b-a194-5965540fe2d7 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e83eb728-99ad-4ba1-9724-45f0b708d54e Sep 23 14:43:14 devstack sudo[99045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:43:23 devstack cinder-volume[86310]: DEBUG dbcounter [-] [86310] Writing DB stats cinder:UPDATE=52,cinder:SELECT=41,cinder:INSERT=14,cinder:DELETE=4 {{(pid=86310) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 14:43:23 devstack cinder-volume[86310]: DEBUG dbcounter [-] [86310] Writing DB stats cinder:SELECT=55,cinder:INSERT=12,cinder:UPDATE=54,cinder:DELETE=6 {{(pid=86310) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 14:43:25 devstack sudo[99045]: pam_unix(sudo:session): session closed for user root Sep 23 14:43:25 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-4f2be5c9-4049-444d-82dd-d43288ae8d56 tempest-VolumesSnapshotTestJSON-2026192373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-0cc363e7-0e2e-4c0b-a194-5965540fe2d7 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e83eb728-99ad-4ba1-9724-45f0b708d54e" returned: 0 in 11.105s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:43:25 devstack cinder-volume[86310]: DEBUG cinder.image.image_utils [None req-4f2be5c9-4049-444d-82dd-d43288ae8d56 tempest-VolumesSnapshotTestJSON-2026192373 None] Image conversion details: src /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-0cc363e7-0e2e-4c0b-a194-5965540fe2d7, size 1024.00 MB, duration 11.11 sec, destination /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e83eb728-99ad-4ba1-9724-45f0b708d54e {{(pid=86310) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 14:43:25 devstack cinder-volume[86310]: INFO cinder.image.image_utils [None req-4f2be5c9-4049-444d-82dd-d43288ae8d56 tempest-VolumesSnapshotTestJSON-2026192373 None] Converted 1024.00 MB image at 92.21 MB/s Sep 23 14:43:25 devstack cinder-volume[86310]: WARNING cinder.volume.drivers.remotefs [None req-4f2be5c9-4049-444d-82dd-d43288ae8d56 tempest-VolumesSnapshotTestJSON-2026192373 None] /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e83eb728-99ad-4ba1-9724-45f0b708d54e is being set with open permissions: ugo+rw Sep 23 14:43:25 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-4f2be5c9-4049-444d-82dd-d43288ae8d56 tempest-VolumesSnapshotTestJSON-2026192373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e83eb728-99ad-4ba1-9724-45f0b708d54e {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:43:25 devstack sudo[99098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e83eb728-99ad-4ba1-9724-45f0b708d54e Sep 23 14:43:25 devstack sudo[99098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:43:25 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e439220-651b-438b-92a2-493fcb399dfd tempest-VolumesGetTest-1470935452 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:43:25 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-6e439220-651b-438b-92a2-493fcb399dfd tempest-VolumesGetTest-1470935452 None] Flow 'volume_create_manager' (5eddb7b3-db2d-47d7-8c34-e7a96e91a260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:43:25 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-6e439220-651b-438b-92a2-493fcb399dfd tempest-VolumesGetTest-1470935452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d0ddfc8-b70d-4f2f-83f3-65e9b0f3b74a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:43:25 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-6e439220-651b-438b-92a2-493fcb399dfd tempest-VolumesGetTest-1470935452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d0ddfc8-b70d-4f2f-83f3-65e9b0f3b74a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:43:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-288676848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0017f55-1794-4597-8a11-1991b17351de,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='00651445389c45f2aa5764549f6a9307',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:43:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:43:26Z,use_quota=True,user_id='31a6159d91a940a48f5b4070277146b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:43:25 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-6e439220-651b-438b-92a2-493fcb399dfd tempest-VolumesGetTest-1470935452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56e17e42-7d73-46c1-9b15-bdad2b552f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:43:25 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-6e439220-651b-438b-92a2-493fcb399dfd tempest-VolumesGetTest-1470935452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56e17e42-7d73-46c1-9b15-bdad2b552f86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:43:25 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-6e439220-651b-438b-92a2-493fcb399dfd tempest-VolumesGetTest-1470935452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb09bbbd-c250-4334-8b2d-b7021b9c80e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:43:25 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-6e439220-651b-438b-92a2-493fcb399dfd tempest-VolumesGetTest-1470935452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb09bbbd-c250-4334-8b2d-b7021b9c80e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0017f55-1794-4597-8a11-1991b17351de', 'volume_name': 'volume-c0017f55-1794-4597-8a11-1991b17351de', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:43:25 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-6e439220-651b-438b-92a2-493fcb399dfd tempest-VolumesGetTest-1470935452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f041008-c457-4a9f-ac87-c4abd81732d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:43:25 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-6e439220-651b-438b-92a2-493fcb399dfd tempest-VolumesGetTest-1470935452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f041008-c457-4a9f-ac87-c4abd81732d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:43:25 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-6e439220-651b-438b-92a2-493fcb399dfd tempest-VolumesGetTest-1470935452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc9fd1d1-fcf0-44c6-8cd5-f4ede9b7de77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:43:25 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-6e439220-651b-438b-92a2-493fcb399dfd tempest-VolumesGetTest-1470935452 None] Volume c0017f55-1794-4597-8a11-1991b17351de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0017f55-1794-4597-8a11-1991b17351de', 'volume_size': 1} Sep 23 14:43:25 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-6e439220-651b-438b-92a2-493fcb399dfd tempest-VolumesGetTest-1470935452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:43:26 devstack sudo[99098]: pam_unix(sudo:session): session closed for user root Sep 23 14:43:26 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-4f2be5c9-4049-444d-82dd-d43288ae8d56 tempest-VolumesSnapshotTestJSON-2026192373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e83eb728-99ad-4ba1-9724-45f0b708d54e" returned: 0 in 0.421s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:43:26 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-4f2be5c9-4049-444d-82dd-d43288ae8d56 tempest-VolumesSnapshotTestJSON-2026192373 None] Lock "cinder-quobyte-e83eb728-99ad-4ba1-9724-45f0b708d54e" released by "_copy_volume_from_snapshot" :: held 12.761s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:43:26 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-4f2be5c9-4049-444d-82dd-d43288ae8d56 tempest-VolumesSnapshotTestJSON-2026192373 None] Lock "cinder-quobyte-b9bcbae8-6403-46a2-af91-f79d67618753-e83eb728-99ad-4ba1-9724-45f0b708d54e" released by "_create_volume_from_snapshot" :: held 12.827s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:43:26 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-4f2be5c9-4049-444d-82dd-d43288ae8d56 tempest-VolumesSnapshotTestJSON-2026192373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.846s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:43:26 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-6e439220-651b-438b-92a2-493fcb399dfd tempest-VolumesGetTest-1470935452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.352s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:43:26 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-6e439220-651b-438b-92a2-493fcb399dfd tempest-VolumesGetTest-1470935452 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:43:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-288676848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0017f55-1794-4597-8a11-1991b17351de,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='00651445389c45f2aa5764549f6a9307',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:43:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:43:26Z,use_quota=True,user_id='31a6159d91a940a48f5b4070277146b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:43:26 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-6e439220-651b-438b-92a2-493fcb399dfd tempest-VolumesGetTest-1470935452 None] Creating volume c0017f55-1794-4597-8a11-1991b17351de {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:43:26 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-6e439220-651b-438b-92a2-493fcb399dfd tempest-VolumesGetTest-1470935452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:43:26 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-6e439220-651b-438b-92a2-493fcb399dfd tempest-VolumesGetTest-1470935452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:43:26 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-6e439220-651b-438b-92a2-493fcb399dfd tempest-VolumesGetTest-1470935452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:43:26 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-6e439220-651b-438b-92a2-493fcb399dfd tempest-VolumesGetTest-1470935452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:43:26 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-6e439220-651b-438b-92a2-493fcb399dfd tempest-VolumesGetTest-1470935452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:43:26 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-6e439220-651b-438b-92a2-493fcb399dfd tempest-VolumesGetTest-1470935452 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:43:26 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-6e439220-651b-438b-92a2-493fcb399dfd tempest-VolumesGetTest-1470935452 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:43:26 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-6e439220-651b-438b-92a2-493fcb399dfd tempest-VolumesGetTest-1470935452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-c0017f55-1794-4597-8a11-1991b17351de 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:43:26 devstack sudo[99101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-c0017f55-1794-4597-8a11-1991b17351de 1073741824 Sep 23 14:43:26 devstack sudo[99101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:43:26 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-4f2be5c9-4049-444d-82dd-d43288ae8d56 tempest-VolumesSnapshotTestJSON-2026192373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09142f8c-4a11-4b4a-8ddc-ce914ba31cce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e83eb728-99ad-4ba1-9724-45f0b708d54e', 'volume_size': 2, 'snapshot_id': 'b9bcbae8-6403-46a2-af91-f79d67618753'}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:43:26 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-4f2be5c9-4049-444d-82dd-d43288ae8d56 tempest-VolumesSnapshotTestJSON-2026192373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85441dba-465d-4d76-9507-b72b732af7b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:43:26 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-4f2be5c9-4049-444d-82dd-d43288ae8d56 tempest-VolumesSnapshotTestJSON-2026192373 None] Volume volume-e83eb728-99ad-4ba1-9724-45f0b708d54e (e83eb728-99ad-4ba1-9724-45f0b708d54e): created successfully Sep 23 14:43:26 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-4f2be5c9-4049-444d-82dd-d43288ae8d56 tempest-VolumesSnapshotTestJSON-2026192373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85441dba-465d-4d76-9507-b72b732af7b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:43:26 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-4f2be5c9-4049-444d-82dd-d43288ae8d56 tempest-VolumesSnapshotTestJSON-2026192373 None] Flow 'volume_create_manager' (6b2ab1a2-d614-4731-934f-b5b3655e9f54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:43:26 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-4f2be5c9-4049-444d-82dd-d43288ae8d56 tempest-VolumesSnapshotTestJSON-2026192373 None] Created volume successfully. Sep 23 14:43:26 devstack sudo[99101]: pam_unix(sudo:session): session closed for user root Sep 23 14:43:26 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-6e439220-651b-438b-92a2-493fcb399dfd tempest-VolumesGetTest-1470935452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-c0017f55-1794-4597-8a11-1991b17351de 1073741824" returned: 0 in 0.502s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:43:26 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-6e439220-651b-438b-92a2-493fcb399dfd tempest-VolumesGetTest-1470935452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-c0017f55-1794-4597-8a11-1991b17351de {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:43:26 devstack sudo[99107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-c0017f55-1794-4597-8a11-1991b17351de Sep 23 14:43:26 devstack sudo[99107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:43:27 devstack sudo[99107]: pam_unix(sudo:session): session closed for user root Sep 23 14:43:27 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-6e439220-651b-438b-92a2-493fcb399dfd tempest-VolumesGetTest-1470935452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-c0017f55-1794-4597-8a11-1991b17351de" returned: 0 in 0.480s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:43:27 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-6e439220-651b-438b-92a2-493fcb399dfd tempest-VolumesGetTest-1470935452 None] <== create_volume: return (1035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:43:27 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-6e439220-651b-438b-92a2-493fcb399dfd tempest-VolumesGetTest-1470935452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.038s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:43:27 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-6e439220-651b-438b-92a2-493fcb399dfd tempest-VolumesGetTest-1470935452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc9fd1d1-fcf0-44c6-8cd5-f4ede9b7de77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0017f55-1794-4597-8a11-1991b17351de', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:43:27 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-6e439220-651b-438b-92a2-493fcb399dfd tempest-VolumesGetTest-1470935452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff290a8c-67d3-4dc8-8c89-229132f2668c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:43:27 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-6e439220-651b-438b-92a2-493fcb399dfd tempest-VolumesGetTest-1470935452 None] Volume volume-c0017f55-1794-4597-8a11-1991b17351de (c0017f55-1794-4597-8a11-1991b17351de): created successfully Sep 23 14:43:27 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-6e439220-651b-438b-92a2-493fcb399dfd tempest-VolumesGetTest-1470935452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff290a8c-67d3-4dc8-8c89-229132f2668c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:43:27 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-6e439220-651b-438b-92a2-493fcb399dfd tempest-VolumesGetTest-1470935452 None] Flow 'volume_create_manager' (5eddb7b3-db2d-47d7-8c34-e7a96e91a260) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:43:27 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-6e439220-651b-438b-92a2-493fcb399dfd tempest-VolumesGetTest-1470935452 None] Created volume successfully. Sep 23 14:43:27 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-794f3c29-e35d-4812-8a4e-08944f6362f5 tempest-VolumesSnapshotTestJSON-2026192373 None] Acquiring lock "cinder-e83eb728-99ad-4ba1-9724-45f0b708d54e-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:43:27 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-794f3c29-e35d-4812-8a4e-08944f6362f5 tempest-VolumesSnapshotTestJSON-2026192373 None] Lock "cinder-e83eb728-99ad-4ba1-9724-45f0b708d54e-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:43:27 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-794f3c29-e35d-4812-8a4e-08944f6362f5 tempest-VolumesSnapshotTestJSON-2026192373 None] Acquiring lock "cinder-quobyte-e83eb728-99ad-4ba1-9724-45f0b708d54e" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:43:27 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-794f3c29-e35d-4812-8a4e-08944f6362f5 tempest-VolumesSnapshotTestJSON-2026192373 None] Lock "cinder-quobyte-e83eb728-99ad-4ba1-9724-45f0b708d54e" acquired by "delete_volume" :: waited 0.029s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:43:27 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ebbd047-e6cd-4fdc-9d4c-411b87b6fb4f]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:43:27 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-794f3c29-e35d-4812-8a4e-08944f6362f5 tempest-VolumesSnapshotTestJSON-2026192373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e83eb728-99ad-4ba1-9724-45f0b708d54e {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:43:27 devstack sudo[99110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e83eb728-99ad-4ba1-9724-45f0b708d54e Sep 23 14:43:27 devstack sudo[99110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:43:28 devstack sudo[99110]: pam_unix(sudo:session): session closed for user root Sep 23 14:43:28 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-794f3c29-e35d-4812-8a4e-08944f6362f5 tempest-VolumesSnapshotTestJSON-2026192373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e83eb728-99ad-4ba1-9724-45f0b708d54e" returned: 0 in 0.474s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:43:28 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-794f3c29-e35d-4812-8a4e-08944f6362f5 tempest-VolumesSnapshotTestJSON-2026192373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e83eb728-99ad-4ba1-9724-45f0b708d54e {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:43:28 devstack sudo[99115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e83eb728-99ad-4ba1-9724-45f0b708d54e Sep 23 14:43:28 devstack sudo[99115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:43:28 devstack sudo[99115]: pam_unix(sudo:session): session closed for user root Sep 23 14:43:28 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-794f3c29-e35d-4812-8a4e-08944f6362f5 tempest-VolumesSnapshotTestJSON-2026192373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e83eb728-99ad-4ba1-9724-45f0b708d54e" returned: 0 in 0.278s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:43:28 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-794f3c29-e35d-4812-8a4e-08944f6362f5 tempest-VolumesSnapshotTestJSON-2026192373 None] Lock "cinder-quobyte-e83eb728-99ad-4ba1-9724-45f0b708d54e" released by "delete_volume" :: held 0.834s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:43:28 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-794f3c29-e35d-4812-8a4e-08944f6362f5 tempest-VolumesSnapshotTestJSON-2026192373 None] Created reservations ['0278833a-9a30-482e-8ef9-c7dcf5f89ab6', 'b93adfeb-b3e1-42f9-a945-899b3c28e541', '868b761f-d1ab-4161-9c9b-870ee8c1057f', '75b99675-b2e9-4993-b4d9-0f5844c7aabd'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:43:28 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-794f3c29-e35d-4812-8a4e-08944f6362f5 tempest-VolumesSnapshotTestJSON-2026192373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:43:28 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-794f3c29-e35d-4812-8a4e-08944f6362f5 tempest-VolumesSnapshotTestJSON-2026192373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:43:28 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-794f3c29-e35d-4812-8a4e-08944f6362f5 tempest-VolumesSnapshotTestJSON-2026192373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:43:28 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-794f3c29-e35d-4812-8a4e-08944f6362f5 tempest-VolumesSnapshotTestJSON-2026192373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:43:28 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-794f3c29-e35d-4812-8a4e-08944f6362f5 tempest-VolumesSnapshotTestJSON-2026192373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:43:28 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-794f3c29-e35d-4812-8a4e-08944f6362f5 tempest-VolumesSnapshotTestJSON-2026192373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:43:28 devstack sudo[99118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:43:28 devstack sudo[99118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:43:28 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4fce8cc-2f55-4cbc-8840-4fd8eca42e6e tempest-VolumesGetTest-1470935452 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:43:28 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-e4fce8cc-2f55-4cbc-8840-4fd8eca42e6e tempest-VolumesGetTest-1470935452 None] Flow 'volume_create_manager' (33fe0a00-badb-46e5-88aa-ab792cc6e7ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:43:28 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-e4fce8cc-2f55-4cbc-8840-4fd8eca42e6e tempest-VolumesGetTest-1470935452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbca2aba-6424-45c8-91ef-a4ed04e125a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:43:28 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-e4fce8cc-2f55-4cbc-8840-4fd8eca42e6e tempest-VolumesGetTest-1470935452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbca2aba-6424-45c8-91ef-a4ed04e125a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:43:28Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-811809365',display_name='tempest-VolumesGetTest-Volume-1967593109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e8c4ee7-40ff-435f-9a0b-60dd5b7e37d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00651445389c45f2aa5764549f6a9307',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:43:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:43:29Z,use_quota=True,user_id='31a6159d91a940a48f5b4070277146b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:43:28 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-e4fce8cc-2f55-4cbc-8840-4fd8eca42e6e tempest-VolumesGetTest-1470935452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1ef8bcf-a9a5-4a01-98e4-31ab440f1bef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:43:28 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-e4fce8cc-2f55-4cbc-8840-4fd8eca42e6e tempest-VolumesGetTest-1470935452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1ef8bcf-a9a5-4a01-98e4-31ab440f1bef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:43:28 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-e4fce8cc-2f55-4cbc-8840-4fd8eca42e6e tempest-VolumesGetTest-1470935452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a56981c0-a1aa-4242-add0-e534ea2a2a88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:43:28 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-e4fce8cc-2f55-4cbc-8840-4fd8eca42e6e tempest-VolumesGetTest-1470935452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a56981c0-a1aa-4242-add0-e534ea2a2a88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e8c4ee7-40ff-435f-9a0b-60dd5b7e37d2', 'volume_name': 'volume-6e8c4ee7-40ff-435f-9a0b-60dd5b7e37d2', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:43:28 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-e4fce8cc-2f55-4cbc-8840-4fd8eca42e6e tempest-VolumesGetTest-1470935452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (055a5d81-2b22-4ccc-ae06-4b0a37264650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:43:28 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-e4fce8cc-2f55-4cbc-8840-4fd8eca42e6e tempest-VolumesGetTest-1470935452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (055a5d81-2b22-4ccc-ae06-4b0a37264650) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:43:28 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-e4fce8cc-2f55-4cbc-8840-4fd8eca42e6e tempest-VolumesGetTest-1470935452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b6e9bf5-dd01-48ca-a81f-1c238e03e239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:43:28 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-e4fce8cc-2f55-4cbc-8840-4fd8eca42e6e tempest-VolumesGetTest-1470935452 None] Volume 6e8c4ee7-40ff-435f-9a0b-60dd5b7e37d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e8c4ee7-40ff-435f-9a0b-60dd5b7e37d2', 'volume_size': 1} Sep 23 14:43:28 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-e4fce8cc-2f55-4cbc-8840-4fd8eca42e6e tempest-VolumesGetTest-1470935452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:43:28 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-e4fce8cc-2f55-4cbc-8840-4fd8eca42e6e tempest-VolumesGetTest-1470935452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:43:28 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-e4fce8cc-2f55-4cbc-8840-4fd8eca42e6e tempest-VolumesGetTest-1470935452 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:43:28Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-811809365',display_name='tempest-VolumesGetTest-Volume-1967593109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e8c4ee7-40ff-435f-9a0b-60dd5b7e37d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00651445389c45f2aa5764549f6a9307',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:43:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:43:29Z,use_quota=True,user_id='31a6159d91a940a48f5b4070277146b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:43:28 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-e4fce8cc-2f55-4cbc-8840-4fd8eca42e6e tempest-VolumesGetTest-1470935452 None] Creating volume 6e8c4ee7-40ff-435f-9a0b-60dd5b7e37d2 {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:43:28 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-e4fce8cc-2f55-4cbc-8840-4fd8eca42e6e tempest-VolumesGetTest-1470935452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:43:28 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-e4fce8cc-2f55-4cbc-8840-4fd8eca42e6e tempest-VolumesGetTest-1470935452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:43:28 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-e4fce8cc-2f55-4cbc-8840-4fd8eca42e6e tempest-VolumesGetTest-1470935452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:43:28 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-e4fce8cc-2f55-4cbc-8840-4fd8eca42e6e tempest-VolumesGetTest-1470935452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:43:28 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-e4fce8cc-2f55-4cbc-8840-4fd8eca42e6e tempest-VolumesGetTest-1470935452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:43:28 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-e4fce8cc-2f55-4cbc-8840-4fd8eca42e6e tempest-VolumesGetTest-1470935452 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:43:28 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-e4fce8cc-2f55-4cbc-8840-4fd8eca42e6e tempest-VolumesGetTest-1470935452 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:43:28 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-e4fce8cc-2f55-4cbc-8840-4fd8eca42e6e tempest-VolumesGetTest-1470935452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6e8c4ee7-40ff-435f-9a0b-60dd5b7e37d2 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:43:28 devstack sudo[99124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6e8c4ee7-40ff-435f-9a0b-60dd5b7e37d2 1073741824 Sep 23 14:43:28 devstack sudo[99124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:43:28 devstack sudo[99118]: pam_unix(sudo:session): session closed for user root Sep 23 14:43:28 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-794f3c29-e35d-4812-8a4e-08944f6362f5 tempest-VolumesSnapshotTestJSON-2026192373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.315s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:43:28 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-794f3c29-e35d-4812-8a4e-08944f6362f5 tempest-VolumesSnapshotTestJSON-2026192373 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:43:28 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-794f3c29-e35d-4812-8a4e-08944f6362f5 tempest-VolumesSnapshotTestJSON-2026192373 None] Deleted volume successfully. Sep 23 14:43:28 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-794f3c29-e35d-4812-8a4e-08944f6362f5 tempest-VolumesSnapshotTestJSON-2026192373 None] Lock "cinder-e83eb728-99ad-4ba1-9724-45f0b708d54e-delete_volume" released by "delete_volume" :: held 1.556s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:43:29 devstack sudo[99124]: pam_unix(sudo:session): session closed for user root Sep 23 14:43:29 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-e4fce8cc-2f55-4cbc-8840-4fd8eca42e6e tempest-VolumesGetTest-1470935452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6e8c4ee7-40ff-435f-9a0b-60dd5b7e37d2 1073741824" returned: 0 in 0.551s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:43:29 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-e4fce8cc-2f55-4cbc-8840-4fd8eca42e6e tempest-VolumesGetTest-1470935452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6e8c4ee7-40ff-435f-9a0b-60dd5b7e37d2 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:43:29 devstack sudo[99132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6e8c4ee7-40ff-435f-9a0b-60dd5b7e37d2 Sep 23 14:43:29 devstack sudo[99132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:43:29 devstack sudo[99132]: pam_unix(sudo:session): session closed for user root Sep 23 14:43:29 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-e4fce8cc-2f55-4cbc-8840-4fd8eca42e6e tempest-VolumesGetTest-1470935452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6e8c4ee7-40ff-435f-9a0b-60dd5b7e37d2" returned: 0 in 0.280s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:43:29 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-e4fce8cc-2f55-4cbc-8840-4fd8eca42e6e tempest-VolumesGetTest-1470935452 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:43:29 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-e4fce8cc-2f55-4cbc-8840-4fd8eca42e6e tempest-VolumesGetTest-1470935452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:43:29 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-e4fce8cc-2f55-4cbc-8840-4fd8eca42e6e tempest-VolumesGetTest-1470935452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b6e9bf5-dd01-48ca-a81f-1c238e03e239) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e8c4ee7-40ff-435f-9a0b-60dd5b7e37d2', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:43:29 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-e4fce8cc-2f55-4cbc-8840-4fd8eca42e6e tempest-VolumesGetTest-1470935452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2d0d84f-559b-49b2-a46e-5265352a331e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:43:29 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-75c16ecd-ea05-4d61-9c32-dfc5402c40fb tempest-VolumesSnapshotTestJSON-2026192373 None] Acquiring lock "cinder-b9bcbae8-6403-46a2-af91-f79d67618753-delete_snapshot" by "delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:43:29 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-e4fce8cc-2f55-4cbc-8840-4fd8eca42e6e tempest-VolumesGetTest-1470935452 None] Volume volume-6e8c4ee7-40ff-435f-9a0b-60dd5b7e37d2 (6e8c4ee7-40ff-435f-9a0b-60dd5b7e37d2): created successfully Sep 23 14:43:29 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-e4fce8cc-2f55-4cbc-8840-4fd8eca42e6e tempest-VolumesGetTest-1470935452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2d0d84f-559b-49b2-a46e-5265352a331e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:43:29 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-e4fce8cc-2f55-4cbc-8840-4fd8eca42e6e tempest-VolumesGetTest-1470935452 None] Flow 'volume_create_manager' (33fe0a00-badb-46e5-88aa-ab792cc6e7ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:43:29 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-75c16ecd-ea05-4d61-9c32-dfc5402c40fb tempest-VolumesSnapshotTestJSON-2026192373 None] Lock "cinder-b9bcbae8-6403-46a2-af91-f79d67618753-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:43:29 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-75c16ecd-ea05-4d61-9c32-dfc5402c40fb tempest-VolumesSnapshotTestJSON-2026192373 None] Acquiring lock "cinder-quobyte-0cc363e7-0e2e-4c0b-a194-5965540fe2d7" by "delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:43:29 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-e4fce8cc-2f55-4cbc-8840-4fd8eca42e6e tempest-VolumesGetTest-1470935452 None] Created volume successfully. Sep 23 14:43:29 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-75c16ecd-ea05-4d61-9c32-dfc5402c40fb tempest-VolumesSnapshotTestJSON-2026192373 None] Lock "cinder-quobyte-0cc363e7-0e2e-4c0b-a194-5965540fe2d7" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:43:29 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-75c16ecd-ea05-4d61-9c32-dfc5402c40fb tempest-VolumesSnapshotTestJSON-2026192373 None] Acquiring lock "cinder-quobyte-b9bcbae8-6403-46a2-af91-f79d67618753" by "_delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:43:29 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-75c16ecd-ea05-4d61-9c32-dfc5402c40fb tempest-VolumesSnapshotTestJSON-2026192373 None] Lock "cinder-quobyte-b9bcbae8-6403-46a2-af91-f79d67618753" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:43:29 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-75c16ecd-ea05-4d61-9c32-dfc5402c40fb tempest-VolumesSnapshotTestJSON-2026192373 None] Deleting offline snapshot b9bcbae8-6403-46a2-af91-f79d67618753 of volume 0cc363e7-0e2e-4c0b-a194-5965540fe2d7 {{(pid=86310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 14:43:29 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-75c16ecd-ea05-4d61-9c32-dfc5402c40fb tempest-VolumesSnapshotTestJSON-2026192373 None] snapshot_file for this snap is: volume-0cc363e7-0e2e-4c0b-a194-5965540fe2d7.b9bcbae8-6403-46a2-af91-f79d67618753 {{(pid=86310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 14:43:29 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[38454add-0889-4770-8d51-b57985382f48]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:43:29 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-75c16ecd-ea05-4d61-9c32-dfc5402c40fb tempest-VolumesSnapshotTestJSON-2026192373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-0cc363e7-0e2e-4c0b-a194-5965540fe2d7.b9bcbae8-6403-46a2-af91-f79d67618753 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:43:30 devstack sudo[99135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-0cc363e7-0e2e-4c0b-a194-5965540fe2d7.b9bcbae8-6403-46a2-af91-f79d67618753 Sep 23 14:43:30 devstack sudo[99135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:43:30 devstack sudo[99135]: pam_unix(sudo:session): session closed for user root Sep 23 14:43:30 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-75c16ecd-ea05-4d61-9c32-dfc5402c40fb tempest-VolumesSnapshotTestJSON-2026192373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-0cc363e7-0e2e-4c0b-a194-5965540fe2d7.b9bcbae8-6403-46a2-af91-f79d67618753" returned: 0 in 0.436s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:43:30 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-75c16ecd-ea05-4d61-9c32-dfc5402c40fb tempest-VolumesSnapshotTestJSON-2026192373 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0cc363e7-0e2e-4c0b-a194-5965540fe2d7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 14:43:30 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ae3cf8e-c362-4e8e-9dbc-6b1ffaa3eb13]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:43:30 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-75c16ecd-ea05-4d61-9c32-dfc5402c40fb tempest-VolumesSnapshotTestJSON-2026192373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-0cc363e7-0e2e-4c0b-a194-5965540fe2d7 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:43:30 devstack sudo[99142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-0cc363e7-0e2e-4c0b-a194-5965540fe2d7 Sep 23 14:43:30 devstack sudo[99142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:43:30 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-8a5d53e3-455d-4cc8-a9c4-582ca597ccbd tempest-VolumesGetTest-1470935452 None] Acquiring lock "cinder-6e8c4ee7-40ff-435f-9a0b-60dd5b7e37d2-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:43:30 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-8a5d53e3-455d-4cc8-a9c4-582ca597ccbd tempest-VolumesGetTest-1470935452 None] Lock "cinder-6e8c4ee7-40ff-435f-9a0b-60dd5b7e37d2-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:43:30 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-8a5d53e3-455d-4cc8-a9c4-582ca597ccbd tempest-VolumesGetTest-1470935452 None] Acquiring lock "cinder-quobyte-6e8c4ee7-40ff-435f-9a0b-60dd5b7e37d2" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:43:31 devstack sudo[99142]: pam_unix(sudo:session): session closed for user root Sep 23 14:43:31 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-8a5d53e3-455d-4cc8-a9c4-582ca597ccbd tempest-VolumesGetTest-1470935452 None] Lock "cinder-quobyte-6e8c4ee7-40ff-435f-9a0b-60dd5b7e37d2" acquired by "delete_volume" :: waited 0.028s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:43:31 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-75c16ecd-ea05-4d61-9c32-dfc5402c40fb tempest-VolumesSnapshotTestJSON-2026192373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-0cc363e7-0e2e-4c0b-a194-5965540fe2d7" returned: 0 in 0.655s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:43:31 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-75c16ecd-ea05-4d61-9c32-dfc5402c40fb tempest-VolumesSnapshotTestJSON-2026192373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-0cc363e7-0e2e-4c0b-a194-5965540fe2d7.b9bcbae8-6403-46a2-af91-f79d67618753 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:43:31 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[80bf8686-9316-4612-bc57-ea9ca2577beb]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:43:31 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8a5d53e3-455d-4cc8-a9c4-582ca597ccbd tempest-VolumesGetTest-1470935452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6e8c4ee7-40ff-435f-9a0b-60dd5b7e37d2 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:43:31 devstack sudo[99147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-0cc363e7-0e2e-4c0b-a194-5965540fe2d7.b9bcbae8-6403-46a2-af91-f79d67618753 Sep 23 14:43:31 devstack sudo[99147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:43:31 devstack sudo[99148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6e8c4ee7-40ff-435f-9a0b-60dd5b7e37d2 Sep 23 14:43:31 devstack sudo[99148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:43:31 devstack sudo[99147]: pam_unix(sudo:session): session closed for user root Sep 23 14:43:31 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-75c16ecd-ea05-4d61-9c32-dfc5402c40fb tempest-VolumesSnapshotTestJSON-2026192373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-0cc363e7-0e2e-4c0b-a194-5965540fe2d7.b9bcbae8-6403-46a2-af91-f79d67618753" returned: 0 in 0.427s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:43:31 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-75c16ecd-ea05-4d61-9c32-dfc5402c40fb tempest-VolumesSnapshotTestJSON-2026192373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-0cc363e7-0e2e-4c0b-a194-5965540fe2d7.b9bcbae8-6403-46a2-af91-f79d67618753 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:43:31 devstack sudo[99148]: pam_unix(sudo:session): session closed for user root Sep 23 14:43:31 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8a5d53e3-455d-4cc8-a9c4-582ca597ccbd tempest-VolumesGetTest-1470935452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6e8c4ee7-40ff-435f-9a0b-60dd5b7e37d2" returned: 0 in 0.430s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:43:31 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8a5d53e3-455d-4cc8-a9c4-582ca597ccbd tempest-VolumesGetTest-1470935452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6e8c4ee7-40ff-435f-9a0b-60dd5b7e37d2 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:43:31 devstack sudo[99157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-0cc363e7-0e2e-4c0b-a194-5965540fe2d7.b9bcbae8-6403-46a2-af91-f79d67618753 Sep 23 14:43:31 devstack sudo[99157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:43:31 devstack sudo[99158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6e8c4ee7-40ff-435f-9a0b-60dd5b7e37d2 Sep 23 14:43:31 devstack sudo[99158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:43:31 devstack sudo[99157]: pam_unix(sudo:session): session closed for user root Sep 23 14:43:31 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-75c16ecd-ea05-4d61-9c32-dfc5402c40fb tempest-VolumesSnapshotTestJSON-2026192373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-0cc363e7-0e2e-4c0b-a194-5965540fe2d7.b9bcbae8-6403-46a2-af91-f79d67618753" returned: 0 in 0.289s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:43:31 devstack sudo[99158]: pam_unix(sudo:session): session closed for user root Sep 23 14:43:31 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8a5d53e3-455d-4cc8-a9c4-582ca597ccbd tempest-VolumesGetTest-1470935452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6e8c4ee7-40ff-435f-9a0b-60dd5b7e37d2" returned: 0 in 0.310s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:43:31 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-75c16ecd-ea05-4d61-9c32-dfc5402c40fb tempest-VolumesSnapshotTestJSON-2026192373 None] Lock "cinder-quobyte-b9bcbae8-6403-46a2-af91-f79d67618753" released by "_delete_snapshot" :: held 1.947s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:43:31 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-75c16ecd-ea05-4d61-9c32-dfc5402c40fb tempest-VolumesSnapshotTestJSON-2026192373 None] Lock "cinder-quobyte-0cc363e7-0e2e-4c0b-a194-5965540fe2d7" released by "delete_snapshot" :: held 1.977s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:43:31 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-8a5d53e3-455d-4cc8-a9c4-582ca597ccbd tempest-VolumesGetTest-1470935452 None] Lock "cinder-quobyte-6e8c4ee7-40ff-435f-9a0b-60dd5b7e37d2" released by "delete_volume" :: held 0.809s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:43:31 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-8a5d53e3-455d-4cc8-a9c4-582ca597ccbd tempest-VolumesGetTest-1470935452 None] Created reservations ['47b3fa3e-7264-4858-a895-4281c771f6ac', '787252ba-5b92-401f-8a9d-7eeadd09b588', '21bcbf5a-f9a9-480e-aaae-d0b600b9cbc9', 'd55ad204-5891-4313-b303-3d652322714c'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:43:31 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-75c16ecd-ea05-4d61-9c32-dfc5402c40fb tempest-VolumesSnapshotTestJSON-2026192373 None] Created reservations ['d2176cbc-84bf-4ba8-9a8f-f266bba5ac05', '14334e10-d8e9-492a-a9ab-f0ccd98c7d59', 'b9026949-06f4-41f3-84de-bc7db003e4d9', '01ac062b-c923-4d86-8914-d115236f411b'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:43:31 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-75c16ecd-ea05-4d61-9c32-dfc5402c40fb tempest-VolumesSnapshotTestJSON-2026192373 None] Delete snapshot completed successfully. Sep 23 14:43:32 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-75c16ecd-ea05-4d61-9c32-dfc5402c40fb tempest-VolumesSnapshotTestJSON-2026192373 None] Lock "cinder-b9bcbae8-6403-46a2-af91-f79d67618753-delete_snapshot" released by "delete_snapshot" :: held 2.184s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:43:32 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-8a5d53e3-455d-4cc8-a9c4-582ca597ccbd tempest-VolumesGetTest-1470935452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:43:32 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-8a5d53e3-455d-4cc8-a9c4-582ca597ccbd tempest-VolumesGetTest-1470935452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:43:32 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-8a5d53e3-455d-4cc8-a9c4-582ca597ccbd tempest-VolumesGetTest-1470935452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:43:32 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-8a5d53e3-455d-4cc8-a9c4-582ca597ccbd tempest-VolumesGetTest-1470935452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:43:32 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-8a5d53e3-455d-4cc8-a9c4-582ca597ccbd tempest-VolumesGetTest-1470935452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:43:32 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8a5d53e3-455d-4cc8-a9c4-582ca597ccbd tempest-VolumesGetTest-1470935452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:43:32 devstack sudo[99163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:43:32 devstack sudo[99163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:43:32 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-31f5ca09-8d48-4dd9-875b-e3ea69856d63 tempest-VolumesGetTest-1470935452 None] Acquiring lock "cinder-c0017f55-1794-4597-8a11-1991b17351de-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:43:32 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-31f5ca09-8d48-4dd9-875b-e3ea69856d63 tempest-VolumesGetTest-1470935452 None] Lock "cinder-c0017f55-1794-4597-8a11-1991b17351de-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:43:32 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-31f5ca09-8d48-4dd9-875b-e3ea69856d63 tempest-VolumesGetTest-1470935452 None] Acquiring lock "cinder-quobyte-c0017f55-1794-4597-8a11-1991b17351de" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:43:32 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-31f5ca09-8d48-4dd9-875b-e3ea69856d63 tempest-VolumesGetTest-1470935452 None] Lock "cinder-quobyte-c0017f55-1794-4597-8a11-1991b17351de" acquired by "delete_volume" :: waited 0.021s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:43:32 devstack sudo[99163]: pam_unix(sudo:session): session closed for user root Sep 23 14:43:32 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8a5d53e3-455d-4cc8-a9c4-582ca597ccbd tempest-VolumesGetTest-1470935452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.298s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:43:32 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-8a5d53e3-455d-4cc8-a9c4-582ca597ccbd tempest-VolumesGetTest-1470935452 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:43:32 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-8a5d53e3-455d-4cc8-a9c4-582ca597ccbd tempest-VolumesGetTest-1470935452 None] Deleted volume successfully. Sep 23 14:43:32 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[64331e21-6350-4bc5-8809-6874681405db]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:43:32 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-31f5ca09-8d48-4dd9-875b-e3ea69856d63 tempest-VolumesGetTest-1470935452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-c0017f55-1794-4597-8a11-1991b17351de {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:43:32 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-8a5d53e3-455d-4cc8-a9c4-582ca597ccbd tempest-VolumesGetTest-1470935452 None] Lock "cinder-6e8c4ee7-40ff-435f-9a0b-60dd5b7e37d2-delete_volume" released by "delete_volume" :: held 1.432s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:43:32 devstack sudo[99166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-c0017f55-1794-4597-8a11-1991b17351de Sep 23 14:43:32 devstack sudo[99166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:43:32 devstack sudo[99166]: pam_unix(sudo:session): session closed for user root Sep 23 14:43:32 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-31f5ca09-8d48-4dd9-875b-e3ea69856d63 tempest-VolumesGetTest-1470935452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-c0017f55-1794-4597-8a11-1991b17351de" returned: 0 in 0.418s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:43:32 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-31f5ca09-8d48-4dd9-875b-e3ea69856d63 tempest-VolumesGetTest-1470935452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-c0017f55-1794-4597-8a11-1991b17351de {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:43:32 devstack sudo[99172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-c0017f55-1794-4597-8a11-1991b17351de Sep 23 14:43:32 devstack sudo[99172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:43:33 devstack sudo[99172]: pam_unix(sudo:session): session closed for user root Sep 23 14:43:33 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-31f5ca09-8d48-4dd9-875b-e3ea69856d63 tempest-VolumesGetTest-1470935452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-c0017f55-1794-4597-8a11-1991b17351de" returned: 0 in 0.326s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:43:33 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-31f5ca09-8d48-4dd9-875b-e3ea69856d63 tempest-VolumesGetTest-1470935452 None] Lock "cinder-quobyte-c0017f55-1794-4597-8a11-1991b17351de" released by "delete_volume" :: held 0.819s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:43:33 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-5897ffdf-c0dc-4e18-b9f1-fc1eaef84241 tempest-VolumesSnapshotTestJSON-2026192373 None] Acquiring lock "cinder-0cc363e7-0e2e-4c0b-a194-5965540fe2d7-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:43:33 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-5897ffdf-c0dc-4e18-b9f1-fc1eaef84241 tempest-VolumesSnapshotTestJSON-2026192373 None] Lock "cinder-0cc363e7-0e2e-4c0b-a194-5965540fe2d7-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:43:33 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-31f5ca09-8d48-4dd9-875b-e3ea69856d63 tempest-VolumesGetTest-1470935452 None] Created reservations ['24f0ff0b-ea7c-4b44-9dde-8fc9709f7d8a', '530ee25f-1d02-4090-afb6-3be52637acc6', 'e283088d-5f8e-4745-9ec5-6b6c3078f881', '188c1833-8c0e-49aa-bcc9-55d90ab5adf7'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:43:33 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-5897ffdf-c0dc-4e18-b9f1-fc1eaef84241 tempest-VolumesSnapshotTestJSON-2026192373 None] Acquiring lock "cinder-quobyte-0cc363e7-0e2e-4c0b-a194-5965540fe2d7" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:43:33 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-5897ffdf-c0dc-4e18-b9f1-fc1eaef84241 tempest-VolumesSnapshotTestJSON-2026192373 None] Lock "cinder-quobyte-0cc363e7-0e2e-4c0b-a194-5965540fe2d7" acquired by "delete_volume" :: waited 0.031s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:43:33 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[3db8fda7-c48a-4b72-88be-f96e10facf7a]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:43:33 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-5897ffdf-c0dc-4e18-b9f1-fc1eaef84241 tempest-VolumesSnapshotTestJSON-2026192373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-0cc363e7-0e2e-4c0b-a194-5965540fe2d7 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:43:33 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-31f5ca09-8d48-4dd9-875b-e3ea69856d63 tempest-VolumesGetTest-1470935452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:43:33 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-31f5ca09-8d48-4dd9-875b-e3ea69856d63 tempest-VolumesGetTest-1470935452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:43:33 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-31f5ca09-8d48-4dd9-875b-e3ea69856d63 tempest-VolumesGetTest-1470935452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:43:33 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-31f5ca09-8d48-4dd9-875b-e3ea69856d63 tempest-VolumesGetTest-1470935452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:43:33 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-31f5ca09-8d48-4dd9-875b-e3ea69856d63 tempest-VolumesGetTest-1470935452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:43:33 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-31f5ca09-8d48-4dd9-875b-e3ea69856d63 tempest-VolumesGetTest-1470935452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:43:33 devstack sudo[99185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:43:33 devstack sudo[99185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:43:33 devstack sudo[99177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-0cc363e7-0e2e-4c0b-a194-5965540fe2d7 Sep 23 14:43:33 devstack sudo[99177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:43:34 devstack sudo[99185]: pam_unix(sudo:session): session closed for user root Sep 23 14:43:34 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-31f5ca09-8d48-4dd9-875b-e3ea69856d63 tempest-VolumesGetTest-1470935452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.418s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:43:34 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-31f5ca09-8d48-4dd9-875b-e3ea69856d63 tempest-VolumesGetTest-1470935452 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:43:34 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-31f5ca09-8d48-4dd9-875b-e3ea69856d63 tempest-VolumesGetTest-1470935452 None] Deleted volume successfully. Sep 23 14:43:34 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-31f5ca09-8d48-4dd9-875b-e3ea69856d63 tempest-VolumesGetTest-1470935452 None] Lock "cinder-c0017f55-1794-4597-8a11-1991b17351de-delete_volume" released by "delete_volume" :: held 1.875s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:43:34 devstack sudo[99177]: pam_unix(sudo:session): session closed for user root Sep 23 14:43:34 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-5897ffdf-c0dc-4e18-b9f1-fc1eaef84241 tempest-VolumesSnapshotTestJSON-2026192373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-0cc363e7-0e2e-4c0b-a194-5965540fe2d7" returned: 0 in 0.631s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:43:34 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-5897ffdf-c0dc-4e18-b9f1-fc1eaef84241 tempest-VolumesSnapshotTestJSON-2026192373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-0cc363e7-0e2e-4c0b-a194-5965540fe2d7 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:43:34 devstack sudo[99199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-0cc363e7-0e2e-4c0b-a194-5965540fe2d7 Sep 23 14:43:34 devstack sudo[99199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:43:34 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-d651fcfa-d77f-42c0-bf3a-bc1ec17f41a8 tempest-VolumesGetTest-1470935452 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:43:34 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-d651fcfa-d77f-42c0-bf3a-bc1ec17f41a8 tempest-VolumesGetTest-1470935452 None] Flow 'volume_create_manager' (ff525990-4d7c-4e12-b490-856e0cdb66d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:43:34 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-d651fcfa-d77f-42c0-bf3a-bc1ec17f41a8 tempest-VolumesGetTest-1470935452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3b15706-5663-4f8c-90c4-639cd8fc35f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:43:34 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-d651fcfa-d77f-42c0-bf3a-bc1ec17f41a8 tempest-VolumesGetTest-1470935452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3b15706-5663-4f8c-90c4-639cd8fc35f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:43:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1110383997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56b1d5d9-6fad-4571-9fa5-f1bb51bcb869,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00651445389c45f2aa5764549f6a9307',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:43:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:43:34Z,use_quota=True,user_id='31a6159d91a940a48f5b4070277146b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:43:34 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-d651fcfa-d77f-42c0-bf3a-bc1ec17f41a8 tempest-VolumesGetTest-1470935452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac0191ac-c964-470a-a6c2-883bd632888c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:43:34 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-d651fcfa-d77f-42c0-bf3a-bc1ec17f41a8 tempest-VolumesGetTest-1470935452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac0191ac-c964-470a-a6c2-883bd632888c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:43:34 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-d651fcfa-d77f-42c0-bf3a-bc1ec17f41a8 tempest-VolumesGetTest-1470935452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4df0dd6a-ef8d-4637-b58f-da9be0b4447e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:43:34 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-d651fcfa-d77f-42c0-bf3a-bc1ec17f41a8 tempest-VolumesGetTest-1470935452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4df0dd6a-ef8d-4637-b58f-da9be0b4447e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56b1d5d9-6fad-4571-9fa5-f1bb51bcb869', 'volume_name': 'volume-56b1d5d9-6fad-4571-9fa5-f1bb51bcb869', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:43:34 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-d651fcfa-d77f-42c0-bf3a-bc1ec17f41a8 tempest-VolumesGetTest-1470935452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c056967-5bf1-4329-9ed9-ab0d33d438fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:43:34 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-d651fcfa-d77f-42c0-bf3a-bc1ec17f41a8 tempest-VolumesGetTest-1470935452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c056967-5bf1-4329-9ed9-ab0d33d438fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:43:34 devstack sudo[99199]: pam_unix(sudo:session): session closed for user root Sep 23 14:43:34 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-d651fcfa-d77f-42c0-bf3a-bc1ec17f41a8 tempest-VolumesGetTest-1470935452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (169c5c15-8353-4001-b744-ab5106d8d00b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:43:34 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-d651fcfa-d77f-42c0-bf3a-bc1ec17f41a8 tempest-VolumesGetTest-1470935452 None] Volume 56b1d5d9-6fad-4571-9fa5-f1bb51bcb869: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56b1d5d9-6fad-4571-9fa5-f1bb51bcb869', 'volume_size': 1} Sep 23 14:43:34 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-d651fcfa-d77f-42c0-bf3a-bc1ec17f41a8 tempest-VolumesGetTest-1470935452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:43:34 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-d651fcfa-d77f-42c0-bf3a-bc1ec17f41a8 tempest-VolumesGetTest-1470935452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:43:34 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-d651fcfa-d77f-42c0-bf3a-bc1ec17f41a8 tempest-VolumesGetTest-1470935452 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:43:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1110383997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56b1d5d9-6fad-4571-9fa5-f1bb51bcb869,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00651445389c45f2aa5764549f6a9307',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:43:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:43:34Z,use_quota=True,user_id='31a6159d91a940a48f5b4070277146b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:43:34 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-d651fcfa-d77f-42c0-bf3a-bc1ec17f41a8 tempest-VolumesGetTest-1470935452 None] Creating volume 56b1d5d9-6fad-4571-9fa5-f1bb51bcb869 {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:43:34 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-d651fcfa-d77f-42c0-bf3a-bc1ec17f41a8 tempest-VolumesGetTest-1470935452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:43:34 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-d651fcfa-d77f-42c0-bf3a-bc1ec17f41a8 tempest-VolumesGetTest-1470935452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:43:34 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-d651fcfa-d77f-42c0-bf3a-bc1ec17f41a8 tempest-VolumesGetTest-1470935452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:43:34 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-d651fcfa-d77f-42c0-bf3a-bc1ec17f41a8 tempest-VolumesGetTest-1470935452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:43:34 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-d651fcfa-d77f-42c0-bf3a-bc1ec17f41a8 tempest-VolumesGetTest-1470935452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:43:34 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-d651fcfa-d77f-42c0-bf3a-bc1ec17f41a8 tempest-VolumesGetTest-1470935452 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:43:34 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-d651fcfa-d77f-42c0-bf3a-bc1ec17f41a8 tempest-VolumesGetTest-1470935452 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:43:34 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d651fcfa-d77f-42c0-bf3a-bc1ec17f41a8 tempest-VolumesGetTest-1470935452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-56b1d5d9-6fad-4571-9fa5-f1bb51bcb869 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:43:34 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-5897ffdf-c0dc-4e18-b9f1-fc1eaef84241 tempest-VolumesSnapshotTestJSON-2026192373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-0cc363e7-0e2e-4c0b-a194-5965540fe2d7" returned: 0 in 0.380s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:43:34 devstack sudo[99202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-56b1d5d9-6fad-4571-9fa5-f1bb51bcb869 1073741824 Sep 23 14:43:34 devstack sudo[99202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:43:34 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-5897ffdf-c0dc-4e18-b9f1-fc1eaef84241 tempest-VolumesSnapshotTestJSON-2026192373 None] Lock "cinder-quobyte-0cc363e7-0e2e-4c0b-a194-5965540fe2d7" released by "delete_volume" :: held 1.174s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:43:34 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-5897ffdf-c0dc-4e18-b9f1-fc1eaef84241 tempest-VolumesSnapshotTestJSON-2026192373 None] Created reservations ['2dc97801-e999-4f4b-8c93-4d3c0c5048ee', '6384c188-3ea0-4310-a619-5cafb292b4b1', '54166ab8-b7ff-4c36-9d4b-e57365439a11', '54c2fbbd-3d83-41f4-9ec5-dfbd5a12c489'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:43:34 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-5897ffdf-c0dc-4e18-b9f1-fc1eaef84241 tempest-VolumesSnapshotTestJSON-2026192373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:43:34 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-5897ffdf-c0dc-4e18-b9f1-fc1eaef84241 tempest-VolumesSnapshotTestJSON-2026192373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:43:34 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-5897ffdf-c0dc-4e18-b9f1-fc1eaef84241 tempest-VolumesSnapshotTestJSON-2026192373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:43:34 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-5897ffdf-c0dc-4e18-b9f1-fc1eaef84241 tempest-VolumesSnapshotTestJSON-2026192373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:43:34 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-5897ffdf-c0dc-4e18-b9f1-fc1eaef84241 tempest-VolumesSnapshotTestJSON-2026192373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:43:34 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-5897ffdf-c0dc-4e18-b9f1-fc1eaef84241 tempest-VolumesSnapshotTestJSON-2026192373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:43:34 devstack sudo[99204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:43:34 devstack sudo[99204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:43:34 devstack sudo[99204]: pam_unix(sudo:session): session closed for user root Sep 23 14:43:34 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-5897ffdf-c0dc-4e18-b9f1-fc1eaef84241 tempest-VolumesSnapshotTestJSON-2026192373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.284s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:43:34 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-5897ffdf-c0dc-4e18-b9f1-fc1eaef84241 tempest-VolumesSnapshotTestJSON-2026192373 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:43:34 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-5897ffdf-c0dc-4e18-b9f1-fc1eaef84241 tempest-VolumesSnapshotTestJSON-2026192373 None] Deleted volume successfully. Sep 23 14:43:35 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-5897ffdf-c0dc-4e18-b9f1-fc1eaef84241 tempest-VolumesSnapshotTestJSON-2026192373 None] Lock "cinder-0cc363e7-0e2e-4c0b-a194-5965540fe2d7-delete_volume" released by "delete_volume" :: held 1.814s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:43:35 devstack sudo[99202]: pam_unix(sudo:session): session closed for user root Sep 23 14:43:35 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d651fcfa-d77f-42c0-bf3a-bc1ec17f41a8 tempest-VolumesGetTest-1470935452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-56b1d5d9-6fad-4571-9fa5-f1bb51bcb869 1073741824" returned: 0 in 0.538s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:43:35 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d651fcfa-d77f-42c0-bf3a-bc1ec17f41a8 tempest-VolumesGetTest-1470935452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-56b1d5d9-6fad-4571-9fa5-f1bb51bcb869 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:43:35 devstack sudo[99211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-56b1d5d9-6fad-4571-9fa5-f1bb51bcb869 Sep 23 14:43:35 devstack sudo[99211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:43:35 devstack sudo[99211]: pam_unix(sudo:session): session closed for user root Sep 23 14:43:35 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d651fcfa-d77f-42c0-bf3a-bc1ec17f41a8 tempest-VolumesGetTest-1470935452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-56b1d5d9-6fad-4571-9fa5-f1bb51bcb869" returned: 0 in 0.298s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:43:35 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-d651fcfa-d77f-42c0-bf3a-bc1ec17f41a8 tempest-VolumesGetTest-1470935452 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:43:35 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-d651fcfa-d77f-42c0-bf3a-bc1ec17f41a8 tempest-VolumesGetTest-1470935452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.889s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:43:35 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-d651fcfa-d77f-42c0-bf3a-bc1ec17f41a8 tempest-VolumesGetTest-1470935452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (169c5c15-8353-4001-b744-ab5106d8d00b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56b1d5d9-6fad-4571-9fa5-f1bb51bcb869', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:43:35 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-d651fcfa-d77f-42c0-bf3a-bc1ec17f41a8 tempest-VolumesGetTest-1470935452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3fcf279-6e42-4063-a8e1-fa0d09862621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:43:35 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-d651fcfa-d77f-42c0-bf3a-bc1ec17f41a8 tempest-VolumesGetTest-1470935452 None] Volume volume-56b1d5d9-6fad-4571-9fa5-f1bb51bcb869 (56b1d5d9-6fad-4571-9fa5-f1bb51bcb869): created successfully Sep 23 14:43:35 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-d651fcfa-d77f-42c0-bf3a-bc1ec17f41a8 tempest-VolumesGetTest-1470935452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3fcf279-6e42-4063-a8e1-fa0d09862621) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:43:35 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-d651fcfa-d77f-42c0-bf3a-bc1ec17f41a8 tempest-VolumesGetTest-1470935452 None] Flow 'volume_create_manager' (ff525990-4d7c-4e12-b490-856e0cdb66d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:43:35 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-d651fcfa-d77f-42c0-bf3a-bc1ec17f41a8 tempest-VolumesGetTest-1470935452 None] Created volume successfully. Sep 23 14:43:36 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-229631cb-4273-47f8-861a-52461b1f4f43 tempest-VolumesSnapshotTestJSON-2026192373 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:43:36 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-229631cb-4273-47f8-861a-52461b1f4f43 tempest-VolumesSnapshotTestJSON-2026192373 None] Flow 'volume_create_manager' (8c6d5ef0-ca44-4171-8c24-b62ad5e4827f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:43:36 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-229631cb-4273-47f8-861a-52461b1f4f43 tempest-VolumesSnapshotTestJSON-2026192373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86130062-7b90-441b-adaf-a42fd103fd1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:43:36 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-229631cb-4273-47f8-861a-52461b1f4f43 tempest-VolumesSnapshotTestJSON-2026192373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86130062-7b90-441b-adaf-a42fd103fd1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:43:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1439021622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=731253f4-6a74-42c2-9363-06a913f3851a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc37b3f0f14743f98ec5678b6b1d8d57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:43:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:43:36Z,use_quota=True,user_id='2befd5b4c0e64f129ca6768bb143e6ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:43:36 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-229631cb-4273-47f8-861a-52461b1f4f43 tempest-VolumesSnapshotTestJSON-2026192373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93e3377a-367a-4177-bf48-2e09d53710ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:43:36 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-229631cb-4273-47f8-861a-52461b1f4f43 tempest-VolumesSnapshotTestJSON-2026192373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93e3377a-367a-4177-bf48-2e09d53710ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:43:36 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-229631cb-4273-47f8-861a-52461b1f4f43 tempest-VolumesSnapshotTestJSON-2026192373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ec6df90-bce3-4e31-91c8-1eb472a0cda0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:43:36 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-229631cb-4273-47f8-861a-52461b1f4f43 tempest-VolumesSnapshotTestJSON-2026192373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ec6df90-bce3-4e31-91c8-1eb472a0cda0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '731253f4-6a74-42c2-9363-06a913f3851a', 'volume_name': 'volume-731253f4-6a74-42c2-9363-06a913f3851a', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:43:36 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-229631cb-4273-47f8-861a-52461b1f4f43 tempest-VolumesSnapshotTestJSON-2026192373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b69108b4-e5d4-4d6e-ba98-4677b1833800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:43:36 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-229631cb-4273-47f8-861a-52461b1f4f43 tempest-VolumesSnapshotTestJSON-2026192373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b69108b4-e5d4-4d6e-ba98-4677b1833800) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:43:36 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-229631cb-4273-47f8-861a-52461b1f4f43 tempest-VolumesSnapshotTestJSON-2026192373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a20a0c17-9583-4bcb-af5d-a206c46711ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:43:36 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-229631cb-4273-47f8-861a-52461b1f4f43 tempest-VolumesSnapshotTestJSON-2026192373 None] Volume 731253f4-6a74-42c2-9363-06a913f3851a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-731253f4-6a74-42c2-9363-06a913f3851a', 'volume_size': 1} Sep 23 14:43:36 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-229631cb-4273-47f8-861a-52461b1f4f43 tempest-VolumesSnapshotTestJSON-2026192373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:43:36 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-229631cb-4273-47f8-861a-52461b1f4f43 tempest-VolumesSnapshotTestJSON-2026192373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:43:36 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-229631cb-4273-47f8-861a-52461b1f4f43 tempest-VolumesSnapshotTestJSON-2026192373 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:43:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1439021622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=731253f4-6a74-42c2-9363-06a913f3851a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc37b3f0f14743f98ec5678b6b1d8d57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:43:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:43:36Z,use_quota=True,user_id='2befd5b4c0e64f129ca6768bb143e6ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:43:36 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-229631cb-4273-47f8-861a-52461b1f4f43 tempest-VolumesSnapshotTestJSON-2026192373 None] Creating volume 731253f4-6a74-42c2-9363-06a913f3851a {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:43:36 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-229631cb-4273-47f8-861a-52461b1f4f43 tempest-VolumesSnapshotTestJSON-2026192373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:43:36 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-229631cb-4273-47f8-861a-52461b1f4f43 tempest-VolumesSnapshotTestJSON-2026192373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:43:36 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-229631cb-4273-47f8-861a-52461b1f4f43 tempest-VolumesSnapshotTestJSON-2026192373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:43:36 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-229631cb-4273-47f8-861a-52461b1f4f43 tempest-VolumesSnapshotTestJSON-2026192373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:43:36 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-229631cb-4273-47f8-861a-52461b1f4f43 tempest-VolumesSnapshotTestJSON-2026192373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:43:36 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-229631cb-4273-47f8-861a-52461b1f4f43 tempest-VolumesSnapshotTestJSON-2026192373 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:43:36 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-229631cb-4273-47f8-861a-52461b1f4f43 tempest-VolumesSnapshotTestJSON-2026192373 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:43:36 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-229631cb-4273-47f8-861a-52461b1f4f43 tempest-VolumesSnapshotTestJSON-2026192373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-731253f4-6a74-42c2-9363-06a913f3851a 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:43:36 devstack sudo[99214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-731253f4-6a74-42c2-9363-06a913f3851a 1073741824 Sep 23 14:43:36 devstack sudo[99214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:43:37 devstack sudo[99214]: pam_unix(sudo:session): session closed for user root Sep 23 14:43:37 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-229631cb-4273-47f8-861a-52461b1f4f43 tempest-VolumesSnapshotTestJSON-2026192373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-731253f4-6a74-42c2-9363-06a913f3851a 1073741824" returned: 0 in 0.699s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:43:37 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-229631cb-4273-47f8-861a-52461b1f4f43 tempest-VolumesSnapshotTestJSON-2026192373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-731253f4-6a74-42c2-9363-06a913f3851a {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:43:37 devstack sudo[99220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-731253f4-6a74-42c2-9363-06a913f3851a Sep 23 14:43:37 devstack sudo[99220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:43:37 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-34c1fe57-f983-41be-a428-598ee721ca77 tempest-VolumesGetTest-1470935452 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:43:37 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-34c1fe57-f983-41be-a428-598ee721ca77 tempest-VolumesGetTest-1470935452 None] Flow 'volume_create_manager' (e297ab50-2970-4f68-a616-0de8b8cf8e59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:43:37 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-34c1fe57-f983-41be-a428-598ee721ca77 tempest-VolumesGetTest-1470935452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b981fd54-1abd-4498-a66e-326ece408821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:43:37 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-34c1fe57-f983-41be-a428-598ee721ca77 tempest-VolumesGetTest-1470935452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b981fd54-1abd-4498-a66e-326ece408821) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:43:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-730196219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f061926-b121-4250-9879-82f9d9949909,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='00651445389c45f2aa5764549f6a9307',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:43:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=56b1d5d9-6fad-4571-9fa5-f1bb51bcb869,status='creating',terminated_at=None,updated_at=2026-09-23T12:43:37Z,use_quota=True,user_id='31a6159d91a940a48f5b4070277146b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:43:37 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-34c1fe57-f983-41be-a428-598ee721ca77 tempest-VolumesGetTest-1470935452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (359c56d4-3531-4c7b-9cbc-5d03c8edcc7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:43:37 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-34c1fe57-f983-41be-a428-598ee721ca77 tempest-VolumesGetTest-1470935452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (359c56d4-3531-4c7b-9cbc-5d03c8edcc7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:43:37 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-34c1fe57-f983-41be-a428-598ee721ca77 tempest-VolumesGetTest-1470935452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a6a40d7-9747-4ead-b51f-2da9b0002474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:43:37 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-34c1fe57-f983-41be-a428-598ee721ca77 tempest-VolumesGetTest-1470935452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a6a40d7-9747-4ead-b51f-2da9b0002474) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '1f061926-b121-4250-9879-82f9d9949909', 'volume_name': 'volume-1f061926-b121-4250-9879-82f9d9949909', 'volume_size': 1, 'source_volid': '56b1d5d9-6fad-4571-9fa5-f1bb51bcb869', 'source_volstatus': 'available'}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:43:37 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-34c1fe57-f983-41be-a428-598ee721ca77 tempest-VolumesGetTest-1470935452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e3f8072-385d-4846-b99d-1a62ba5d1915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:43:37 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-34c1fe57-f983-41be-a428-598ee721ca77 tempest-VolumesGetTest-1470935452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e3f8072-385d-4846-b99d-1a62ba5d1915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:43:37 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-34c1fe57-f983-41be-a428-598ee721ca77 tempest-VolumesGetTest-1470935452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f75e6f0-0716-487f-b4b0-f51e7c052580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:43:37 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-34c1fe57-f983-41be-a428-598ee721ca77 tempest-VolumesGetTest-1470935452 None] Volume 1f061926-b121-4250-9879-82f9d9949909: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-1f061926-b121-4250-9879-82f9d9949909', 'volume_size': 1, 'source_volid': '56b1d5d9-6fad-4571-9fa5-f1bb51bcb869', 'source_volstatus': 'available'} Sep 23 14:43:37 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-34c1fe57-f983-41be-a428-598ee721ca77 tempest-VolumesGetTest-1470935452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:43:37 devstack sudo[99220]: pam_unix(sudo:session): session closed for user root Sep 23 14:43:37 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-229631cb-4273-47f8-861a-52461b1f4f43 tempest-VolumesSnapshotTestJSON-2026192373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-731253f4-6a74-42c2-9363-06a913f3851a" returned: 0 in 0.324s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:43:37 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-229631cb-4273-47f8-861a-52461b1f4f43 tempest-VolumesSnapshotTestJSON-2026192373 None] <== create_volume: return (1085ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:43:37 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-229631cb-4273-47f8-861a-52461b1f4f43 tempest-VolumesSnapshotTestJSON-2026192373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.087s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:43:37 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-34c1fe57-f983-41be-a428-598ee721ca77 tempest-VolumesGetTest-1470935452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.031s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:43:37 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-34c1fe57-f983-41be-a428-598ee721ca77 tempest-VolumesGetTest-1470935452 None] Cloning volume 56b1d5d9-6fad-4571-9fa5-f1bb51bcb869 to volume 1f061926-b121-4250-9879-82f9d9949909 Sep 23 14:43:37 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-229631cb-4273-47f8-861a-52461b1f4f43 tempest-VolumesSnapshotTestJSON-2026192373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a20a0c17-9583-4bcb-af5d-a206c46711ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-731253f4-6a74-42c2-9363-06a913f3851a', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:43:37 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-229631cb-4273-47f8-861a-52461b1f4f43 tempest-VolumesSnapshotTestJSON-2026192373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (512d5bc0-42e7-435f-bd0c-1f73a48c4922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:43:37 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-229631cb-4273-47f8-861a-52461b1f4f43 tempest-VolumesSnapshotTestJSON-2026192373 None] Volume volume-731253f4-6a74-42c2-9363-06a913f3851a (731253f4-6a74-42c2-9363-06a913f3851a): created successfully Sep 23 14:43:37 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-229631cb-4273-47f8-861a-52461b1f4f43 tempest-VolumesSnapshotTestJSON-2026192373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (512d5bc0-42e7-435f-bd0c-1f73a48c4922) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:43:37 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-229631cb-4273-47f8-861a-52461b1f4f43 tempest-VolumesSnapshotTestJSON-2026192373 None] Flow 'volume_create_manager' (8c6d5ef0-ca44-4171-8c24-b62ad5e4827f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:43:37 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-229631cb-4273-47f8-861a-52461b1f4f43 tempest-VolumesSnapshotTestJSON-2026192373 None] Created volume successfully. Sep 23 14:43:37 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-34c1fe57-f983-41be-a428-598ee721ca77 tempest-VolumesGetTest-1470935452 None] Creating offline snapshot 84cc74fd-33fd-4cf3-874a-1c74271388a4 of volume 56b1d5d9-6fad-4571-9fa5-f1bb51bcb869 {{(pid=86310) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 14:43:37 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[e18d0a22-0024-4a62-838d-f6b7eda8d371]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:43:37 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-34c1fe57-f983-41be-a428-598ee721ca77 tempest-VolumesGetTest-1470935452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-56b1d5d9-6fad-4571-9fa5-f1bb51bcb869 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:43:37 devstack sudo[99223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-56b1d5d9-6fad-4571-9fa5-f1bb51bcb869 Sep 23 14:43:37 devstack sudo[99223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:43:37 devstack sudo[99223]: pam_unix(sudo:session): session closed for user root Sep 23 14:43:37 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-34c1fe57-f983-41be-a428-598ee721ca77 tempest-VolumesGetTest-1470935452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-56b1d5d9-6fad-4571-9fa5-f1bb51bcb869" returned: 0 in 0.413s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:43:37 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-34c1fe57-f983-41be-a428-598ee721ca77 tempest-VolumesGetTest-1470935452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-56b1d5d9-6fad-4571-9fa5-f1bb51bcb869,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-56b1d5d9-6fad-4571-9fa5-f1bb51bcb869.84cc74fd-33fd-4cf3-874a-1c74271388a4 1G {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:43:37 devstack sudo[99229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-56b1d5d9-6fad-4571-9fa5-f1bb51bcb869,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-56b1d5d9-6fad-4571-9fa5-f1bb51bcb869.84cc74fd-33fd-4cf3-874a-1c74271388a4 1G Sep 23 14:43:37 devstack sudo[99229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:43:38 devstack sudo[99229]: pam_unix(sudo:session): session closed for user root Sep 23 14:43:38 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-34c1fe57-f983-41be-a428-598ee721ca77 tempest-VolumesGetTest-1470935452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-56b1d5d9-6fad-4571-9fa5-f1bb51bcb869,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-56b1d5d9-6fad-4571-9fa5-f1bb51bcb869.84cc74fd-33fd-4cf3-874a-1c74271388a4 1G" returned: 0 in 0.471s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:43:38 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-34c1fe57-f983-41be-a428-598ee721ca77 tempest-VolumesGetTest-1470935452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56b1d5d9-6fad-4571-9fa5-f1bb51bcb869 -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-56b1d5d9-6fad-4571-9fa5-f1bb51bcb869.84cc74fd-33fd-4cf3-874a-1c74271388a4 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:43:38 devstack sudo[99235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56b1d5d9-6fad-4571-9fa5-f1bb51bcb869 -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-56b1d5d9-6fad-4571-9fa5-f1bb51bcb869.84cc74fd-33fd-4cf3-874a-1c74271388a4 Sep 23 14:43:38 devstack sudo[99235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:43:38 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-92478efa-95af-4479-8de0-431ff13e1d64 tempest-VolumesSnapshotTestJSON-2026192373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:43:38 devstack sudo[99235]: pam_unix(sudo:session): session closed for user root Sep 23 14:43:38 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-34c1fe57-f983-41be-a428-598ee721ca77 tempest-VolumesGetTest-1470935452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56b1d5d9-6fad-4571-9fa5-f1bb51bcb869 -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-56b1d5d9-6fad-4571-9fa5-f1bb51bcb869.84cc74fd-33fd-4cf3-874a-1c74271388a4" returned: 0 in 0.364s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:43:38 devstack cinder-volume[86310]: WARNING cinder.volume.drivers.remotefs [None req-34c1fe57-f983-41be-a428-598ee721ca77 tempest-VolumesGetTest-1470935452 None] /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-56b1d5d9-6fad-4571-9fa5-f1bb51bcb869.84cc74fd-33fd-4cf3-874a-1c74271388a4 is being set with open permissions: ugo+rw Sep 23 14:43:38 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-34c1fe57-f983-41be-a428-598ee721ca77 tempest-VolumesGetTest-1470935452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-56b1d5d9-6fad-4571-9fa5-f1bb51bcb869.84cc74fd-33fd-4cf3-874a-1c74271388a4 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:43:38 devstack sudo[99240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-56b1d5d9-6fad-4571-9fa5-f1bb51bcb869.84cc74fd-33fd-4cf3-874a-1c74271388a4 Sep 23 14:43:38 devstack sudo[99240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:43:39 devstack sudo[99240]: pam_unix(sudo:session): session closed for user root Sep 23 14:43:39 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-34c1fe57-f983-41be-a428-598ee721ca77 tempest-VolumesGetTest-1470935452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-56b1d5d9-6fad-4571-9fa5-f1bb51bcb869.84cc74fd-33fd-4cf3-874a-1c74271388a4" returned: 0 in 0.281s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:43:39 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-34c1fe57-f983-41be-a428-598ee721ca77 tempest-VolumesGetTest-1470935452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-56b1d5d9-6fad-4571-9fa5-f1bb51bcb869.info {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:43:39 devstack sudo[99247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-56b1d5d9-6fad-4571-9fa5-f1bb51bcb869.info Sep 23 14:43:39 devstack sudo[99247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:43:39 devstack sudo[99247]: pam_unix(sudo:session): session closed for user root Sep 23 14:43:39 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-34c1fe57-f983-41be-a428-598ee721ca77 tempest-VolumesGetTest-1470935452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-56b1d5d9-6fad-4571-9fa5-f1bb51bcb869.info" returned: 0 in 0.298s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:43:39 devstack cinder-volume[86310]: WARNING cinder.volume.drivers.remotefs [None req-34c1fe57-f983-41be-a428-598ee721ca77 tempest-VolumesGetTest-1470935452 None] /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-56b1d5d9-6fad-4571-9fa5-f1bb51bcb869.info is being set with open permissions: ugo+rw Sep 23 14:43:39 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-34c1fe57-f983-41be-a428-598ee721ca77 tempest-VolumesGetTest-1470935452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-56b1d5d9-6fad-4571-9fa5-f1bb51bcb869.info {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:43:39 devstack sudo[99250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-56b1d5d9-6fad-4571-9fa5-f1bb51bcb869.info Sep 23 14:43:39 devstack sudo[99250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:43:39 devstack sudo[99250]: pam_unix(sudo:session): session closed for user root Sep 23 14:43:39 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-34c1fe57-f983-41be-a428-598ee721ca77 tempest-VolumesGetTest-1470935452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-56b1d5d9-6fad-4571-9fa5-f1bb51bcb869.info" returned: 0 in 0.285s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:43:39 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-34c1fe57-f983-41be-a428-598ee721ca77 tempest-VolumesGetTest-1470935452 None] Acquiring lock "cinder-quobyte-1f061926-b121-4250-9879-82f9d9949909" by "_copy_volume_from_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:43:39 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-34c1fe57-f983-41be-a428-598ee721ca77 tempest-VolumesGetTest-1470935452 None] Lock "cinder-quobyte-1f061926-b121-4250-9879-82f9d9949909" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:43:39 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-34c1fe57-f983-41be-a428-598ee721ca77 tempest-VolumesGetTest-1470935452 None] snapshot: 84cc74fd-33fd-4cf3-874a-1c74271388a4, volume: 1f061926-b121-4250-9879-82f9d9949909, {{(pid=86310) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 23 14:43:39 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-34c1fe57-f983-41be-a428-598ee721ca77 tempest-VolumesGetTest-1470935452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:43:39 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-34c1fe57-f983-41be-a428-598ee721ca77 tempest-VolumesGetTest-1470935452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:43:39 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-34c1fe57-f983-41be-a428-598ee721ca77 tempest-VolumesGetTest-1470935452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:43:39 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-34c1fe57-f983-41be-a428-598ee721ca77 tempest-VolumesGetTest-1470935452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:43:39 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-34c1fe57-f983-41be-a428-598ee721ca77 tempest-VolumesGetTest-1470935452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:43:39 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de3598b-35e3-45d7-89a1-9fb302332ee0]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:43:39 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-34c1fe57-f983-41be-a428-598ee721ca77 tempest-VolumesGetTest-1470935452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-56b1d5d9-6fad-4571-9fa5-f1bb51bcb869.84cc74fd-33fd-4cf3-874a-1c74271388a4 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:43:39 devstack sudo[99253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-56b1d5d9-6fad-4571-9fa5-f1bb51bcb869.84cc74fd-33fd-4cf3-874a-1c74271388a4 Sep 23 14:43:39 devstack sudo[99253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:43:40 devstack sudo[99253]: pam_unix(sudo:session): session closed for user root Sep 23 14:43:40 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-34c1fe57-f983-41be-a428-598ee721ca77 tempest-VolumesGetTest-1470935452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-56b1d5d9-6fad-4571-9fa5-f1bb51bcb869.84cc74fd-33fd-4cf3-874a-1c74271388a4" returned: 0 in 0.565s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:43:40 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-34c1fe57-f983-41be-a428-598ee721ca77 tempest-VolumesGetTest-1470935452 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-56b1d5d9-6fad-4571-9fa5-f1bb51bcb869(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 14:43:40 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[656cf02d-3f9f-4ad1-b1cd-a6872237f474]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:43:40 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-34c1fe57-f983-41be-a428-598ee721ca77 tempest-VolumesGetTest-1470935452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-56b1d5d9-6fad-4571-9fa5-f1bb51bcb869 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:43:40 devstack sudo[99261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-56b1d5d9-6fad-4571-9fa5-f1bb51bcb869 Sep 23 14:43:40 devstack sudo[99261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:43:40 devstack sudo[99261]: pam_unix(sudo:session): session closed for user root Sep 23 14:43:40 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-34c1fe57-f983-41be-a428-598ee721ca77 tempest-VolumesGetTest-1470935452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-56b1d5d9-6fad-4571-9fa5-f1bb51bcb869" returned: 0 in 0.414s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:43:40 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-34c1fe57-f983-41be-a428-598ee721ca77 tempest-VolumesGetTest-1470935452 None] will copy from snapshot at /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-56b1d5d9-6fad-4571-9fa5-f1bb51bcb869 {{(pid=86310) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 23 14:43:40 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-34c1fe57-f983-41be-a428-598ee721ca77 tempest-VolumesGetTest-1470935452 None] Creating direct copy from snapshot {{(pid=86310) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 23 14:43:40 devstack cinder-volume[86310]: DEBUG cinder.utils [None req-34c1fe57-f983-41be-a428-598ee721ca77 tempest-VolumesGetTest-1470935452 None] Path /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-1f061926-b121-4250-9879-82f9d9949909 not found in is_blk_device check {{(pid=86310) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 23 14:43:40 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-34c1fe57-f983-41be-a428-598ee721ca77 tempest-VolumesGetTest-1470935452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-56b1d5d9-6fad-4571-9fa5-f1bb51bcb869 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-1f061926-b121-4250-9879-82f9d9949909 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:43:40 devstack sudo[99266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-56b1d5d9-6fad-4571-9fa5-f1bb51bcb869 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-1f061926-b121-4250-9879-82f9d9949909 Sep 23 14:43:40 devstack sudo[99266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:43:43 devstack cinder-volume[86310]: INFO cinder.volume.manager [req-dfc8382f-7d33-4276-915c-fe2cc5c854db req-84fd79c9-416d-45dc-aab5-8a7223ada2f0 tempest-TestMinimumBasicScenario-596633662 None] Terminate volume connection completed successfully. Sep 23 14:43:43 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [req-dfc8382f-7d33-4276-915c-fe2cc5c854db req-84fd79c9-416d-45dc-aab5-8a7223ada2f0 tempest-TestMinimumBasicScenario-596633662 None] Deleting attachment 9fcfc7f2-df53-46c3-8ea5-d18ed8dd6f12. {{(pid=86310) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 14:43:44 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-f6d0b312-cf8d-4ff9-8b27-56e375a2aa94 tempest-TestMinimumBasicScenario-596633662 None] Acquiring lock "cinder-300dcc93-73bc-41c8-a80e-1673383aa69f-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:43:44 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-f6d0b312-cf8d-4ff9-8b27-56e375a2aa94 tempest-TestMinimumBasicScenario-596633662 None] Lock "cinder-300dcc93-73bc-41c8-a80e-1673383aa69f-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:43:44 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-f6d0b312-cf8d-4ff9-8b27-56e375a2aa94 tempest-TestMinimumBasicScenario-596633662 None] Acquiring lock "cinder-quobyte-300dcc93-73bc-41c8-a80e-1673383aa69f" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:43:44 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-f6d0b312-cf8d-4ff9-8b27-56e375a2aa94 tempest-TestMinimumBasicScenario-596633662 None] Lock "cinder-quobyte-300dcc93-73bc-41c8-a80e-1673383aa69f" acquired by "delete_volume" :: waited 0.040s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:43:44 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[91f66bb0-4be9-4eca-baa9-7d5451b81ab0]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:43:44 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-f6d0b312-cf8d-4ff9-8b27-56e375a2aa94 tempest-TestMinimumBasicScenario-596633662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-300dcc93-73bc-41c8-a80e-1673383aa69f {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:43:44 devstack sudo[99284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-300dcc93-73bc-41c8-a80e-1673383aa69f Sep 23 14:43:44 devstack sudo[99284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:43:45 devstack sudo[99284]: pam_unix(sudo:session): session closed for user root Sep 23 14:43:45 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-f6d0b312-cf8d-4ff9-8b27-56e375a2aa94 tempest-TestMinimumBasicScenario-596633662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-300dcc93-73bc-41c8-a80e-1673383aa69f" returned: 0 in 1.077s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:43:45 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-f6d0b312-cf8d-4ff9-8b27-56e375a2aa94 tempest-TestMinimumBasicScenario-596633662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-300dcc93-73bc-41c8-a80e-1673383aa69f {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:43:45 devstack sudo[99291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-300dcc93-73bc-41c8-a80e-1673383aa69f Sep 23 14:43:45 devstack sudo[99291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:43:45 devstack sudo[99291]: pam_unix(sudo:session): session closed for user root Sep 23 14:43:45 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-f6d0b312-cf8d-4ff9-8b27-56e375a2aa94 tempest-TestMinimumBasicScenario-596633662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-300dcc93-73bc-41c8-a80e-1673383aa69f" returned: 0 in 0.507s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:43:46 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-f6d0b312-cf8d-4ff9-8b27-56e375a2aa94 tempest-TestMinimumBasicScenario-596633662 None] Lock "cinder-quobyte-300dcc93-73bc-41c8-a80e-1673383aa69f" released by "delete_volume" :: held 1.731s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:43:46 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-f6d0b312-cf8d-4ff9-8b27-56e375a2aa94 tempest-TestMinimumBasicScenario-596633662 None] Created reservations ['d9b570aa-730c-40a1-81fb-d4c8ba38297e', '8de6655a-4834-4499-b1fa-7f848274b33a', '968cbc35-f222-4c32-8dee-a47b5bf58116', '149c16db-0a1f-425a-a9a8-4dcb812c1562'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:43:46 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-f6d0b312-cf8d-4ff9-8b27-56e375a2aa94 tempest-TestMinimumBasicScenario-596633662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:43:46 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-f6d0b312-cf8d-4ff9-8b27-56e375a2aa94 tempest-TestMinimumBasicScenario-596633662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:43:46 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-f6d0b312-cf8d-4ff9-8b27-56e375a2aa94 tempest-TestMinimumBasicScenario-596633662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:43:46 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-f6d0b312-cf8d-4ff9-8b27-56e375a2aa94 tempest-TestMinimumBasicScenario-596633662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:43:46 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-f6d0b312-cf8d-4ff9-8b27-56e375a2aa94 tempest-TestMinimumBasicScenario-596633662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:43:46 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-f6d0b312-cf8d-4ff9-8b27-56e375a2aa94 tempest-TestMinimumBasicScenario-596633662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:43:46 devstack sudo[99295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:43:46 devstack sudo[99295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:43:47 devstack sudo[99295]: pam_unix(sudo:session): session closed for user root Sep 23 14:43:47 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-f6d0b312-cf8d-4ff9-8b27-56e375a2aa94 tempest-TestMinimumBasicScenario-596633662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.746s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:43:47 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-f6d0b312-cf8d-4ff9-8b27-56e375a2aa94 tempest-TestMinimumBasicScenario-596633662 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:43:47 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-f6d0b312-cf8d-4ff9-8b27-56e375a2aa94 tempest-TestMinimumBasicScenario-596633662 None] Deleted volume successfully. Sep 23 14:43:47 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-f6d0b312-cf8d-4ff9-8b27-56e375a2aa94 tempest-TestMinimumBasicScenario-596633662 None] Lock "cinder-300dcc93-73bc-41c8-a80e-1673383aa69f-delete_volume" released by "delete_volume" :: held 3.263s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:43:51 devstack sudo[99266]: pam_unix(sudo:session): session closed for user root Sep 23 14:43:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-34c1fe57-f983-41be-a428-598ee721ca77 tempest-VolumesGetTest-1470935452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-56b1d5d9-6fad-4571-9fa5-f1bb51bcb869 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-1f061926-b121-4250-9879-82f9d9949909" returned: 0 in 10.386s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:43:51 devstack cinder-volume[86310]: DEBUG cinder.image.image_utils [None req-34c1fe57-f983-41be-a428-598ee721ca77 tempest-VolumesGetTest-1470935452 None] Image conversion details: src /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-56b1d5d9-6fad-4571-9fa5-f1bb51bcb869, size 1024.00 MB, duration 10.39 sec, destination /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-1f061926-b121-4250-9879-82f9d9949909 {{(pid=86310) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 14:43:51 devstack cinder-volume[86310]: INFO cinder.image.image_utils [None req-34c1fe57-f983-41be-a428-598ee721ca77 tempest-VolumesGetTest-1470935452 None] Converted 1024.00 MB image at 98.58 MB/s Sep 23 14:43:51 devstack cinder-volume[86310]: WARNING cinder.volume.drivers.remotefs [None req-34c1fe57-f983-41be-a428-598ee721ca77 tempest-VolumesGetTest-1470935452 None] /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-1f061926-b121-4250-9879-82f9d9949909 is being set with open permissions: ugo+rw Sep 23 14:43:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-34c1fe57-f983-41be-a428-598ee721ca77 tempest-VolumesGetTest-1470935452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-1f061926-b121-4250-9879-82f9d9949909 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:43:51 devstack sudo[99322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-1f061926-b121-4250-9879-82f9d9949909 Sep 23 14:43:51 devstack sudo[99322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:43:51 devstack cinder-volume[86310]: DEBUG oslo_service.periodic_task [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86310) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 14:43:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:43:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:43:51 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:43:51 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:43:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:43:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:43:51 devstack sudo[99325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:43:51 devstack sudo[99325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:43:51 devstack sudo[99322]: pam_unix(sudo:session): session closed for user root Sep 23 14:43:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-34c1fe57-f983-41be-a428-598ee721ca77 tempest-VolumesGetTest-1470935452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-1f061926-b121-4250-9879-82f9d9949909" returned: 0 in 0.341s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:43:51 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-34c1fe57-f983-41be-a428-598ee721ca77 tempest-VolumesGetTest-1470935452 None] Lock "cinder-quobyte-1f061926-b121-4250-9879-82f9d9949909" released by "_copy_volume_from_snapshot" :: held 11.809s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:43:51 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-34c1fe57-f983-41be-a428-598ee721ca77 tempest-VolumesGetTest-1470935452 None] Acquiring lock "cinder-quobyte-84cc74fd-33fd-4cf3-874a-1c74271388a4" by "_delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:43:51 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-34c1fe57-f983-41be-a428-598ee721ca77 tempest-VolumesGetTest-1470935452 None] Lock "cinder-quobyte-84cc74fd-33fd-4cf3-874a-1c74271388a4" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:43:51 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-34c1fe57-f983-41be-a428-598ee721ca77 tempest-VolumesGetTest-1470935452 None] Deleting offline snapshot 84cc74fd-33fd-4cf3-874a-1c74271388a4 of volume 56b1d5d9-6fad-4571-9fa5-f1bb51bcb869 {{(pid=86310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 14:43:51 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-34c1fe57-f983-41be-a428-598ee721ca77 tempest-VolumesGetTest-1470935452 None] snapshot_file for this snap is: volume-56b1d5d9-6fad-4571-9fa5-f1bb51bcb869.84cc74fd-33fd-4cf3-874a-1c74271388a4 {{(pid=86310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 14:43:51 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9e645b8-e261-458a-9a39-278d389f596c]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:43:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-34c1fe57-f983-41be-a428-598ee721ca77 tempest-VolumesGetTest-1470935452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-56b1d5d9-6fad-4571-9fa5-f1bb51bcb869.84cc74fd-33fd-4cf3-874a-1c74271388a4 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:43:51 devstack sudo[99325]: pam_unix(sudo:session): session closed for user root Sep 23 14:43:51 devstack sudo[99327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-56b1d5d9-6fad-4571-9fa5-f1bb51bcb869.84cc74fd-33fd-4cf3-874a-1c74271388a4 Sep 23 14:43:51 devstack sudo[99327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:43:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.312s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:43:51 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:43:51 devstack cinder-volume[86310]: DEBUG oslo_service.periodic_task [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Running periodic task VolumeManager._thread_info {{(pid=86310) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 14:43:51 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] thread count: 28 {{(pid=86310) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 14:43:51 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] thread info: [<_MainThread(MainThread, started 128854208852096)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86310) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 14:43:52 devstack sudo[99327]: pam_unix(sudo:session): session closed for user root Sep 23 14:43:52 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-34c1fe57-f983-41be-a428-598ee721ca77 tempest-VolumesGetTest-1470935452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-56b1d5d9-6fad-4571-9fa5-f1bb51bcb869.84cc74fd-33fd-4cf3-874a-1c74271388a4" returned: 0 in 0.433s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:43:52 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-34c1fe57-f983-41be-a428-598ee721ca77 tempest-VolumesGetTest-1470935452 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-56b1d5d9-6fad-4571-9fa5-f1bb51bcb869(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 14:43:52 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[a444227c-f75b-4e3a-bde8-a1cc2a4921e3]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:43:52 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-34c1fe57-f983-41be-a428-598ee721ca77 tempest-VolumesGetTest-1470935452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-56b1d5d9-6fad-4571-9fa5-f1bb51bcb869 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:43:52 devstack sudo[99333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-56b1d5d9-6fad-4571-9fa5-f1bb51bcb869 Sep 23 14:43:52 devstack sudo[99333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:43:52 devstack sudo[99333]: pam_unix(sudo:session): session closed for user root Sep 23 14:43:52 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-34c1fe57-f983-41be-a428-598ee721ca77 tempest-VolumesGetTest-1470935452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-56b1d5d9-6fad-4571-9fa5-f1bb51bcb869" returned: 0 in 0.663s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:43:52 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-34c1fe57-f983-41be-a428-598ee721ca77 tempest-VolumesGetTest-1470935452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-56b1d5d9-6fad-4571-9fa5-f1bb51bcb869.84cc74fd-33fd-4cf3-874a-1c74271388a4 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:43:52 devstack sudo[99339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-56b1d5d9-6fad-4571-9fa5-f1bb51bcb869.84cc74fd-33fd-4cf3-874a-1c74271388a4 Sep 23 14:43:52 devstack sudo[99339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:43:53 devstack sudo[99339]: pam_unix(sudo:session): session closed for user root Sep 23 14:43:53 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-34c1fe57-f983-41be-a428-598ee721ca77 tempest-VolumesGetTest-1470935452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-56b1d5d9-6fad-4571-9fa5-f1bb51bcb869.84cc74fd-33fd-4cf3-874a-1c74271388a4" returned: 0 in 0.448s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:43:53 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-34c1fe57-f983-41be-a428-598ee721ca77 tempest-VolumesGetTest-1470935452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-56b1d5d9-6fad-4571-9fa5-f1bb51bcb869.84cc74fd-33fd-4cf3-874a-1c74271388a4 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:43:53 devstack sudo[99344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-56b1d5d9-6fad-4571-9fa5-f1bb51bcb869.84cc74fd-33fd-4cf3-874a-1c74271388a4 Sep 23 14:43:53 devstack sudo[99344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:43:53 devstack sudo[99344]: pam_unix(sudo:session): session closed for user root Sep 23 14:43:53 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-34c1fe57-f983-41be-a428-598ee721ca77 tempest-VolumesGetTest-1470935452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-56b1d5d9-6fad-4571-9fa5-f1bb51bcb869.84cc74fd-33fd-4cf3-874a-1c74271388a4" returned: 0 in 0.313s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:43:53 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-34c1fe57-f983-41be-a428-598ee721ca77 tempest-VolumesGetTest-1470935452 None] Lock "cinder-quobyte-84cc74fd-33fd-4cf3-874a-1c74271388a4" released by "_delete_snapshot" :: held 2.042s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:43:53 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d000df5-ea5d-46ca-833f-f9ffc792d0c2 tempest-TestImageHashVerification-489684057 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:43:53 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-9d000df5-ea5d-46ca-833f-f9ffc792d0c2 tempest-TestImageHashVerification-489684057 None] Flow 'volume_create_manager' (b1d5cb56-fd26-4bf9-8566-52847776bbcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:43:53 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-9d000df5-ea5d-46ca-833f-f9ffc792d0c2 tempest-TestImageHashVerification-489684057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (986738cb-8370-4cf4-9f73-0d2e8f739292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:43:53 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-9d000df5-ea5d-46ca-833f-f9ffc792d0c2 tempest-TestImageHashVerification-489684057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (986738cb-8370-4cf4-9f73-0d2e8f739292) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:43:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-866245521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93d6305d-bf3d-4857-bf3e-02ac4e7fe95e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7970dc3395e946a7a35197e4b3951fa5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:43:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:43:54Z,use_quota=True,user_id='9329706830ce47d5959c344c35a958e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:43:53 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-9d000df5-ea5d-46ca-833f-f9ffc792d0c2 tempest-TestImageHashVerification-489684057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78547c86-a76c-462e-8e17-3f4038886800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:43:53 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-9d000df5-ea5d-46ca-833f-f9ffc792d0c2 tempest-TestImageHashVerification-489684057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78547c86-a76c-462e-8e17-3f4038886800) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:43:53 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-9d000df5-ea5d-46ca-833f-f9ffc792d0c2 tempest-TestImageHashVerification-489684057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c719cc2-fce5-458b-b517-935393d5ead5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:43:53 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-9d000df5-ea5d-46ca-833f-f9ffc792d0c2 tempest-TestImageHashVerification-489684057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c719cc2-fce5-458b-b517-935393d5ead5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93d6305d-bf3d-4857-bf3e-02ac4e7fe95e', 'volume_name': 'volume-93d6305d-bf3d-4857-bf3e-02ac4e7fe95e', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:43:53 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-9d000df5-ea5d-46ca-833f-f9ffc792d0c2 tempest-TestImageHashVerification-489684057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d10d0815-6c82-4462-b4f8-cbcf4b425f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:43:53 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-9d000df5-ea5d-46ca-833f-f9ffc792d0c2 tempest-TestImageHashVerification-489684057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d10d0815-6c82-4462-b4f8-cbcf4b425f66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:43:53 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-9d000df5-ea5d-46ca-833f-f9ffc792d0c2 tempest-TestImageHashVerification-489684057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8c297d2-ebff-455b-a9e8-7cae563d2ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:43:53 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-9d000df5-ea5d-46ca-833f-f9ffc792d0c2 tempest-TestImageHashVerification-489684057 None] Volume 93d6305d-bf3d-4857-bf3e-02ac4e7fe95e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93d6305d-bf3d-4857-bf3e-02ac4e7fe95e', 'volume_size': 1} Sep 23 14:43:53 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-9d000df5-ea5d-46ca-833f-f9ffc792d0c2 tempest-TestImageHashVerification-489684057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:43:53 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-34c1fe57-f983-41be-a428-598ee721ca77 tempest-VolumesGetTest-1470935452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.319s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:43:53 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-92478efa-95af-4479-8de0-431ff13e1d64 tempest-VolumesSnapshotTestJSON-2026192373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 15.148s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:43:53 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-34c1fe57-f983-41be-a428-598ee721ca77 tempest-VolumesGetTest-1470935452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f75e6f0-0716-487f-b4b0-f51e7c052580) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f061926-b121-4250-9879-82f9d9949909', 'volume_size': 1, 'source_volid': '56b1d5d9-6fad-4571-9fa5-f1bb51bcb869', 'source_volstatus': 'available'}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:43:53 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-34c1fe57-f983-41be-a428-598ee721ca77 tempest-VolumesGetTest-1470935452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93ccf271-928d-48e0-91cc-83cb950d431c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:43:53 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-92478efa-95af-4479-8de0-431ff13e1d64 tempest-VolumesSnapshotTestJSON-2026192373 None] Creating offline snapshot 9bbcf549-9bf1-42ac-9cb8-42d2b01b617b of volume 731253f4-6a74-42c2-9363-06a913f3851a {{(pid=86310) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 14:43:53 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-34c1fe57-f983-41be-a428-598ee721ca77 tempest-VolumesGetTest-1470935452 None] Volume volume-1f061926-b121-4250-9879-82f9d9949909 (1f061926-b121-4250-9879-82f9d9949909): created successfully Sep 23 14:43:53 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-34c1fe57-f983-41be-a428-598ee721ca77 tempest-VolumesGetTest-1470935452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93ccf271-928d-48e0-91cc-83cb950d431c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:43:53 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-34c1fe57-f983-41be-a428-598ee721ca77 tempest-VolumesGetTest-1470935452 None] Flow 'volume_create_manager' (e297ab50-2970-4f68-a616-0de8b8cf8e59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:43:53 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc03d00e-ab53-4031-9fa0-eb9e597fb107]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:43:53 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-92478efa-95af-4479-8de0-431ff13e1d64 tempest-VolumesSnapshotTestJSON-2026192373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-731253f4-6a74-42c2-9363-06a913f3851a {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:43:53 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-34c1fe57-f983-41be-a428-598ee721ca77 tempest-VolumesGetTest-1470935452 None] Created volume successfully. Sep 23 14:43:53 devstack sudo[99347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-731253f4-6a74-42c2-9363-06a913f3851a Sep 23 14:43:53 devstack sudo[99347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:43:54 devstack sudo[99347]: pam_unix(sudo:session): session closed for user root Sep 23 14:43:54 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-92478efa-95af-4479-8de0-431ff13e1d64 tempest-VolumesSnapshotTestJSON-2026192373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-731253f4-6a74-42c2-9363-06a913f3851a" returned: 0 in 0.423s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:43:54 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-92478efa-95af-4479-8de0-431ff13e1d64 tempest-VolumesSnapshotTestJSON-2026192373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-731253f4-6a74-42c2-9363-06a913f3851a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-731253f4-6a74-42c2-9363-06a913f3851a.9bbcf549-9bf1-42ac-9cb8-42d2b01b617b 1G {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:43:54 devstack sudo[99353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-731253f4-6a74-42c2-9363-06a913f3851a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-731253f4-6a74-42c2-9363-06a913f3851a.9bbcf549-9bf1-42ac-9cb8-42d2b01b617b 1G Sep 23 14:43:54 devstack sudo[99353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:43:54 devstack sudo[99353]: pam_unix(sudo:session): session closed for user root Sep 23 14:43:54 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-92478efa-95af-4479-8de0-431ff13e1d64 tempest-VolumesSnapshotTestJSON-2026192373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-731253f4-6a74-42c2-9363-06a913f3851a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-731253f4-6a74-42c2-9363-06a913f3851a.9bbcf549-9bf1-42ac-9cb8-42d2b01b617b 1G" returned: 0 in 0.491s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:43:54 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-92478efa-95af-4479-8de0-431ff13e1d64 tempest-VolumesSnapshotTestJSON-2026192373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-731253f4-6a74-42c2-9363-06a913f3851a -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-731253f4-6a74-42c2-9363-06a913f3851a.9bbcf549-9bf1-42ac-9cb8-42d2b01b617b {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:43:54 devstack sudo[99359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-731253f4-6a74-42c2-9363-06a913f3851a -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-731253f4-6a74-42c2-9363-06a913f3851a.9bbcf549-9bf1-42ac-9cb8-42d2b01b617b Sep 23 14:43:54 devstack sudo[99359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:43:55 devstack sudo[99359]: pam_unix(sudo:session): session closed for user root Sep 23 14:43:55 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-92478efa-95af-4479-8de0-431ff13e1d64 tempest-VolumesSnapshotTestJSON-2026192373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-731253f4-6a74-42c2-9363-06a913f3851a -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-731253f4-6a74-42c2-9363-06a913f3851a.9bbcf549-9bf1-42ac-9cb8-42d2b01b617b" returned: 0 in 0.329s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:43:55 devstack cinder-volume[86310]: WARNING cinder.volume.drivers.remotefs [None req-92478efa-95af-4479-8de0-431ff13e1d64 tempest-VolumesSnapshotTestJSON-2026192373 None] /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-731253f4-6a74-42c2-9363-06a913f3851a.9bbcf549-9bf1-42ac-9cb8-42d2b01b617b is being set with open permissions: ugo+rw Sep 23 14:43:55 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-92478efa-95af-4479-8de0-431ff13e1d64 tempest-VolumesSnapshotTestJSON-2026192373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-731253f4-6a74-42c2-9363-06a913f3851a.9bbcf549-9bf1-42ac-9cb8-42d2b01b617b {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:43:55 devstack sudo[99365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-731253f4-6a74-42c2-9363-06a913f3851a.9bbcf549-9bf1-42ac-9cb8-42d2b01b617b Sep 23 14:43:55 devstack sudo[99365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:43:55 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-f696e738-4bfe-4119-a12a-06c798da7a21 tempest-VolumesGetTest-1470935452 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:43:55 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-f696e738-4bfe-4119-a12a-06c798da7a21 tempest-VolumesGetTest-1470935452 None] Flow 'volume_create_manager' (8641c0c6-8bb4-4ef0-85d5-8d9c790eee4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:43:55 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-f696e738-4bfe-4119-a12a-06c798da7a21 tempest-VolumesGetTest-1470935452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05ae7505-2d56-44eb-a582-62a1d7527124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:43:55 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-f696e738-4bfe-4119-a12a-06c798da7a21 tempest-VolumesGetTest-1470935452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05ae7505-2d56-44eb-a582-62a1d7527124) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:43:55Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-394807435',display_name='tempest-VolumesGetTest-Volume-270970742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11261407-6c86-4f09-8f73-0017c60b63fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00651445389c45f2aa5764549f6a9307',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:43:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:43:55Z,use_quota=True,user_id='31a6159d91a940a48f5b4070277146b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:43:55 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-f696e738-4bfe-4119-a12a-06c798da7a21 tempest-VolumesGetTest-1470935452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b961f32c-2566-4315-958b-74e5e6dcd0ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:43:55 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-f696e738-4bfe-4119-a12a-06c798da7a21 tempest-VolumesGetTest-1470935452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b961f32c-2566-4315-958b-74e5e6dcd0ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:43:55 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-f696e738-4bfe-4119-a12a-06c798da7a21 tempest-VolumesGetTest-1470935452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f2a7522-c530-4808-93d7-f6fe19762402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:43:55 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-f696e738-4bfe-4119-a12a-06c798da7a21 tempest-VolumesGetTest-1470935452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f2a7522-c530-4808-93d7-f6fe19762402) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11261407-6c86-4f09-8f73-0017c60b63fc', 'volume_name': 'volume-11261407-6c86-4f09-8f73-0017c60b63fc', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:43:55 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-f696e738-4bfe-4119-a12a-06c798da7a21 tempest-VolumesGetTest-1470935452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d582225-e7da-4214-98fe-c97753efcba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:43:55 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-f696e738-4bfe-4119-a12a-06c798da7a21 tempest-VolumesGetTest-1470935452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d582225-e7da-4214-98fe-c97753efcba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:43:55 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-f696e738-4bfe-4119-a12a-06c798da7a21 tempest-VolumesGetTest-1470935452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (896d07f0-3323-47f3-b89a-97d0d63c3dcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:43:55 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-f696e738-4bfe-4119-a12a-06c798da7a21 tempest-VolumesGetTest-1470935452 None] Volume 11261407-6c86-4f09-8f73-0017c60b63fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11261407-6c86-4f09-8f73-0017c60b63fc', 'volume_size': 1} Sep 23 14:43:55 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-f696e738-4bfe-4119-a12a-06c798da7a21 tempest-VolumesGetTest-1470935452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:43:55 devstack sudo[99365]: pam_unix(sudo:session): session closed for user root Sep 23 14:43:55 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-92478efa-95af-4479-8de0-431ff13e1d64 tempest-VolumesSnapshotTestJSON-2026192373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-731253f4-6a74-42c2-9363-06a913f3851a.9bbcf549-9bf1-42ac-9cb8-42d2b01b617b" returned: 0 in 0.277s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:43:55 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-92478efa-95af-4479-8de0-431ff13e1d64 tempest-VolumesSnapshotTestJSON-2026192373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-731253f4-6a74-42c2-9363-06a913f3851a.info {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:43:55 devstack sudo[99368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-731253f4-6a74-42c2-9363-06a913f3851a.info Sep 23 14:43:55 devstack sudo[99368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:43:55 devstack sudo[99368]: pam_unix(sudo:session): session closed for user root Sep 23 14:43:55 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-92478efa-95af-4479-8de0-431ff13e1d64 tempest-VolumesSnapshotTestJSON-2026192373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-731253f4-6a74-42c2-9363-06a913f3851a.info" returned: 0 in 0.254s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:43:55 devstack cinder-volume[86310]: WARNING cinder.volume.drivers.remotefs [None req-92478efa-95af-4479-8de0-431ff13e1d64 tempest-VolumesSnapshotTestJSON-2026192373 None] /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-731253f4-6a74-42c2-9363-06a913f3851a.info is being set with open permissions: ugo+rw Sep 23 14:43:55 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-92478efa-95af-4479-8de0-431ff13e1d64 tempest-VolumesSnapshotTestJSON-2026192373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-731253f4-6a74-42c2-9363-06a913f3851a.info {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:43:55 devstack sudo[99371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-731253f4-6a74-42c2-9363-06a913f3851a.info Sep 23 14:43:55 devstack sudo[99371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:43:55 devstack sudo[99371]: pam_unix(sudo:session): session closed for user root Sep 23 14:43:55 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-92478efa-95af-4479-8de0-431ff13e1d64 tempest-VolumesSnapshotTestJSON-2026192373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-731253f4-6a74-42c2-9363-06a913f3851a.info" returned: 0 in 0.238s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:43:55 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-92478efa-95af-4479-8de0-431ff13e1d64 tempest-VolumesSnapshotTestJSON-2026192373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.125s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:43:55 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-9d000df5-ea5d-46ca-833f-f9ffc792d0c2 tempest-TestImageHashVerification-489684057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.144s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:43:55 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-9d000df5-ea5d-46ca-833f-f9ffc792d0c2 tempest-TestImageHashVerification-489684057 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:43:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-866245521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93d6305d-bf3d-4857-bf3e-02ac4e7fe95e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7970dc3395e946a7a35197e4b3951fa5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:43:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:43:54Z,use_quota=True,user_id='9329706830ce47d5959c344c35a958e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:43:55 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-9d000df5-ea5d-46ca-833f-f9ffc792d0c2 tempest-TestImageHashVerification-489684057 None] Creating volume 93d6305d-bf3d-4857-bf3e-02ac4e7fe95e {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:43:55 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-9d000df5-ea5d-46ca-833f-f9ffc792d0c2 tempest-TestImageHashVerification-489684057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:43:55 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-9d000df5-ea5d-46ca-833f-f9ffc792d0c2 tempest-TestImageHashVerification-489684057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:43:55 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-9d000df5-ea5d-46ca-833f-f9ffc792d0c2 tempest-TestImageHashVerification-489684057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:43:55 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-9d000df5-ea5d-46ca-833f-f9ffc792d0c2 tempest-TestImageHashVerification-489684057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:43:55 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-9d000df5-ea5d-46ca-833f-f9ffc792d0c2 tempest-TestImageHashVerification-489684057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:43:55 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-9d000df5-ea5d-46ca-833f-f9ffc792d0c2 tempest-TestImageHashVerification-489684057 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:43:55 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-9d000df5-ea5d-46ca-833f-f9ffc792d0c2 tempest-TestImageHashVerification-489684057 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:43:55 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-9d000df5-ea5d-46ca-833f-f9ffc792d0c2 tempest-TestImageHashVerification-489684057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-93d6305d-bf3d-4857-bf3e-02ac4e7fe95e 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:43:55 devstack sudo[99374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-93d6305d-bf3d-4857-bf3e-02ac4e7fe95e 1073741824 Sep 23 14:43:55 devstack sudo[99374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:43:55 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-92478efa-95af-4479-8de0-431ff13e1d64 tempest-VolumesSnapshotTestJSON-2026192373 None] Create snapshot completed successfully Sep 23 14:43:56 devstack sudo[99374]: pam_unix(sudo:session): session closed for user root Sep 23 14:43:56 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-9d000df5-ea5d-46ca-833f-f9ffc792d0c2 tempest-TestImageHashVerification-489684057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-93d6305d-bf3d-4857-bf3e-02ac4e7fe95e 1073741824" returned: 0 in 0.408s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:43:56 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-9d000df5-ea5d-46ca-833f-f9ffc792d0c2 tempest-TestImageHashVerification-489684057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-93d6305d-bf3d-4857-bf3e-02ac4e7fe95e {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:43:56 devstack sudo[99379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-93d6305d-bf3d-4857-bf3e-02ac4e7fe95e Sep 23 14:43:56 devstack sudo[99379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:43:56 devstack sudo[99379]: pam_unix(sudo:session): session closed for user root Sep 23 14:43:56 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-9d000df5-ea5d-46ca-833f-f9ffc792d0c2 tempest-TestImageHashVerification-489684057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-93d6305d-bf3d-4857-bf3e-02ac4e7fe95e" returned: 0 in 0.235s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:43:56 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-9d000df5-ea5d-46ca-833f-f9ffc792d0c2 tempest-TestImageHashVerification-489684057 None] <== create_volume: return (683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:43:56 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-9d000df5-ea5d-46ca-833f-f9ffc792d0c2 tempest-TestImageHashVerification-489684057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.688s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:43:56 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-f696e738-4bfe-4119-a12a-06c798da7a21 tempest-VolumesGetTest-1470935452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.329s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:43:56 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-f696e738-4bfe-4119-a12a-06c798da7a21 tempest-VolumesGetTest-1470935452 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:43:55Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-394807435',display_name='tempest-VolumesGetTest-Volume-270970742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11261407-6c86-4f09-8f73-0017c60b63fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00651445389c45f2aa5764549f6a9307',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:43:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:43:55Z,use_quota=True,user_id='31a6159d91a940a48f5b4070277146b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:43:56 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-f696e738-4bfe-4119-a12a-06c798da7a21 tempest-VolumesGetTest-1470935452 None] Creating volume 11261407-6c86-4f09-8f73-0017c60b63fc {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:43:56 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-f696e738-4bfe-4119-a12a-06c798da7a21 tempest-VolumesGetTest-1470935452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:43:56 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-f696e738-4bfe-4119-a12a-06c798da7a21 tempest-VolumesGetTest-1470935452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:43:56 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-f696e738-4bfe-4119-a12a-06c798da7a21 tempest-VolumesGetTest-1470935452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:43:56 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-f696e738-4bfe-4119-a12a-06c798da7a21 tempest-VolumesGetTest-1470935452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:43:56 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-f696e738-4bfe-4119-a12a-06c798da7a21 tempest-VolumesGetTest-1470935452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:43:56 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-f696e738-4bfe-4119-a12a-06c798da7a21 tempest-VolumesGetTest-1470935452 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:43:56 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-f696e738-4bfe-4119-a12a-06c798da7a21 tempest-VolumesGetTest-1470935452 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:43:56 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-f696e738-4bfe-4119-a12a-06c798da7a21 tempest-VolumesGetTest-1470935452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-11261407-6c86-4f09-8f73-0017c60b63fc 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:43:56 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-9d000df5-ea5d-46ca-833f-f9ffc792d0c2 tempest-TestImageHashVerification-489684057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8c297d2-ebff-455b-a9e8-7cae563d2ac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93d6305d-bf3d-4857-bf3e-02ac4e7fe95e', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:43:56 devstack sudo[99382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-11261407-6c86-4f09-8f73-0017c60b63fc 1073741824 Sep 23 14:43:56 devstack sudo[99382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:43:56 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-9d000df5-ea5d-46ca-833f-f9ffc792d0c2 tempest-TestImageHashVerification-489684057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3ce2143-4bf3-4b04-995c-d2fbf1d8ae63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:43:56 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-9d000df5-ea5d-46ca-833f-f9ffc792d0c2 tempest-TestImageHashVerification-489684057 None] Volume volume-93d6305d-bf3d-4857-bf3e-02ac4e7fe95e (93d6305d-bf3d-4857-bf3e-02ac4e7fe95e): created successfully Sep 23 14:43:56 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-9d000df5-ea5d-46ca-833f-f9ffc792d0c2 tempest-TestImageHashVerification-489684057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3ce2143-4bf3-4b04-995c-d2fbf1d8ae63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:43:56 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-9d000df5-ea5d-46ca-833f-f9ffc792d0c2 tempest-TestImageHashVerification-489684057 None] Flow 'volume_create_manager' (b1d5cb56-fd26-4bf9-8566-52847776bbcd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:43:56 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-9d000df5-ea5d-46ca-833f-f9ffc792d0c2 tempest-TestImageHashVerification-489684057 None] Created volume successfully. Sep 23 14:43:57 devstack sudo[99382]: pam_unix(sudo:session): session closed for user root Sep 23 14:43:57 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-f696e738-4bfe-4119-a12a-06c798da7a21 tempest-VolumesGetTest-1470935452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-11261407-6c86-4f09-8f73-0017c60b63fc 1073741824" returned: 0 in 0.572s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:43:57 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-f696e738-4bfe-4119-a12a-06c798da7a21 tempest-VolumesGetTest-1470935452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-11261407-6c86-4f09-8f73-0017c60b63fc {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:43:57 devstack sudo[99388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-11261407-6c86-4f09-8f73-0017c60b63fc Sep 23 14:43:57 devstack sudo[99388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:43:57 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-091b36e4-d270-4597-80df-19a71e46ce5b tempest-VolumesSnapshotTestJSON-2026192373 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:43:57 devstack sudo[99388]: pam_unix(sudo:session): session closed for user root Sep 23 14:43:57 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-f696e738-4bfe-4119-a12a-06c798da7a21 tempest-VolumesGetTest-1470935452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-11261407-6c86-4f09-8f73-0017c60b63fc" returned: 0 in 0.296s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:43:57 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-f696e738-4bfe-4119-a12a-06c798da7a21 tempest-VolumesGetTest-1470935452 None] <== create_volume: return (916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:43:57 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-f696e738-4bfe-4119-a12a-06c798da7a21 tempest-VolumesGetTest-1470935452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.922s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:43:57 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-091b36e4-d270-4597-80df-19a71e46ce5b tempest-VolumesSnapshotTestJSON-2026192373 None] Flow 'volume_create_manager' (a993c819-9160-4789-a788-f61c132994b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:43:57 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-091b36e4-d270-4597-80df-19a71e46ce5b tempest-VolumesSnapshotTestJSON-2026192373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fe98603-7716-4d3f-8bf8-5d2541da96f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:43:57 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-091b36e4-d270-4597-80df-19a71e46ce5b tempest-VolumesSnapshotTestJSON-2026192373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fe98603-7716-4d3f-8bf8-5d2541da96f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:43:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2066372204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfbdc3b3-3b6c-47c8-8e67-dfdd42955e7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc37b3f0f14743f98ec5678b6b1d8d57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:43:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9bbcf549-9bf1-42ac-9cb8-42d2b01b617b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:43:57Z,use_quota=True,user_id='2befd5b4c0e64f129ca6768bb143e6ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:43:57 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-091b36e4-d270-4597-80df-19a71e46ce5b tempest-VolumesSnapshotTestJSON-2026192373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d82d1c9-aaa1-4a0f-8deb-5d5856eb27b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:43:57 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-091b36e4-d270-4597-80df-19a71e46ce5b tempest-VolumesSnapshotTestJSON-2026192373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d82d1c9-aaa1-4a0f-8deb-5d5856eb27b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:43:57 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-091b36e4-d270-4597-80df-19a71e46ce5b tempest-VolumesSnapshotTestJSON-2026192373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b43a3655-7933-464e-9b8a-a7c564abf221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:43:57 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-091b36e4-d270-4597-80df-19a71e46ce5b tempest-VolumesSnapshotTestJSON-2026192373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b43a3655-7933-464e-9b8a-a7c564abf221) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'bfbdc3b3-3b6c-47c8-8e67-dfdd42955e7c', 'volume_name': 'volume-bfbdc3b3-3b6c-47c8-8e67-dfdd42955e7c', 'volume_size': 1, 'snapshot_id': '9bbcf549-9bf1-42ac-9cb8-42d2b01b617b'}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:43:57 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-091b36e4-d270-4597-80df-19a71e46ce5b tempest-VolumesSnapshotTestJSON-2026192373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad70cf53-1e50-49f5-a89a-68019a516587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:43:57 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-091b36e4-d270-4597-80df-19a71e46ce5b tempest-VolumesSnapshotTestJSON-2026192373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad70cf53-1e50-49f5-a89a-68019a516587) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:43:57 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-091b36e4-d270-4597-80df-19a71e46ce5b tempest-VolumesSnapshotTestJSON-2026192373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92abec63-5026-4647-a8dd-2b11e406336f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:43:57 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-091b36e4-d270-4597-80df-19a71e46ce5b tempest-VolumesSnapshotTestJSON-2026192373 None] Volume bfbdc3b3-3b6c-47c8-8e67-dfdd42955e7c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-bfbdc3b3-3b6c-47c8-8e67-dfdd42955e7c', 'volume_size': 1, 'snapshot_id': '9bbcf549-9bf1-42ac-9cb8-42d2b01b617b'} Sep 23 14:43:57 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-f696e738-4bfe-4119-a12a-06c798da7a21 tempest-VolumesGetTest-1470935452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (896d07f0-3323-47f3-b89a-97d0d63c3dcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11261407-6c86-4f09-8f73-0017c60b63fc', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:43:57 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-f696e738-4bfe-4119-a12a-06c798da7a21 tempest-VolumesGetTest-1470935452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5108e6d9-e54c-4237-b321-97f3311c9114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:43:57 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-091b36e4-d270-4597-80df-19a71e46ce5b tempest-VolumesSnapshotTestJSON-2026192373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:43:57 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-091b36e4-d270-4597-80df-19a71e46ce5b tempest-VolumesSnapshotTestJSON-2026192373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:43:57 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-091b36e4-d270-4597-80df-19a71e46ce5b tempest-VolumesSnapshotTestJSON-2026192373 None] Acquiring lock "cinder-quobyte-9bbcf549-9bf1-42ac-9cb8-42d2b01b617b-bfbdc3b3-3b6c-47c8-8e67-dfdd42955e7c" by "_create_volume_from_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:43:57 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-f696e738-4bfe-4119-a12a-06c798da7a21 tempest-VolumesGetTest-1470935452 None] Volume volume-11261407-6c86-4f09-8f73-0017c60b63fc (11261407-6c86-4f09-8f73-0017c60b63fc): created successfully Sep 23 14:43:57 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-f696e738-4bfe-4119-a12a-06c798da7a21 tempest-VolumesGetTest-1470935452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5108e6d9-e54c-4237-b321-97f3311c9114) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:43:57 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-f696e738-4bfe-4119-a12a-06c798da7a21 tempest-VolumesGetTest-1470935452 None] Flow 'volume_create_manager' (8641c0c6-8bb4-4ef0-85d5-8d9c790eee4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:43:57 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-091b36e4-d270-4597-80df-19a71e46ce5b tempest-VolumesSnapshotTestJSON-2026192373 None] Lock "cinder-quobyte-9bbcf549-9bf1-42ac-9cb8-42d2b01b617b-bfbdc3b3-3b6c-47c8-8e67-dfdd42955e7c" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:43:57 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-091b36e4-d270-4597-80df-19a71e46ce5b tempest-VolumesSnapshotTestJSON-2026192373 None] Creating volume bfbdc3b3-3b6c-47c8-8e67-dfdd42955e7c from snapshot 9bbcf549-9bf1-42ac-9cb8-42d2b01b617b {{(pid=86310) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 23 14:43:57 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-091b36e4-d270-4597-80df-19a71e46ce5b tempest-VolumesSnapshotTestJSON-2026192373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:43:57 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-091b36e4-d270-4597-80df-19a71e46ce5b tempest-VolumesSnapshotTestJSON-2026192373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:43:57 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-091b36e4-d270-4597-80df-19a71e46ce5b tempest-VolumesSnapshotTestJSON-2026192373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:43:57 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-091b36e4-d270-4597-80df-19a71e46ce5b tempest-VolumesSnapshotTestJSON-2026192373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:43:57 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-091b36e4-d270-4597-80df-19a71e46ce5b tempest-VolumesSnapshotTestJSON-2026192373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:43:57 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-091b36e4-d270-4597-80df-19a71e46ce5b tempest-VolumesSnapshotTestJSON-2026192373 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:43:57 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-091b36e4-d270-4597-80df-19a71e46ce5b tempest-VolumesSnapshotTestJSON-2026192373 None] Acquiring lock "cinder-quobyte-bfbdc3b3-3b6c-47c8-8e67-dfdd42955e7c" by "_copy_volume_from_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:43:57 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-f696e738-4bfe-4119-a12a-06c798da7a21 tempest-VolumesGetTest-1470935452 None] Created volume successfully. Sep 23 14:43:57 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-091b36e4-d270-4597-80df-19a71e46ce5b tempest-VolumesSnapshotTestJSON-2026192373 None] Lock "cinder-quobyte-bfbdc3b3-3b6c-47c8-8e67-dfdd42955e7c" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:43:57 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-091b36e4-d270-4597-80df-19a71e46ce5b tempest-VolumesSnapshotTestJSON-2026192373 None] snapshot: 9bbcf549-9bf1-42ac-9cb8-42d2b01b617b, volume: bfbdc3b3-3b6c-47c8-8e67-dfdd42955e7c, {{(pid=86310) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 23 14:43:57 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-091b36e4-d270-4597-80df-19a71e46ce5b tempest-VolumesSnapshotTestJSON-2026192373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:43:57 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-091b36e4-d270-4597-80df-19a71e46ce5b tempest-VolumesSnapshotTestJSON-2026192373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:43:57 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-091b36e4-d270-4597-80df-19a71e46ce5b tempest-VolumesSnapshotTestJSON-2026192373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:43:57 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-091b36e4-d270-4597-80df-19a71e46ce5b tempest-VolumesSnapshotTestJSON-2026192373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:43:57 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-091b36e4-d270-4597-80df-19a71e46ce5b tempest-VolumesSnapshotTestJSON-2026192373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:43:57 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a2da8ab-76a4-4741-a1c3-1bbc9d130de2]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:43:57 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-091b36e4-d270-4597-80df-19a71e46ce5b tempest-VolumesSnapshotTestJSON-2026192373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-731253f4-6a74-42c2-9363-06a913f3851a.9bbcf549-9bf1-42ac-9cb8-42d2b01b617b {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:43:57 devstack sudo[99392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-731253f4-6a74-42c2-9363-06a913f3851a.9bbcf549-9bf1-42ac-9cb8-42d2b01b617b Sep 23 14:43:57 devstack sudo[99392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:43:58 devstack sudo[99392]: pam_unix(sudo:session): session closed for user root Sep 23 14:43:58 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-091b36e4-d270-4597-80df-19a71e46ce5b tempest-VolumesSnapshotTestJSON-2026192373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-731253f4-6a74-42c2-9363-06a913f3851a.9bbcf549-9bf1-42ac-9cb8-42d2b01b617b" returned: 0 in 0.388s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:43:58 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-091b36e4-d270-4597-80df-19a71e46ce5b tempest-VolumesSnapshotTestJSON-2026192373 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-731253f4-6a74-42c2-9363-06a913f3851a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 14:43:58 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aa914c8-2d7c-4f5d-803e-baeccc1acd99]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:43:58 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-091b36e4-d270-4597-80df-19a71e46ce5b tempest-VolumesSnapshotTestJSON-2026192373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-731253f4-6a74-42c2-9363-06a913f3851a {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:43:58 devstack sudo[99397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-731253f4-6a74-42c2-9363-06a913f3851a Sep 23 14:43:58 devstack sudo[99397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:43:58 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-c2fb5488-e3c6-4a10-94b6-dc566c4dac53 tempest-VolumesGetTest-1470935452 None] Acquiring lock "cinder-11261407-6c86-4f09-8f73-0017c60b63fc-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:43:58 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-c2fb5488-e3c6-4a10-94b6-dc566c4dac53 tempest-VolumesGetTest-1470935452 None] Lock "cinder-11261407-6c86-4f09-8f73-0017c60b63fc-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:43:58 devstack sudo[99397]: pam_unix(sudo:session): session closed for user root Sep 23 14:43:58 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-c2fb5488-e3c6-4a10-94b6-dc566c4dac53 tempest-VolumesGetTest-1470935452 None] Acquiring lock "cinder-quobyte-11261407-6c86-4f09-8f73-0017c60b63fc" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:43:58 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-091b36e4-d270-4597-80df-19a71e46ce5b tempest-VolumesSnapshotTestJSON-2026192373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-731253f4-6a74-42c2-9363-06a913f3851a" returned: 0 in 0.469s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:43:58 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-091b36e4-d270-4597-80df-19a71e46ce5b tempest-VolumesSnapshotTestJSON-2026192373 None] will copy from snapshot at /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-731253f4-6a74-42c2-9363-06a913f3851a {{(pid=86310) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 23 14:43:58 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-091b36e4-d270-4597-80df-19a71e46ce5b tempest-VolumesSnapshotTestJSON-2026192373 None] Creating direct copy from snapshot {{(pid=86310) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 23 14:43:58 devstack cinder-volume[86310]: DEBUG cinder.utils [None req-091b36e4-d270-4597-80df-19a71e46ce5b tempest-VolumesSnapshotTestJSON-2026192373 None] Path /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bfbdc3b3-3b6c-47c8-8e67-dfdd42955e7c not found in is_blk_device check {{(pid=86310) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 23 14:43:58 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-091b36e4-d270-4597-80df-19a71e46ce5b tempest-VolumesSnapshotTestJSON-2026192373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-731253f4-6a74-42c2-9363-06a913f3851a /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bfbdc3b3-3b6c-47c8-8e67-dfdd42955e7c {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:43:58 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-c2fb5488-e3c6-4a10-94b6-dc566c4dac53 tempest-VolumesGetTest-1470935452 None] Lock "cinder-quobyte-11261407-6c86-4f09-8f73-0017c60b63fc" acquired by "delete_volume" :: waited 0.029s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:43:58 devstack sudo[99402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-731253f4-6a74-42c2-9363-06a913f3851a /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bfbdc3b3-3b6c-47c8-8e67-dfdd42955e7c Sep 23 14:43:58 devstack sudo[99402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:43:58 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[430a8669-3423-42a0-8b35-9d1c5ed8e596]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:43:58 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-c2fb5488-e3c6-4a10-94b6-dc566c4dac53 tempest-VolumesGetTest-1470935452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-11261407-6c86-4f09-8f73-0017c60b63fc {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:43:58 devstack sudo[99404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-11261407-6c86-4f09-8f73-0017c60b63fc Sep 23 14:43:58 devstack sudo[99404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:43:58 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-c1193926-7172-49a2-a264-8681651c7feb tempest-TestImageHashVerification-489684057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:43:59 devstack sudo[99404]: pam_unix(sudo:session): session closed for user root Sep 23 14:43:59 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-c2fb5488-e3c6-4a10-94b6-dc566c4dac53 tempest-VolumesGetTest-1470935452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-11261407-6c86-4f09-8f73-0017c60b63fc" returned: 0 in 0.395s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:43:59 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-c2fb5488-e3c6-4a10-94b6-dc566c4dac53 tempest-VolumesGetTest-1470935452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-11261407-6c86-4f09-8f73-0017c60b63fc {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:43:59 devstack sudo[99412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-11261407-6c86-4f09-8f73-0017c60b63fc Sep 23 14:43:59 devstack sudo[99412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:43:59 devstack sudo[99412]: pam_unix(sudo:session): session closed for user root Sep 23 14:43:59 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-c2fb5488-e3c6-4a10-94b6-dc566c4dac53 tempest-VolumesGetTest-1470935452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-11261407-6c86-4f09-8f73-0017c60b63fc" returned: 0 in 0.499s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:43:59 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-c2fb5488-e3c6-4a10-94b6-dc566c4dac53 tempest-VolumesGetTest-1470935452 None] Lock "cinder-quobyte-11261407-6c86-4f09-8f73-0017c60b63fc" released by "delete_volume" :: held 0.985s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:43:59 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-c2fb5488-e3c6-4a10-94b6-dc566c4dac53 tempest-VolumesGetTest-1470935452 None] Created reservations ['953fc8b4-4fb2-4956-b8ae-595418952efe', '1746eda5-6da9-4418-a090-8d766f51a901', 'd4522524-2d75-4334-98c0-fcbdd3a3d4d9', 'ba2245b0-c939-4498-a5b7-4572e031183b'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:44:00 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-c2fb5488-e3c6-4a10-94b6-dc566c4dac53 tempest-VolumesGetTest-1470935452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:44:00 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-c2fb5488-e3c6-4a10-94b6-dc566c4dac53 tempest-VolumesGetTest-1470935452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:44:00 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-c2fb5488-e3c6-4a10-94b6-dc566c4dac53 tempest-VolumesGetTest-1470935452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:44:00 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-c2fb5488-e3c6-4a10-94b6-dc566c4dac53 tempest-VolumesGetTest-1470935452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:44:00 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-c2fb5488-e3c6-4a10-94b6-dc566c4dac53 tempest-VolumesGetTest-1470935452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:44:00 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-c2fb5488-e3c6-4a10-94b6-dc566c4dac53 tempest-VolumesGetTest-1470935452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:44:00 devstack sudo[99423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:44:00 devstack sudo[99423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:44:00 devstack sudo[99423]: pam_unix(sudo:session): session closed for user root Sep 23 14:44:00 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-c2fb5488-e3c6-4a10-94b6-dc566c4dac53 tempest-VolumesGetTest-1470935452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.444s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:44:00 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-c2fb5488-e3c6-4a10-94b6-dc566c4dac53 tempest-VolumesGetTest-1470935452 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:44:00 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-c2fb5488-e3c6-4a10-94b6-dc566c4dac53 tempest-VolumesGetTest-1470935452 None] Deleted volume successfully. Sep 23 14:44:00 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-c2fb5488-e3c6-4a10-94b6-dc566c4dac53 tempest-VolumesGetTest-1470935452 None] Lock "cinder-11261407-6c86-4f09-8f73-0017c60b63fc-delete_volume" released by "delete_volume" :: held 1.984s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:44:01 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-76dfa4ae-8666-46bd-9866-028fa6156e5e tempest-VolumesGetTest-1470935452 None] Acquiring lock "cinder-1f061926-b121-4250-9879-82f9d9949909-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:44:01 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-76dfa4ae-8666-46bd-9866-028fa6156e5e tempest-VolumesGetTest-1470935452 None] Lock "cinder-1f061926-b121-4250-9879-82f9d9949909-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:44:01 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-76dfa4ae-8666-46bd-9866-028fa6156e5e tempest-VolumesGetTest-1470935452 None] Acquiring lock "cinder-quobyte-1f061926-b121-4250-9879-82f9d9949909" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:44:01 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-76dfa4ae-8666-46bd-9866-028fa6156e5e tempest-VolumesGetTest-1470935452 None] Lock "cinder-quobyte-1f061926-b121-4250-9879-82f9d9949909" acquired by "delete_volume" :: waited 0.023s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:44:01 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c3c86c2-8520-4bf5-8953-3731af5a66c6]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:44:01 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-76dfa4ae-8666-46bd-9866-028fa6156e5e tempest-VolumesGetTest-1470935452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-1f061926-b121-4250-9879-82f9d9949909 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:44:01 devstack sudo[99426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-1f061926-b121-4250-9879-82f9d9949909 Sep 23 14:44:01 devstack sudo[99426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:44:02 devstack sudo[99426]: pam_unix(sudo:session): session closed for user root Sep 23 14:44:02 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-76dfa4ae-8666-46bd-9866-028fa6156e5e tempest-VolumesGetTest-1470935452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-1f061926-b121-4250-9879-82f9d9949909" returned: 0 in 0.808s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:44:02 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-76dfa4ae-8666-46bd-9866-028fa6156e5e tempest-VolumesGetTest-1470935452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-1f061926-b121-4250-9879-82f9d9949909 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:44:02 devstack sudo[99432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-1f061926-b121-4250-9879-82f9d9949909 Sep 23 14:44:02 devstack sudo[99432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:44:02 devstack sudo[99432]: pam_unix(sudo:session): session closed for user root Sep 23 14:44:02 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-76dfa4ae-8666-46bd-9866-028fa6156e5e tempest-VolumesGetTest-1470935452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-1f061926-b121-4250-9879-82f9d9949909" returned: 0 in 0.451s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:44:02 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-76dfa4ae-8666-46bd-9866-028fa6156e5e tempest-VolumesGetTest-1470935452 None] Lock "cinder-quobyte-1f061926-b121-4250-9879-82f9d9949909" released by "delete_volume" :: held 1.388s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:44:02 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-76dfa4ae-8666-46bd-9866-028fa6156e5e tempest-VolumesGetTest-1470935452 None] Created reservations ['60566ad7-6c00-4be4-887d-282965c027f9', '5a6a3f6c-130f-42ee-b7b3-061602cd2339', '51a54f8b-3001-417a-bc1d-588cf4c634fd', 'a1a60023-e5a9-4a35-b3c7-05d64214de2d'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:44:02 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-76dfa4ae-8666-46bd-9866-028fa6156e5e tempest-VolumesGetTest-1470935452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:44:02 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-76dfa4ae-8666-46bd-9866-028fa6156e5e tempest-VolumesGetTest-1470935452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:44:02 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-76dfa4ae-8666-46bd-9866-028fa6156e5e tempest-VolumesGetTest-1470935452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:44:02 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-76dfa4ae-8666-46bd-9866-028fa6156e5e tempest-VolumesGetTest-1470935452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:44:02 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-76dfa4ae-8666-46bd-9866-028fa6156e5e tempest-VolumesGetTest-1470935452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:44:02 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-76dfa4ae-8666-46bd-9866-028fa6156e5e tempest-VolumesGetTest-1470935452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:44:02 devstack sudo[99436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:44:02 devstack sudo[99436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:44:03 devstack sudo[99436]: pam_unix(sudo:session): session closed for user root Sep 23 14:44:03 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-76dfa4ae-8666-46bd-9866-028fa6156e5e tempest-VolumesGetTest-1470935452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.460s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:44:03 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-76dfa4ae-8666-46bd-9866-028fa6156e5e tempest-VolumesGetTest-1470935452 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:44:03 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-76dfa4ae-8666-46bd-9866-028fa6156e5e tempest-VolumesGetTest-1470935452 None] Deleted volume successfully. Sep 23 14:44:03 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-76dfa4ae-8666-46bd-9866-028fa6156e5e tempest-VolumesGetTest-1470935452 None] Lock "cinder-1f061926-b121-4250-9879-82f9d9949909-delete_volume" released by "delete_volume" :: held 2.300s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:44:03 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-8d31c5d8-9120-46a4-9b42-7ade328e3c0a tempest-VolumesGetTest-1470935452 None] Acquiring lock "cinder-56b1d5d9-6fad-4571-9fa5-f1bb51bcb869-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:44:03 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-8d31c5d8-9120-46a4-9b42-7ade328e3c0a tempest-VolumesGetTest-1470935452 None] Lock "cinder-56b1d5d9-6fad-4571-9fa5-f1bb51bcb869-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:44:03 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-8d31c5d8-9120-46a4-9b42-7ade328e3c0a tempest-VolumesGetTest-1470935452 None] Acquiring lock "cinder-quobyte-56b1d5d9-6fad-4571-9fa5-f1bb51bcb869" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:44:03 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-8d31c5d8-9120-46a4-9b42-7ade328e3c0a tempest-VolumesGetTest-1470935452 None] Lock "cinder-quobyte-56b1d5d9-6fad-4571-9fa5-f1bb51bcb869" acquired by "delete_volume" :: waited 0.019s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:44:03 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[33c875d7-777d-4c3f-a5c3-81448a37c102]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:44:03 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8d31c5d8-9120-46a4-9b42-7ade328e3c0a tempest-VolumesGetTest-1470935452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-56b1d5d9-6fad-4571-9fa5-f1bb51bcb869 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:44:04 devstack sudo[99439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-56b1d5d9-6fad-4571-9fa5-f1bb51bcb869 Sep 23 14:44:04 devstack sudo[99439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:44:04 devstack sudo[99439]: pam_unix(sudo:session): session closed for user root Sep 23 14:44:04 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8d31c5d8-9120-46a4-9b42-7ade328e3c0a tempest-VolumesGetTest-1470935452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-56b1d5d9-6fad-4571-9fa5-f1bb51bcb869" returned: 0 in 0.635s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:44:04 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8d31c5d8-9120-46a4-9b42-7ade328e3c0a tempest-VolumesGetTest-1470935452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-56b1d5d9-6fad-4571-9fa5-f1bb51bcb869 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:44:04 devstack sudo[99444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-56b1d5d9-6fad-4571-9fa5-f1bb51bcb869 Sep 23 14:44:04 devstack sudo[99444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:44:05 devstack sudo[99444]: pam_unix(sudo:session): session closed for user root Sep 23 14:44:05 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8d31c5d8-9120-46a4-9b42-7ade328e3c0a tempest-VolumesGetTest-1470935452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-56b1d5d9-6fad-4571-9fa5-f1bb51bcb869" returned: 0 in 0.607s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:44:05 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-8d31c5d8-9120-46a4-9b42-7ade328e3c0a tempest-VolumesGetTest-1470935452 None] Lock "cinder-quobyte-56b1d5d9-6fad-4571-9fa5-f1bb51bcb869" released by "delete_volume" :: held 1.415s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:44:05 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-8d31c5d8-9120-46a4-9b42-7ade328e3c0a tempest-VolumesGetTest-1470935452 None] Created reservations ['8b2e8699-74cf-4f31-bd01-552902ee84ac', '13757b5e-ac85-4073-8c31-a1423c9904c5', '8014925a-326c-4d05-80b5-5f1ae25bc0fa', '7e466589-af15-4ccb-8c95-aa29be7156ac'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:44:05 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-8d31c5d8-9120-46a4-9b42-7ade328e3c0a tempest-VolumesGetTest-1470935452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:44:05 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-8d31c5d8-9120-46a4-9b42-7ade328e3c0a tempest-VolumesGetTest-1470935452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:44:05 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-8d31c5d8-9120-46a4-9b42-7ade328e3c0a tempest-VolumesGetTest-1470935452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:44:05 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-8d31c5d8-9120-46a4-9b42-7ade328e3c0a tempest-VolumesGetTest-1470935452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:44:05 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-8d31c5d8-9120-46a4-9b42-7ade328e3c0a tempest-VolumesGetTest-1470935452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:44:05 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8d31c5d8-9120-46a4-9b42-7ade328e3c0a tempest-VolumesGetTest-1470935452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:44:05 devstack sudo[99448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:44:05 devstack sudo[99448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:44:05 devstack sudo[99448]: pam_unix(sudo:session): session closed for user root Sep 23 14:44:05 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8d31c5d8-9120-46a4-9b42-7ade328e3c0a tempest-VolumesGetTest-1470935452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.320s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:44:05 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-8d31c5d8-9120-46a4-9b42-7ade328e3c0a tempest-VolumesGetTest-1470935452 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:44:05 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-8d31c5d8-9120-46a4-9b42-7ade328e3c0a tempest-VolumesGetTest-1470935452 None] Deleted volume successfully. Sep 23 14:44:05 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-8d31c5d8-9120-46a4-9b42-7ade328e3c0a tempest-VolumesGetTest-1470935452 None] Lock "cinder-56b1d5d9-6fad-4571-9fa5-f1bb51bcb869-delete_volume" released by "delete_volume" :: held 2.149s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:44:07 devstack sudo[99402]: pam_unix(sudo:session): session closed for user root Sep 23 14:44:07 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-091b36e4-d270-4597-80df-19a71e46ce5b tempest-VolumesSnapshotTestJSON-2026192373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-731253f4-6a74-42c2-9363-06a913f3851a /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bfbdc3b3-3b6c-47c8-8e67-dfdd42955e7c" returned: 0 in 8.476s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:44:07 devstack cinder-volume[86310]: DEBUG cinder.image.image_utils [None req-091b36e4-d270-4597-80df-19a71e46ce5b tempest-VolumesSnapshotTestJSON-2026192373 None] Image conversion details: src /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-731253f4-6a74-42c2-9363-06a913f3851a, size 1024.00 MB, duration 8.48 sec, destination /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bfbdc3b3-3b6c-47c8-8e67-dfdd42955e7c {{(pid=86310) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 14:44:07 devstack cinder-volume[86310]: INFO cinder.image.image_utils [None req-091b36e4-d270-4597-80df-19a71e46ce5b tempest-VolumesSnapshotTestJSON-2026192373 None] Converted 1024.00 MB image at 120.79 MB/s Sep 23 14:44:07 devstack cinder-volume[86310]: WARNING cinder.volume.drivers.remotefs [None req-091b36e4-d270-4597-80df-19a71e46ce5b tempest-VolumesSnapshotTestJSON-2026192373 None] /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bfbdc3b3-3b6c-47c8-8e67-dfdd42955e7c is being set with open permissions: ugo+rw Sep 23 14:44:07 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-091b36e4-d270-4597-80df-19a71e46ce5b tempest-VolumesSnapshotTestJSON-2026192373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bfbdc3b3-3b6c-47c8-8e67-dfdd42955e7c {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:44:07 devstack sudo[99451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bfbdc3b3-3b6c-47c8-8e67-dfdd42955e7c Sep 23 14:44:07 devstack sudo[99451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:44:07 devstack sudo[99451]: pam_unix(sudo:session): session closed for user root Sep 23 14:44:07 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-22867f21-ccd6-4408-b098-a14bc5a37cf2 tempest-VolumesGetTest-1470935452 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:44:07 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-22867f21-ccd6-4408-b098-a14bc5a37cf2 tempest-VolumesGetTest-1470935452 None] Flow 'volume_create_manager' (ed33ccbe-5960-4131-a0eb-a2fa2d246131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:44:07 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-22867f21-ccd6-4408-b098-a14bc5a37cf2 tempest-VolumesGetTest-1470935452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec313107-fba9-48c1-9821-448153a9b637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:44:07 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-091b36e4-d270-4597-80df-19a71e46ce5b tempest-VolumesSnapshotTestJSON-2026192373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bfbdc3b3-3b6c-47c8-8e67-dfdd42955e7c" returned: 0 in 0.353s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:44:07 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-22867f21-ccd6-4408-b098-a14bc5a37cf2 tempest-VolumesGetTest-1470935452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec313107-fba9-48c1-9821-448153a9b637) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:44:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-693364931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0e686dc-5da3-4f58-916a-2485094ad7ec,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='00651445389c45f2aa5764549f6a9307',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:44:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:44:07Z,use_quota=True,user_id='31a6159d91a940a48f5b4070277146b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:44:07 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-22867f21-ccd6-4408-b098-a14bc5a37cf2 tempest-VolumesGetTest-1470935452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a6465dc-6aab-4790-91a6-0b456a87e9a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:44:07 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-22867f21-ccd6-4408-b098-a14bc5a37cf2 tempest-VolumesGetTest-1470935452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a6465dc-6aab-4790-91a6-0b456a87e9a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:44:07 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-22867f21-ccd6-4408-b098-a14bc5a37cf2 tempest-VolumesGetTest-1470935452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4c49e2f-4c13-4ff0-ba3f-b01b01468f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:44:07 devstack cinder-volume[86310]: DEBUG cinder.image.glance [None req-22867f21-ccd6-4408-b098-a14bc5a37cf2 tempest-VolumesGetTest-1470935452 None] Creating Keystone auth plugin from conf {{(pid=86310) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 23 14:44:07 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-091b36e4-d270-4597-80df-19a71e46ce5b tempest-VolumesSnapshotTestJSON-2026192373 None] Lock "cinder-quobyte-bfbdc3b3-3b6c-47c8-8e67-dfdd42955e7c" released by "_copy_volume_from_snapshot" :: held 9.861s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:44:07 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-091b36e4-d270-4597-80df-19a71e46ce5b tempest-VolumesSnapshotTestJSON-2026192373 None] Lock "cinder-quobyte-9bbcf549-9bf1-42ac-9cb8-42d2b01b617b-bfbdc3b3-3b6c-47c8-8e67-dfdd42955e7c" released by "_create_volume_from_snapshot" :: held 9.955s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:44:07 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-091b36e4-d270-4597-80df-19a71e46ce5b tempest-VolumesSnapshotTestJSON-2026192373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.988s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:44:07 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-c1193926-7172-49a2-a264-8681651c7feb tempest-TestImageHashVerification-489684057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 8.715s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:44:07 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[349d61a7-f66e-46a1-8696-d034dbc55f87]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:44:07 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-c1193926-7172-49a2-a264-8681651c7feb tempest-TestImageHashVerification-489684057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-93d6305d-bf3d-4857-bf3e-02ac4e7fe95e {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:44:07 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-091b36e4-d270-4597-80df-19a71e46ce5b tempest-VolumesSnapshotTestJSON-2026192373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92abec63-5026-4647-a8dd-2b11e406336f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bfbdc3b3-3b6c-47c8-8e67-dfdd42955e7c', 'volume_size': 1, 'snapshot_id': '9bbcf549-9bf1-42ac-9cb8-42d2b01b617b'}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:44:07 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-091b36e4-d270-4597-80df-19a71e46ce5b tempest-VolumesSnapshotTestJSON-2026192373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (251fa322-2d6d-480a-b0e3-dea7d46861ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:44:07 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-091b36e4-d270-4597-80df-19a71e46ce5b tempest-VolumesSnapshotTestJSON-2026192373 None] Volume volume-bfbdc3b3-3b6c-47c8-8e67-dfdd42955e7c (bfbdc3b3-3b6c-47c8-8e67-dfdd42955e7c): created successfully Sep 23 14:44:07 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-091b36e4-d270-4597-80df-19a71e46ce5b tempest-VolumesSnapshotTestJSON-2026192373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (251fa322-2d6d-480a-b0e3-dea7d46861ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:44:07 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-091b36e4-d270-4597-80df-19a71e46ce5b tempest-VolumesSnapshotTestJSON-2026192373 None] Flow 'volume_create_manager' (a993c819-9160-4789-a788-f61c132994b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:44:07 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-091b36e4-d270-4597-80df-19a71e46ce5b tempest-VolumesSnapshotTestJSON-2026192373 None] Created volume successfully. Sep 23 14:44:07 devstack sudo[99454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-93d6305d-bf3d-4857-bf3e-02ac4e7fe95e Sep 23 14:44:07 devstack sudo[99454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:44:07 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-22867f21-ccd6-4408-b098-a14bc5a37cf2 tempest-VolumesGetTest-1470935452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4c49e2f-4c13-4ff0-ba3f-b01b01468f14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e0e686dc-5da3-4f58-916a-2485094ad7ec', 'volume_name': 'volume-e0e686dc-5da3-4f58-916a-2485094ad7ec', 'volume_size': 1, 'image_id': '0cd395f9-e766-4e32-94b1-775454bf3449', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0cd395f9-e766-4e32-94b1-775454bf3449', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7fa20aad952548c880b3288dd7d64dbc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0cd395f9-e766-4e32-94b1-775454bf3449', 'created_at': datetime.datetime(2026, 9, 23, 12, 25, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 23, 12, 25, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0cd395f9-e766-4e32-94b1-775454bf3449/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:44:07 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-22867f21-ccd6-4408-b098-a14bc5a37cf2 tempest-VolumesGetTest-1470935452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (234f5cc7-f70c-424e-8a9c-449fa9a0d708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:44:07 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-22867f21-ccd6-4408-b098-a14bc5a37cf2 tempest-VolumesGetTest-1470935452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (234f5cc7-f70c-424e-8a9c-449fa9a0d708) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:44:07 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-22867f21-ccd6-4408-b098-a14bc5a37cf2 tempest-VolumesGetTest-1470935452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d38728b0-23ea-4632-991f-3694449749ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:44:07 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-22867f21-ccd6-4408-b098-a14bc5a37cf2 tempest-VolumesGetTest-1470935452 None] Volume e0e686dc-5da3-4f58-916a-2485094ad7ec: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e0e686dc-5da3-4f58-916a-2485094ad7ec', 'volume_size': 1, 'image_id': '0cd395f9-e766-4e32-94b1-775454bf3449', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0cd395f9-e766-4e32-94b1-775454bf3449', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7fa20aad952548c880b3288dd7d64dbc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0cd395f9-e766-4e32-94b1-775454bf3449', 'created_at': datetime.datetime(2026, 9, 23, 12, 25, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 23, 12, 25, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0cd395f9-e766-4e32-94b1-775454bf3449/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 23 14:44:07 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-22867f21-ccd6-4408-b098-a14bc5a37cf2 tempest-VolumesGetTest-1470935452 None] Trying to clone e0e686dc-5da3-4f58-916a-2485094ad7ec from image 0cd395f9-e766-4e32-94b1-775454bf3449 at location (None, [{'url': 'file:///opt/stack/data/glance/images/0cd395f9-e766-4e32-94b1-775454bf3449', 'metadata': {}}]). {{(pid=86310) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 23 14:44:08 devstack sudo[99454]: pam_unix(sudo:session): session closed for user root Sep 23 14:44:08 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-c1193926-7172-49a2-a264-8681651c7feb tempest-TestImageHashVerification-489684057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-93d6305d-bf3d-4857-bf3e-02ac4e7fe95e" returned: 0 in 0.439s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:44:08 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c2088e-f707-4d13-915c-a41a62e4cef5]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:44:08 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-c1193926-7172-49a2-a264-8681651c7feb tempest-TestImageHashVerification-489684057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-93d6305d-bf3d-4857-bf3e-02ac4e7fe95e {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:44:08 devstack sudo[99459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-93d6305d-bf3d-4857-bf3e-02ac4e7fe95e Sep 23 14:44:08 devstack sudo[99459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:44:08 devstack cinder-volume[86310]: DEBUG cinder.image.image_utils [None req-22867f21-ccd6-4408-b098-a14bc5a37cf2 tempest-VolumesGetTest-1470935452 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0cd395f9-e766-4e32-94b1-775454bf3449_tzwrn54udevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86310) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 23 14:44:08 devstack cinder-volume[86310]: INFO cinder.image.image_utils [None req-22867f21-ccd6-4408-b098-a14bc5a37cf2 tempest-VolumesGetTest-1470935452 None] Image download 20.69 MB at 20.69 MB/s Sep 23 14:44:08 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a32f3c8-16ec-4db1-90ce-1f3de7c329d8]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:44:08 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-22867f21-ccd6-4408-b098-a14bc5a37cf2 tempest-VolumesGetTest-1470935452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0cd395f9-e766-4e32-94b1-775454bf3449_tzwrn54udevstack@QuobyteHD {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:44:08 devstack sudo[99463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0cd395f9-e766-4e32-94b1-775454bf3449_tzwrn54udevstack@QuobyteHD Sep 23 14:44:08 devstack sudo[99463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:44:08 devstack sudo[99459]: pam_unix(sudo:session): session closed for user root Sep 23 14:44:08 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-c1193926-7172-49a2-a264-8681651c7feb tempest-TestImageHashVerification-489684057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-93d6305d-bf3d-4857-bf3e-02ac4e7fe95e" returned: 0 in 0.482s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:44:08 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-c1193926-7172-49a2-a264-8681651c7feb tempest-TestImageHashVerification-489684057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-93d6305d-bf3d-4857-bf3e-02ac4e7fe95e /opt/stack/data/cinder/conversion/93d6305d-bf3d-4857-bf3e-02ac4e7fe95e.temp_image.9b7c810e-7c87-4e8f-b302-a322e842c219p0wa12wc.img {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:44:08 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-771bf552-5484-4067-87aa-a6cf6c7d8e1f tempest-VolumesSnapshotTestJSON-2026192373 None] Acquiring lock "cinder-bfbdc3b3-3b6c-47c8-8e67-dfdd42955e7c-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:44:08 devstack sudo[99469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-93d6305d-bf3d-4857-bf3e-02ac4e7fe95e /opt/stack/data/cinder/conversion/93d6305d-bf3d-4857-bf3e-02ac4e7fe95e.temp_image.9b7c810e-7c87-4e8f-b302-a322e842c219p0wa12wc.img Sep 23 14:44:08 devstack sudo[99469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:44:08 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-771bf552-5484-4067-87aa-a6cf6c7d8e1f tempest-VolumesSnapshotTestJSON-2026192373 None] Lock "cinder-bfbdc3b3-3b6c-47c8-8e67-dfdd42955e7c-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:44:08 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-771bf552-5484-4067-87aa-a6cf6c7d8e1f tempest-VolumesSnapshotTestJSON-2026192373 None] Acquiring lock "cinder-quobyte-bfbdc3b3-3b6c-47c8-8e67-dfdd42955e7c" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:44:08 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-771bf552-5484-4067-87aa-a6cf6c7d8e1f tempest-VolumesSnapshotTestJSON-2026192373 None] Lock "cinder-quobyte-bfbdc3b3-3b6c-47c8-8e67-dfdd42955e7c" acquired by "delete_volume" :: waited 0.029s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:44:08 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b7d220a-cd9c-4922-8d5f-a0ef1cc0b238]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:44:08 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-771bf552-5484-4067-87aa-a6cf6c7d8e1f tempest-VolumesSnapshotTestJSON-2026192373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bfbdc3b3-3b6c-47c8-8e67-dfdd42955e7c {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:44:08 devstack sudo[99463]: pam_unix(sudo:session): session closed for user root Sep 23 14:44:08 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-22867f21-ccd6-4408-b098-a14bc5a37cf2 tempest-VolumesGetTest-1470935452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0cd395f9-e766-4e32-94b1-775454bf3449_tzwrn54udevstack@QuobyteHD" returned: 0 in 0.432s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:44:08 devstack cinder-volume[86310]: DEBUG cinder.image.image_utils [None req-22867f21-ccd6-4408-b098-a14bc5a37cf2 tempest-VolumesGetTest-1470935452 None] Temporary image 0cd395f9-e766-4e32-94b1-775454bf3449 is fetched for user 31a6159d91a940a48f5b4070277146b2. {{(pid=86310) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 23 14:44:08 devstack sudo[99471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bfbdc3b3-3b6c-47c8-8e67-dfdd42955e7c Sep 23 14:44:08 devstack sudo[99471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:44:08 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfe996dc-7af6-499a-9628-dd85d046235b]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:44:08 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-22867f21-ccd6-4408-b098-a14bc5a37cf2 tempest-VolumesGetTest-1470935452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0cd395f9-e766-4e32-94b1-775454bf3449_tzwrn54udevstack@QuobyteHD {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:44:09 devstack sudo[99480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0cd395f9-e766-4e32-94b1-775454bf3449_tzwrn54udevstack@QuobyteHD Sep 23 14:44:09 devstack sudo[99480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:44:09 devstack sudo[99480]: pam_unix(sudo:session): session closed for user root Sep 23 14:44:09 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-22867f21-ccd6-4408-b098-a14bc5a37cf2 tempest-VolumesGetTest-1470935452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0cd395f9-e766-4e32-94b1-775454bf3449_tzwrn54udevstack@QuobyteHD" returned: 0 in 0.810s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:44:09 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-22867f21-ccd6-4408-b098-a14bc5a37cf2 tempest-VolumesGetTest-1470935452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:44:09 devstack sudo[99471]: pam_unix(sudo:session): session closed for user root Sep 23 14:44:09 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-771bf552-5484-4067-87aa-a6cf6c7d8e1f tempest-VolumesSnapshotTestJSON-2026192373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bfbdc3b3-3b6c-47c8-8e67-dfdd42955e7c" returned: 0 in 1.001s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:44:09 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-771bf552-5484-4067-87aa-a6cf6c7d8e1f tempest-VolumesSnapshotTestJSON-2026192373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bfbdc3b3-3b6c-47c8-8e67-dfdd42955e7c {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:44:09 devstack sudo[99495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bfbdc3b3-3b6c-47c8-8e67-dfdd42955e7c Sep 23 14:44:09 devstack sudo[99495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:44:10 devstack sudo[99495]: pam_unix(sudo:session): session closed for user root Sep 23 14:44:10 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-771bf552-5484-4067-87aa-a6cf6c7d8e1f tempest-VolumesSnapshotTestJSON-2026192373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bfbdc3b3-3b6c-47c8-8e67-dfdd42955e7c" returned: 0 in 0.488s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:44:10 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-771bf552-5484-4067-87aa-a6cf6c7d8e1f tempest-VolumesSnapshotTestJSON-2026192373 None] Lock "cinder-quobyte-bfbdc3b3-3b6c-47c8-8e67-dfdd42955e7c" released by "delete_volume" :: held 1.562s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:44:10 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-771bf552-5484-4067-87aa-a6cf6c7d8e1f tempest-VolumesSnapshotTestJSON-2026192373 None] Created reservations ['b76474ef-2f99-465f-b7b9-6715ac043c28', 'e636eb93-582f-4ee0-a5f4-8ce999e80be1', 'c2c76c6c-16dc-47c7-ab24-7eed3da7e809', '420b0b7c-0a69-4a15-baaf-e32f57977155'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:44:10 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-771bf552-5484-4067-87aa-a6cf6c7d8e1f tempest-VolumesSnapshotTestJSON-2026192373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:44:10 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-771bf552-5484-4067-87aa-a6cf6c7d8e1f tempest-VolumesSnapshotTestJSON-2026192373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:44:10 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-771bf552-5484-4067-87aa-a6cf6c7d8e1f tempest-VolumesSnapshotTestJSON-2026192373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:44:10 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-771bf552-5484-4067-87aa-a6cf6c7d8e1f tempest-VolumesSnapshotTestJSON-2026192373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:44:10 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-771bf552-5484-4067-87aa-a6cf6c7d8e1f tempest-VolumesSnapshotTestJSON-2026192373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:44:10 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-771bf552-5484-4067-87aa-a6cf6c7d8e1f tempest-VolumesSnapshotTestJSON-2026192373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:44:10 devstack sudo[99498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:44:10 devstack sudo[99498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:44:11 devstack sudo[99498]: pam_unix(sudo:session): session closed for user root Sep 23 14:44:11 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-771bf552-5484-4067-87aa-a6cf6c7d8e1f tempest-VolumesSnapshotTestJSON-2026192373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.422s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:44:11 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-771bf552-5484-4067-87aa-a6cf6c7d8e1f tempest-VolumesSnapshotTestJSON-2026192373 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:44:11 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-771bf552-5484-4067-87aa-a6cf6c7d8e1f tempest-VolumesSnapshotTestJSON-2026192373 None] Deleted volume successfully. Sep 23 14:44:11 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-90300f8c-440c-4fb5-aee3-2615ca333d82 tempest-VolumesSnapshotTestJSON-2026192373 None] Acquiring lock "cinder-9bbcf549-9bf1-42ac-9cb8-42d2b01b617b-delete_snapshot" by "delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:44:11 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-771bf552-5484-4067-87aa-a6cf6c7d8e1f tempest-VolumesSnapshotTestJSON-2026192373 None] Lock "cinder-bfbdc3b3-3b6c-47c8-8e67-dfdd42955e7c-delete_volume" released by "delete_volume" :: held 2.490s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:44:11 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-90300f8c-440c-4fb5-aee3-2615ca333d82 tempest-VolumesSnapshotTestJSON-2026192373 None] Lock "cinder-9bbcf549-9bf1-42ac-9cb8-42d2b01b617b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:44:11 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-90300f8c-440c-4fb5-aee3-2615ca333d82 tempest-VolumesSnapshotTestJSON-2026192373 None] Acquiring lock "cinder-quobyte-731253f4-6a74-42c2-9363-06a913f3851a" by "delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:44:11 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-90300f8c-440c-4fb5-aee3-2615ca333d82 tempest-VolumesSnapshotTestJSON-2026192373 None] Lock "cinder-quobyte-731253f4-6a74-42c2-9363-06a913f3851a" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:44:11 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-90300f8c-440c-4fb5-aee3-2615ca333d82 tempest-VolumesSnapshotTestJSON-2026192373 None] Acquiring lock "cinder-quobyte-9bbcf549-9bf1-42ac-9cb8-42d2b01b617b" by "_delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:44:11 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-90300f8c-440c-4fb5-aee3-2615ca333d82 tempest-VolumesSnapshotTestJSON-2026192373 None] Lock "cinder-quobyte-9bbcf549-9bf1-42ac-9cb8-42d2b01b617b" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:44:11 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-90300f8c-440c-4fb5-aee3-2615ca333d82 tempest-VolumesSnapshotTestJSON-2026192373 None] Deleting offline snapshot 9bbcf549-9bf1-42ac-9cb8-42d2b01b617b of volume 731253f4-6a74-42c2-9363-06a913f3851a {{(pid=86310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 14:44:11 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-90300f8c-440c-4fb5-aee3-2615ca333d82 tempest-VolumesSnapshotTestJSON-2026192373 None] snapshot_file for this snap is: volume-731253f4-6a74-42c2-9363-06a913f3851a.9bbcf549-9bf1-42ac-9cb8-42d2b01b617b {{(pid=86310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 14:44:11 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d982ef5-32ab-4a7d-b53b-8495fe242d11]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:44:11 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-90300f8c-440c-4fb5-aee3-2615ca333d82 tempest-VolumesSnapshotTestJSON-2026192373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-731253f4-6a74-42c2-9363-06a913f3851a.9bbcf549-9bf1-42ac-9cb8-42d2b01b617b {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:44:11 devstack sudo[99504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-731253f4-6a74-42c2-9363-06a913f3851a.9bbcf549-9bf1-42ac-9cb8-42d2b01b617b Sep 23 14:44:11 devstack sudo[99504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:44:12 devstack sudo[99504]: pam_unix(sudo:session): session closed for user root Sep 23 14:44:12 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-90300f8c-440c-4fb5-aee3-2615ca333d82 tempest-VolumesSnapshotTestJSON-2026192373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-731253f4-6a74-42c2-9363-06a913f3851a.9bbcf549-9bf1-42ac-9cb8-42d2b01b617b" returned: 0 in 0.801s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:44:12 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-90300f8c-440c-4fb5-aee3-2615ca333d82 tempest-VolumesSnapshotTestJSON-2026192373 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-731253f4-6a74-42c2-9363-06a913f3851a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 14:44:12 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5caed49-5147-4c00-992d-2eabf9c87fba]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:44:12 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-90300f8c-440c-4fb5-aee3-2615ca333d82 tempest-VolumesSnapshotTestJSON-2026192373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-731253f4-6a74-42c2-9363-06a913f3851a {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:44:12 devstack sudo[99509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-731253f4-6a74-42c2-9363-06a913f3851a Sep 23 14:44:12 devstack sudo[99509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:44:13 devstack sudo[99509]: pam_unix(sudo:session): session closed for user root Sep 23 14:44:13 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-90300f8c-440c-4fb5-aee3-2615ca333d82 tempest-VolumesSnapshotTestJSON-2026192373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-731253f4-6a74-42c2-9363-06a913f3851a" returned: 0 in 1.254s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:44:13 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-90300f8c-440c-4fb5-aee3-2615ca333d82 tempest-VolumesSnapshotTestJSON-2026192373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-731253f4-6a74-42c2-9363-06a913f3851a.9bbcf549-9bf1-42ac-9cb8-42d2b01b617b {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:44:13 devstack sudo[99515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-731253f4-6a74-42c2-9363-06a913f3851a.9bbcf549-9bf1-42ac-9cb8-42d2b01b617b Sep 23 14:44:13 devstack sudo[99515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:44:14 devstack sudo[99515]: pam_unix(sudo:session): session closed for user root Sep 23 14:44:14 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-90300f8c-440c-4fb5-aee3-2615ca333d82 tempest-VolumesSnapshotTestJSON-2026192373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-731253f4-6a74-42c2-9363-06a913f3851a.9bbcf549-9bf1-42ac-9cb8-42d2b01b617b" returned: 0 in 0.775s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:44:14 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-90300f8c-440c-4fb5-aee3-2615ca333d82 tempest-VolumesSnapshotTestJSON-2026192373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-731253f4-6a74-42c2-9363-06a913f3851a.9bbcf549-9bf1-42ac-9cb8-42d2b01b617b {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:44:14 devstack sudo[99520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-731253f4-6a74-42c2-9363-06a913f3851a.9bbcf549-9bf1-42ac-9cb8-42d2b01b617b Sep 23 14:44:14 devstack sudo[99520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:44:14 devstack sudo[99520]: pam_unix(sudo:session): session closed for user root Sep 23 14:44:14 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-90300f8c-440c-4fb5-aee3-2615ca333d82 tempest-VolumesSnapshotTestJSON-2026192373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-731253f4-6a74-42c2-9363-06a913f3851a.9bbcf549-9bf1-42ac-9cb8-42d2b01b617b" returned: 0 in 0.622s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:44:14 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-90300f8c-440c-4fb5-aee3-2615ca333d82 tempest-VolumesSnapshotTestJSON-2026192373 None] Lock "cinder-quobyte-9bbcf549-9bf1-42ac-9cb8-42d2b01b617b" released by "_delete_snapshot" :: held 3.669s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:44:14 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-90300f8c-440c-4fb5-aee3-2615ca333d82 tempest-VolumesSnapshotTestJSON-2026192373 None] Lock "cinder-quobyte-731253f4-6a74-42c2-9363-06a913f3851a" released by "delete_snapshot" :: held 3.718s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:44:14 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-90300f8c-440c-4fb5-aee3-2615ca333d82 tempest-VolumesSnapshotTestJSON-2026192373 None] Created reservations ['0cfa205a-657c-4b17-924f-41de4df97266', '9c28bba8-b8fe-4327-ae55-d66de285e486', 'f0734233-2010-40f8-a027-e74209e82ff3', '4b5054e5-b379-4623-a8a1-8e214da0b669'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:44:15 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-90300f8c-440c-4fb5-aee3-2615ca333d82 tempest-VolumesSnapshotTestJSON-2026192373 None] Delete snapshot completed successfully. Sep 23 14:44:15 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-90300f8c-440c-4fb5-aee3-2615ca333d82 tempest-VolumesSnapshotTestJSON-2026192373 None] Lock "cinder-9bbcf549-9bf1-42ac-9cb8-42d2b01b617b-delete_snapshot" released by "delete_snapshot" :: held 3.966s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:44:15 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-a8e7d58b-2aca-4f80-a18e-f40b2af3f954 tempest-VolumesSnapshotTestJSON-2026192373 None] Acquiring lock "cinder-731253f4-6a74-42c2-9363-06a913f3851a-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:44:15 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-a8e7d58b-2aca-4f80-a18e-f40b2af3f954 tempest-VolumesSnapshotTestJSON-2026192373 None] Lock "cinder-731253f4-6a74-42c2-9363-06a913f3851a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:44:16 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-a8e7d58b-2aca-4f80-a18e-f40b2af3f954 tempest-VolumesSnapshotTestJSON-2026192373 None] Acquiring lock "cinder-quobyte-731253f4-6a74-42c2-9363-06a913f3851a" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:44:16 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-a8e7d58b-2aca-4f80-a18e-f40b2af3f954 tempest-VolumesSnapshotTestJSON-2026192373 None] Lock "cinder-quobyte-731253f4-6a74-42c2-9363-06a913f3851a" acquired by "delete_volume" :: waited 0.021s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:44:16 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a4d419d-8410-4d64-88a8-0558bc064d5f]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:44:16 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a8e7d58b-2aca-4f80-a18e-f40b2af3f954 tempest-VolumesSnapshotTestJSON-2026192373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-731253f4-6a74-42c2-9363-06a913f3851a {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:44:16 devstack sudo[99524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-731253f4-6a74-42c2-9363-06a913f3851a Sep 23 14:44:16 devstack sudo[99524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:44:16 devstack sudo[99469]: pam_unix(sudo:session): session closed for user root Sep 23 14:44:16 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-c1193926-7172-49a2-a264-8681651c7feb tempest-TestImageHashVerification-489684057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-93d6305d-bf3d-4857-bf3e-02ac4e7fe95e /opt/stack/data/cinder/conversion/93d6305d-bf3d-4857-bf3e-02ac4e7fe95e.temp_image.9b7c810e-7c87-4e8f-b302-a322e842c219p0wa12wc.img" returned: 0 in 7.982s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:44:16 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[bae6eded-f5c3-4092-a1b2-9a02bb76b361]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:44:16 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-c1193926-7172-49a2-a264-8681651c7feb tempest-TestImageHashVerification-489684057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-93d6305d-bf3d-4857-bf3e-02ac4e7fe95e {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:44:16 devstack sudo[99526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-93d6305d-bf3d-4857-bf3e-02ac4e7fe95e Sep 23 14:44:16 devstack sudo[99526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:44:16 devstack sudo[99524]: pam_unix(sudo:session): session closed for user root Sep 23 14:44:16 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a8e7d58b-2aca-4f80-a18e-f40b2af3f954 tempest-VolumesSnapshotTestJSON-2026192373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-731253f4-6a74-42c2-9363-06a913f3851a" returned: 0 in 0.516s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:44:16 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a8e7d58b-2aca-4f80-a18e-f40b2af3f954 tempest-VolumesSnapshotTestJSON-2026192373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-731253f4-6a74-42c2-9363-06a913f3851a {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:44:16 devstack sudo[99531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-731253f4-6a74-42c2-9363-06a913f3851a Sep 23 14:44:16 devstack sudo[99531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:44:17 devstack sudo[99531]: pam_unix(sudo:session): session closed for user root Sep 23 14:44:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a8e7d58b-2aca-4f80-a18e-f40b2af3f954 tempest-VolumesSnapshotTestJSON-2026192373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-731253f4-6a74-42c2-9363-06a913f3851a" returned: 0 in 0.324s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:44:17 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-a8e7d58b-2aca-4f80-a18e-f40b2af3f954 tempest-VolumesSnapshotTestJSON-2026192373 None] Lock "cinder-quobyte-731253f4-6a74-42c2-9363-06a913f3851a" released by "delete_volume" :: held 0.974s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:44:17 devstack sudo[99526]: pam_unix(sudo:session): session closed for user root Sep 23 14:44:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-c1193926-7172-49a2-a264-8681651c7feb tempest-TestImageHashVerification-489684057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-93d6305d-bf3d-4857-bf3e-02ac4e7fe95e" returned: 0 in 0.605s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:44:17 devstack cinder-volume[86310]: DEBUG cinder.image.image_utils [None req-c1193926-7172-49a2-a264-8681651c7feb tempest-TestImageHashVerification-489684057 None] Image conversion details: src /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-93d6305d-bf3d-4857-bf3e-02ac4e7fe95e, size 1024.00 MB, duration 7.98 sec, destination /opt/stack/data/cinder/conversion/93d6305d-bf3d-4857-bf3e-02ac4e7fe95e.temp_image.9b7c810e-7c87-4e8f-b302-a322e842c219p0wa12wc.img {{(pid=86310) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 14:44:17 devstack cinder-volume[86310]: INFO cinder.image.image_utils [None req-c1193926-7172-49a2-a264-8681651c7feb tempest-TestImageHashVerification-489684057 None] Converted 1024.00 MB image at 128.27 MB/s Sep 23 14:44:17 devstack cinder-volume[86310]: DEBUG cinder.image.image_utils [None req-c1193926-7172-49a2-a264-8681651c7feb tempest-TestImageHashVerification-489684057 None] 9b7c810e-7c87-4e8f-b302-a322e842c219 was raw, no need to convert to raw {{(pid=86310) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 23 14:44:17 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-a8e7d58b-2aca-4f80-a18e-f40b2af3f954 tempest-VolumesSnapshotTestJSON-2026192373 None] Created reservations ['2ccfe5e1-c347-40f3-ac8d-79b16d7236df', '8916bb7e-af79-491b-961f-9896116e0291', '904668fe-a157-40ec-b5e8-dc7f2e5513a1', 'b909209d-5b10-4eaa-bd0b-ff73e906aa51'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:44:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-a8e7d58b-2aca-4f80-a18e-f40b2af3f954 tempest-VolumesSnapshotTestJSON-2026192373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:44:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-a8e7d58b-2aca-4f80-a18e-f40b2af3f954 tempest-VolumesSnapshotTestJSON-2026192373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:44:17 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-a8e7d58b-2aca-4f80-a18e-f40b2af3f954 tempest-VolumesSnapshotTestJSON-2026192373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:44:17 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-a8e7d58b-2aca-4f80-a18e-f40b2af3f954 tempest-VolumesSnapshotTestJSON-2026192373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:44:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-a8e7d58b-2aca-4f80-a18e-f40b2af3f954 tempest-VolumesSnapshotTestJSON-2026192373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:44:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a8e7d58b-2aca-4f80-a18e-f40b2af3f954 tempest-VolumesSnapshotTestJSON-2026192373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:44:17 devstack sudo[99537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:44:17 devstack sudo[99537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:44:17 devstack sudo[99537]: pam_unix(sudo:session): session closed for user root Sep 23 14:44:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a8e7d58b-2aca-4f80-a18e-f40b2af3f954 tempest-VolumesSnapshotTestJSON-2026192373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.263s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:44:17 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-a8e7d58b-2aca-4f80-a18e-f40b2af3f954 tempest-VolumesSnapshotTestJSON-2026192373 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:44:17 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-a8e7d58b-2aca-4f80-a18e-f40b2af3f954 tempest-VolumesSnapshotTestJSON-2026192373 None] Deleted volume successfully. Sep 23 14:44:17 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-a8e7d58b-2aca-4f80-a18e-f40b2af3f954 tempest-VolumesSnapshotTestJSON-2026192373 None] Lock "cinder-731253f4-6a74-42c2-9363-06a913f3851a-delete_volume" released by "delete_volume" :: held 1.898s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:44:18 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-1d542966-f325-4ca1-acc8-98a4cf0a97f1 tempest-VolumesSnapshotTestJSON-2026192373 None] Acquiring lock "cinder-89074cb5-5a6e-47bb-9cd8-b9049d7cc04a-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:44:18 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-1d542966-f325-4ca1-acc8-98a4cf0a97f1 tempest-VolumesSnapshotTestJSON-2026192373 None] Lock "cinder-89074cb5-5a6e-47bb-9cd8-b9049d7cc04a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:44:18 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-1d542966-f325-4ca1-acc8-98a4cf0a97f1 tempest-VolumesSnapshotTestJSON-2026192373 None] Acquiring lock "cinder-quobyte-89074cb5-5a6e-47bb-9cd8-b9049d7cc04a" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:44:18 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-1d542966-f325-4ca1-acc8-98a4cf0a97f1 tempest-VolumesSnapshotTestJSON-2026192373 None] Lock "cinder-quobyte-89074cb5-5a6e-47bb-9cd8-b9049d7cc04a" acquired by "delete_volume" :: waited 0.026s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:44:18 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[384bc980-479d-4cce-9998-90773e4e3321]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:44:18 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-1d542966-f325-4ca1-acc8-98a4cf0a97f1 tempest-VolumesSnapshotTestJSON-2026192373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-89074cb5-5a6e-47bb-9cd8-b9049d7cc04a {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:44:19 devstack sudo[99540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-89074cb5-5a6e-47bb-9cd8-b9049d7cc04a Sep 23 14:44:19 devstack sudo[99540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:44:19 devstack sudo[99540]: pam_unix(sudo:session): session closed for user root Sep 23 14:44:19 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-1d542966-f325-4ca1-acc8-98a4cf0a97f1 tempest-VolumesSnapshotTestJSON-2026192373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-89074cb5-5a6e-47bb-9cd8-b9049d7cc04a" returned: 0 in 0.553s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:44:19 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-1d542966-f325-4ca1-acc8-98a4cf0a97f1 tempest-VolumesSnapshotTestJSON-2026192373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-89074cb5-5a6e-47bb-9cd8-b9049d7cc04a {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:44:19 devstack sudo[99545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-89074cb5-5a6e-47bb-9cd8-b9049d7cc04a Sep 23 14:44:19 devstack sudo[99545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:44:19 devstack sudo[99545]: pam_unix(sudo:session): session closed for user root Sep 23 14:44:19 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-1d542966-f325-4ca1-acc8-98a4cf0a97f1 tempest-VolumesSnapshotTestJSON-2026192373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-89074cb5-5a6e-47bb-9cd8-b9049d7cc04a" returned: 0 in 0.440s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:44:19 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-1d542966-f325-4ca1-acc8-98a4cf0a97f1 tempest-VolumesSnapshotTestJSON-2026192373 None] Lock "cinder-quobyte-89074cb5-5a6e-47bb-9cd8-b9049d7cc04a" released by "delete_volume" :: held 1.111s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:44:20 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-1d542966-f325-4ca1-acc8-98a4cf0a97f1 tempest-VolumesSnapshotTestJSON-2026192373 None] Created reservations ['8c8cd4f1-5367-4607-bd64-4db6a96ca635', '350e7115-54fc-4c31-ba18-b805a1477846', '8090314a-0075-4461-953d-7f6a8ce49f3f', 'c5a69163-5f1c-48f2-9c3d-f4c968d8b360'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:44:20 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-1d542966-f325-4ca1-acc8-98a4cf0a97f1 tempest-VolumesSnapshotTestJSON-2026192373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:44:20 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-1d542966-f325-4ca1-acc8-98a4cf0a97f1 tempest-VolumesSnapshotTestJSON-2026192373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:44:20 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-1d542966-f325-4ca1-acc8-98a4cf0a97f1 tempest-VolumesSnapshotTestJSON-2026192373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:44:20 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-1d542966-f325-4ca1-acc8-98a4cf0a97f1 tempest-VolumesSnapshotTestJSON-2026192373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:44:20 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-1d542966-f325-4ca1-acc8-98a4cf0a97f1 tempest-VolumesSnapshotTestJSON-2026192373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:44:20 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-1d542966-f325-4ca1-acc8-98a4cf0a97f1 tempest-VolumesSnapshotTestJSON-2026192373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:44:20 devstack sudo[99548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:44:20 devstack sudo[99548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:44:21 devstack sudo[99548]: pam_unix(sudo:session): session closed for user root Sep 23 14:44:21 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-1d542966-f325-4ca1-acc8-98a4cf0a97f1 tempest-VolumesSnapshotTestJSON-2026192373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.351s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:44:21 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-1d542966-f325-4ca1-acc8-98a4cf0a97f1 tempest-VolumesSnapshotTestJSON-2026192373 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:44:21 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-1d542966-f325-4ca1-acc8-98a4cf0a97f1 tempest-VolumesSnapshotTestJSON-2026192373 None] Deleted volume successfully. Sep 23 14:44:21 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-1d542966-f325-4ca1-acc8-98a4cf0a97f1 tempest-VolumesSnapshotTestJSON-2026192373 None] Lock "cinder-89074cb5-5a6e-47bb-9cd8-b9049d7cc04a-delete_volume" released by "delete_volume" :: held 2.652s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:44:27 devstack cinder-volume[86310]: DEBUG dbcounter [-] [86310] Writing DB stats cinder:SELECT=98,cinder:UPDATE=132,cinder:DELETE=12,cinder:INSERT=31 {{(pid=86310) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 14:44:27 devstack cinder-volume[86310]: DEBUG dbcounter [-] [86310] Writing DB stats cinder:UPDATE=127,cinder:INSERT=34,cinder:SELECT=95,cinder:DELETE=9 {{(pid=86310) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 14:44:39 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e23f7b0-9946-4878-82c2-309adc1b39d1 tempest-TestServerVolumeAttachmentScenario-656438129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:44:39 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-7e23f7b0-9946-4878-82c2-309adc1b39d1 tempest-TestServerVolumeAttachmentScenario-656438129 None] Flow 'volume_create_manager' (3b73360c-b8cc-416d-b5a9-0c6c86e611dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:44:39 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-7e23f7b0-9946-4878-82c2-309adc1b39d1 tempest-TestServerVolumeAttachmentScenario-656438129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcd182b2-5c90-4387-93cc-0a52748cc332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:44:39 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-7e23f7b0-9946-4878-82c2-309adc1b39d1 tempest-TestServerVolumeAttachmentScenario-656438129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcd182b2-5c90-4387-93cc-0a52748cc332) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:44:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-855776333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1fd58c0-5cbd-438c-ba6f-7b2022aa3736,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbdc7191e2fc48e9a7bf46d04b6e53bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:44:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:44:39Z,use_quota=True,user_id='79a53e547ee14558b4b0abc3be718689',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:44:39 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-7e23f7b0-9946-4878-82c2-309adc1b39d1 tempest-TestServerVolumeAttachmentScenario-656438129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8a54907-9868-492e-841b-05b144ce6433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:44:39 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-7e23f7b0-9946-4878-82c2-309adc1b39d1 tempest-TestServerVolumeAttachmentScenario-656438129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8a54907-9868-492e-841b-05b144ce6433) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:44:39 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-7e23f7b0-9946-4878-82c2-309adc1b39d1 tempest-TestServerVolumeAttachmentScenario-656438129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e4aba7a-a580-4c3d-ab45-229f58335d6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:44:39 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-7e23f7b0-9946-4878-82c2-309adc1b39d1 tempest-TestServerVolumeAttachmentScenario-656438129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e4aba7a-a580-4c3d-ab45-229f58335d6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1fd58c0-5cbd-438c-ba6f-7b2022aa3736', 'volume_name': 'volume-f1fd58c0-5cbd-438c-ba6f-7b2022aa3736', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:44:39 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-7e23f7b0-9946-4878-82c2-309adc1b39d1 tempest-TestServerVolumeAttachmentScenario-656438129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2829636f-969a-4e53-b86c-c4d8b43543af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:44:39 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-7e23f7b0-9946-4878-82c2-309adc1b39d1 tempest-TestServerVolumeAttachmentScenario-656438129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2829636f-969a-4e53-b86c-c4d8b43543af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:44:39 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-7e23f7b0-9946-4878-82c2-309adc1b39d1 tempest-TestServerVolumeAttachmentScenario-656438129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f3a41de-fd70-42b3-a937-f23ea3a0ffb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:44:39 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-7e23f7b0-9946-4878-82c2-309adc1b39d1 tempest-TestServerVolumeAttachmentScenario-656438129 None] Volume f1fd58c0-5cbd-438c-ba6f-7b2022aa3736: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1fd58c0-5cbd-438c-ba6f-7b2022aa3736', 'volume_size': 1} Sep 23 14:44:39 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-7e23f7b0-9946-4878-82c2-309adc1b39d1 tempest-TestServerVolumeAttachmentScenario-656438129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:44:39 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-688de64d-4b2e-4834-b043-dad79770c330 tempest-TestServerVolumeAttachmentScenario-656438129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:44:39 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-688de64d-4b2e-4834-b043-dad79770c330 tempest-TestServerVolumeAttachmentScenario-656438129 None] Flow 'volume_create_manager' (8866ef0e-ca13-4fbd-8ba9-bfae230c3035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:44:39 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-688de64d-4b2e-4834-b043-dad79770c330 tempest-TestServerVolumeAttachmentScenario-656438129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93619124-9950-4e50-9349-8285927dc96b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:44:39 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-688de64d-4b2e-4834-b043-dad79770c330 tempest-TestServerVolumeAttachmentScenario-656438129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93619124-9950-4e50-9349-8285927dc96b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:44:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-210040719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12ea1d58-2c36-4830-9bf1-88d6434e9148,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbdc7191e2fc48e9a7bf46d04b6e53bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:44:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:44:40Z,use_quota=True,user_id='79a53e547ee14558b4b0abc3be718689',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:44:39 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-688de64d-4b2e-4834-b043-dad79770c330 tempest-TestServerVolumeAttachmentScenario-656438129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a237a41d-f696-4521-9d7b-6024d3972748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:44:39 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-688de64d-4b2e-4834-b043-dad79770c330 tempest-TestServerVolumeAttachmentScenario-656438129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a237a41d-f696-4521-9d7b-6024d3972748) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:44:39 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-688de64d-4b2e-4834-b043-dad79770c330 tempest-TestServerVolumeAttachmentScenario-656438129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3acd8704-c064-449b-865c-e8aa4d09becc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:44:39 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-688de64d-4b2e-4834-b043-dad79770c330 tempest-TestServerVolumeAttachmentScenario-656438129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3acd8704-c064-449b-865c-e8aa4d09becc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12ea1d58-2c36-4830-9bf1-88d6434e9148', 'volume_name': 'volume-12ea1d58-2c36-4830-9bf1-88d6434e9148', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:44:39 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-688de64d-4b2e-4834-b043-dad79770c330 tempest-TestServerVolumeAttachmentScenario-656438129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f6759c7-b8e4-450a-b56e-6e4cdd2c6f1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:44:39 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-688de64d-4b2e-4834-b043-dad79770c330 tempest-TestServerVolumeAttachmentScenario-656438129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f6759c7-b8e4-450a-b56e-6e4cdd2c6f1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:44:39 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-688de64d-4b2e-4834-b043-dad79770c330 tempest-TestServerVolumeAttachmentScenario-656438129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20f4aa70-2834-4d29-8786-f59c72e46dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:44:39 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-688de64d-4b2e-4834-b043-dad79770c330 tempest-TestServerVolumeAttachmentScenario-656438129 None] Volume 12ea1d58-2c36-4830-9bf1-88d6434e9148: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12ea1d58-2c36-4830-9bf1-88d6434e9148', 'volume_size': 1} Sep 23 14:44:39 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-688de64d-4b2e-4834-b043-dad79770c330 tempest-TestServerVolumeAttachmentScenario-656438129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:44:42 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-c1193926-7172-49a2-a264-8681651c7feb tempest-TestImageHashVerification-489684057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 35.096s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:44:42 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-c1193926-7172-49a2-a264-8681651c7feb tempest-TestImageHashVerification-489684057 None] Uploaded volume to glance image-id: 9b7c810e-7c87-4e8f-b302-a322e842c219. {{(pid=86310) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 23 14:44:42 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-22867f21-ccd6-4408-b098-a14bc5a37cf2 tempest-VolumesGetTest-1470935452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 32.971s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:44:42 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-22867f21-ccd6-4408-b098-a14bc5a37cf2 tempest-VolumesGetTest-1470935452 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:44:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-693364931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0e686dc-5da3-4f58-916a-2485094ad7ec,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='00651445389c45f2aa5764549f6a9307',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:44:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:44:07Z,use_quota=True,user_id='31a6159d91a940a48f5b4070277146b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:44:42 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-22867f21-ccd6-4408-b098-a14bc5a37cf2 tempest-VolumesGetTest-1470935452 None] Creating volume e0e686dc-5da3-4f58-916a-2485094ad7ec {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:44:42 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-22867f21-ccd6-4408-b098-a14bc5a37cf2 tempest-VolumesGetTest-1470935452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:44:42 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-22867f21-ccd6-4408-b098-a14bc5a37cf2 tempest-VolumesGetTest-1470935452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:44:42 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-22867f21-ccd6-4408-b098-a14bc5a37cf2 tempest-VolumesGetTest-1470935452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:44:42 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-22867f21-ccd6-4408-b098-a14bc5a37cf2 tempest-VolumesGetTest-1470935452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:44:42 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-22867f21-ccd6-4408-b098-a14bc5a37cf2 tempest-VolumesGetTest-1470935452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:44:42 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-22867f21-ccd6-4408-b098-a14bc5a37cf2 tempest-VolumesGetTest-1470935452 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:44:42 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-22867f21-ccd6-4408-b098-a14bc5a37cf2 tempest-VolumesGetTest-1470935452 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:44:42 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-22867f21-ccd6-4408-b098-a14bc5a37cf2 tempest-VolumesGetTest-1470935452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e0e686dc-5da3-4f58-916a-2485094ad7ec 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:44:42 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-c1193926-7172-49a2-a264-8681651c7feb tempest-TestImageHashVerification-489684057 None] Copy volume to image completed successfully. Sep 23 14:44:42 devstack sudo[99600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e0e686dc-5da3-4f58-916a-2485094ad7ec 1073741824 Sep 23 14:44:42 devstack sudo[99600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:44:43 devstack sudo[99600]: pam_unix(sudo:session): session closed for user root Sep 23 14:44:43 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-22867f21-ccd6-4408-b098-a14bc5a37cf2 tempest-VolumesGetTest-1470935452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e0e686dc-5da3-4f58-916a-2485094ad7ec 1073741824" returned: 0 in 0.601s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:44:43 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-22867f21-ccd6-4408-b098-a14bc5a37cf2 tempest-VolumesGetTest-1470935452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e0e686dc-5da3-4f58-916a-2485094ad7ec {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:44:43 devstack sudo[99606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e0e686dc-5da3-4f58-916a-2485094ad7ec Sep 23 14:44:43 devstack sudo[99606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:44:43 devstack sudo[99606]: pam_unix(sudo:session): session closed for user root Sep 23 14:44:43 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-22867f21-ccd6-4408-b098-a14bc5a37cf2 tempest-VolumesGetTest-1470935452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e0e686dc-5da3-4f58-916a-2485094ad7ec" returned: 0 in 0.367s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:44:43 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-22867f21-ccd6-4408-b098-a14bc5a37cf2 tempest-VolumesGetTest-1470935452 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:44:43 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-22867f21-ccd6-4408-b098-a14bc5a37cf2 tempest-VolumesGetTest-1470935452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:44:43 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-7e23f7b0-9946-4878-82c2-309adc1b39d1 tempest-TestServerVolumeAttachmentScenario-656438129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.369s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:44:43 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-7e23f7b0-9946-4878-82c2-309adc1b39d1 tempest-TestServerVolumeAttachmentScenario-656438129 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:44:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-855776333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1fd58c0-5cbd-438c-ba6f-7b2022aa3736,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbdc7191e2fc48e9a7bf46d04b6e53bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:44:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:44:39Z,use_quota=True,user_id='79a53e547ee14558b4b0abc3be718689',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:44:43 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-7e23f7b0-9946-4878-82c2-309adc1b39d1 tempest-TestServerVolumeAttachmentScenario-656438129 None] Creating volume f1fd58c0-5cbd-438c-ba6f-7b2022aa3736 {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:44:43 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-7e23f7b0-9946-4878-82c2-309adc1b39d1 tempest-TestServerVolumeAttachmentScenario-656438129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:44:43 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-7e23f7b0-9946-4878-82c2-309adc1b39d1 tempest-TestServerVolumeAttachmentScenario-656438129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:44:43 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-7e23f7b0-9946-4878-82c2-309adc1b39d1 tempest-TestServerVolumeAttachmentScenario-656438129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:44:43 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-7e23f7b0-9946-4878-82c2-309adc1b39d1 tempest-TestServerVolumeAttachmentScenario-656438129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:44:43 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-7e23f7b0-9946-4878-82c2-309adc1b39d1 tempest-TestServerVolumeAttachmentScenario-656438129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:44:43 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-7e23f7b0-9946-4878-82c2-309adc1b39d1 tempest-TestServerVolumeAttachmentScenario-656438129 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:44:43 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-7e23f7b0-9946-4878-82c2-309adc1b39d1 tempest-TestServerVolumeAttachmentScenario-656438129 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:44:43 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-7e23f7b0-9946-4878-82c2-309adc1b39d1 tempest-TestServerVolumeAttachmentScenario-656438129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-f1fd58c0-5cbd-438c-ba6f-7b2022aa3736 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:44:43 devstack sudo[99609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-f1fd58c0-5cbd-438c-ba6f-7b2022aa3736 1073741824 Sep 23 14:44:43 devstack sudo[99609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:44:43 devstack cinder-volume[86310]: DEBUG cinder.volume.volume_utils [None req-22867f21-ccd6-4408-b098-a14bc5a37cf2 tempest-VolumesGetTest-1470935452 None] Attempting download of 0cd395f9-e766-4e32-94b1-775454bf3449 ((None, [{'url': 'file:///opt/stack/data/glance/images/0cd395f9-e766-4e32-94b1-775454bf3449', 'metadata': {}}])) to volume e0e686dc-5da3-4f58-916a-2485094ad7ec. {{(pid=86310) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 23 14:44:43 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[1538ac5f-1108-46c7-a22b-d0a0cb72b924]: (4, 'raw') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:44:43 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-22867f21-ccd6-4408-b098-a14bc5a37cf2 tempest-VolumesGetTest-1470935452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0cd395f9-e766-4e32-94b1-775454bf3449_uoszdqpc {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:44:44 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-63cfc535-4879-41ab-9ddb-6e76b2990b77 tempest-TestImageHashVerification-489684057 None] Acquiring lock "cinder-93d6305d-bf3d-4857-bf3e-02ac4e7fe95e-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:44:44 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-63cfc535-4879-41ab-9ddb-6e76b2990b77 tempest-TestImageHashVerification-489684057 None] Lock "cinder-93d6305d-bf3d-4857-bf3e-02ac4e7fe95e-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:44:44 devstack sudo[99611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0cd395f9-e766-4e32-94b1-775454bf3449_uoszdqpc Sep 23 14:44:44 devstack sudo[99611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:44:44 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-63cfc535-4879-41ab-9ddb-6e76b2990b77 tempest-TestImageHashVerification-489684057 None] Acquiring lock "cinder-quobyte-93d6305d-bf3d-4857-bf3e-02ac4e7fe95e" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:44:44 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-63cfc535-4879-41ab-9ddb-6e76b2990b77 tempest-TestImageHashVerification-489684057 None] Lock "cinder-quobyte-93d6305d-bf3d-4857-bf3e-02ac4e7fe95e" acquired by "delete_volume" :: waited 0.020s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:44:44 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[909bdfba-ada7-446a-aa23-37893dc16e67]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:44:44 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-63cfc535-4879-41ab-9ddb-6e76b2990b77 tempest-TestImageHashVerification-489684057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-93d6305d-bf3d-4857-bf3e-02ac4e7fe95e {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:44:44 devstack sudo[99616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-93d6305d-bf3d-4857-bf3e-02ac4e7fe95e Sep 23 14:44:44 devstack sudo[99616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:44:44 devstack sudo[99611]: pam_unix(sudo:session): session closed for user root Sep 23 14:44:44 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-22867f21-ccd6-4408-b098-a14bc5a37cf2 tempest-VolumesGetTest-1470935452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0cd395f9-e766-4e32-94b1-775454bf3449_uoszdqpc" returned: 0 in 0.542s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:44:44 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-22867f21-ccd6-4408-b098-a14bc5a37cf2 tempest-VolumesGetTest-1470935452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0cd395f9-e766-4e32-94b1-775454bf3449_uoszdqpc {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:44:44 devstack sudo[99609]: pam_unix(sudo:session): session closed for user root Sep 23 14:44:44 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-7e23f7b0-9946-4878-82c2-309adc1b39d1 tempest-TestServerVolumeAttachmentScenario-656438129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-f1fd58c0-5cbd-438c-ba6f-7b2022aa3736 1073741824" returned: 0 in 0.903s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:44:44 devstack sudo[99621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0cd395f9-e766-4e32-94b1-775454bf3449_uoszdqpc Sep 23 14:44:44 devstack sudo[99621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:44:44 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-7e23f7b0-9946-4878-82c2-309adc1b39d1 tempest-TestServerVolumeAttachmentScenario-656438129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-f1fd58c0-5cbd-438c-ba6f-7b2022aa3736 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:44:44 devstack sudo[99626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-f1fd58c0-5cbd-438c-ba6f-7b2022aa3736 Sep 23 14:44:44 devstack sudo[99626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:44:44 devstack sudo[99616]: pam_unix(sudo:session): session closed for user root Sep 23 14:44:44 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-63cfc535-4879-41ab-9ddb-6e76b2990b77 tempest-TestImageHashVerification-489684057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-93d6305d-bf3d-4857-bf3e-02ac4e7fe95e" returned: 0 in 0.513s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:44:44 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-63cfc535-4879-41ab-9ddb-6e76b2990b77 tempest-TestImageHashVerification-489684057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-93d6305d-bf3d-4857-bf3e-02ac4e7fe95e {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:44:44 devstack sudo[99628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-93d6305d-bf3d-4857-bf3e-02ac4e7fe95e Sep 23 14:44:44 devstack sudo[99628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:44:45 devstack sudo[99621]: pam_unix(sudo:session): session closed for user root Sep 23 14:44:45 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-22867f21-ccd6-4408-b098-a14bc5a37cf2 tempest-VolumesGetTest-1470935452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0cd395f9-e766-4e32-94b1-775454bf3449_uoszdqpc" returned: 1 in 0.562s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:44:45 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-22867f21-ccd6-4408-b098-a14bc5a37cf2 tempest-VolumesGetTest-1470935452 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0cd395f9-e766-4e32-94b1-775454bf3449_uoszdqpc' failed. Not Retrying. {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 14:44:45 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[13243bc6-93ef-4201-9d31-fdce5511f3aa]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:44:45 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-22867f21-ccd6-4408-b098-a14bc5a37cf2 tempest-VolumesGetTest-1470935452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0cd395f9-e766-4e32-94b1-775454bf3449_tzwrn54udevstack@QuobyteHD {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:44:45 devstack sudo[99628]: pam_unix(sudo:session): session closed for user root Sep 23 14:44:45 devstack sudo[99626]: pam_unix(sudo:session): session closed for user root Sep 23 14:44:45 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-63cfc535-4879-41ab-9ddb-6e76b2990b77 tempest-TestImageHashVerification-489684057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-93d6305d-bf3d-4857-bf3e-02ac4e7fe95e" returned: 0 in 0.327s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:44:45 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-7e23f7b0-9946-4878-82c2-309adc1b39d1 tempest-TestServerVolumeAttachmentScenario-656438129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-f1fd58c0-5cbd-438c-ba6f-7b2022aa3736" returned: 0 in 0.404s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:44:45 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-7e23f7b0-9946-4878-82c2-309adc1b39d1 tempest-TestServerVolumeAttachmentScenario-656438129 None] <== create_volume: return (1381ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:44:45 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-7e23f7b0-9946-4878-82c2-309adc1b39d1 tempest-TestServerVolumeAttachmentScenario-656438129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.384s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:44:45 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-688de64d-4b2e-4834-b043-dad79770c330 tempest-TestServerVolumeAttachmentScenario-656438129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.310s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:44:45 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-688de64d-4b2e-4834-b043-dad79770c330 tempest-TestServerVolumeAttachmentScenario-656438129 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:44:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-210040719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12ea1d58-2c36-4830-9bf1-88d6434e9148,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbdc7191e2fc48e9a7bf46d04b6e53bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:44:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:44:40Z,use_quota=True,user_id='79a53e547ee14558b4b0abc3be718689',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:44:45 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-688de64d-4b2e-4834-b043-dad79770c330 tempest-TestServerVolumeAttachmentScenario-656438129 None] Creating volume 12ea1d58-2c36-4830-9bf1-88d6434e9148 {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:44:45 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-688de64d-4b2e-4834-b043-dad79770c330 tempest-TestServerVolumeAttachmentScenario-656438129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:44:45 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-688de64d-4b2e-4834-b043-dad79770c330 tempest-TestServerVolumeAttachmentScenario-656438129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:44:45 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-688de64d-4b2e-4834-b043-dad79770c330 tempest-TestServerVolumeAttachmentScenario-656438129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:44:45 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-688de64d-4b2e-4834-b043-dad79770c330 tempest-TestServerVolumeAttachmentScenario-656438129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:44:45 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-688de64d-4b2e-4834-b043-dad79770c330 tempest-TestServerVolumeAttachmentScenario-656438129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:44:45 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-688de64d-4b2e-4834-b043-dad79770c330 tempest-TestServerVolumeAttachmentScenario-656438129 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:44:45 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-688de64d-4b2e-4834-b043-dad79770c330 tempest-TestServerVolumeAttachmentScenario-656438129 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:44:45 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-688de64d-4b2e-4834-b043-dad79770c330 tempest-TestServerVolumeAttachmentScenario-656438129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-12ea1d58-2c36-4830-9bf1-88d6434e9148 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:44:45 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-63cfc535-4879-41ab-9ddb-6e76b2990b77 tempest-TestImageHashVerification-489684057 None] Lock "cinder-quobyte-93d6305d-bf3d-4857-bf3e-02ac4e7fe95e" released by "delete_volume" :: held 0.948s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:44:45 devstack sudo[99635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-12ea1d58-2c36-4830-9bf1-88d6434e9148 1073741824 Sep 23 14:44:45 devstack sudo[99635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:44:45 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-7e23f7b0-9946-4878-82c2-309adc1b39d1 tempest-TestServerVolumeAttachmentScenario-656438129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f3a41de-fd70-42b3-a937-f23ea3a0ffb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1fd58c0-5cbd-438c-ba6f-7b2022aa3736', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:44:45 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-7e23f7b0-9946-4878-82c2-309adc1b39d1 tempest-TestServerVolumeAttachmentScenario-656438129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2226b450-0b19-4a81-9eb4-1192c4c108f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:44:45 devstack sudo[99634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0cd395f9-e766-4e32-94b1-775454bf3449_tzwrn54udevstack@QuobyteHD Sep 23 14:44:45 devstack sudo[99634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:44:45 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-7e23f7b0-9946-4878-82c2-309adc1b39d1 tempest-TestServerVolumeAttachmentScenario-656438129 None] Volume volume-f1fd58c0-5cbd-438c-ba6f-7b2022aa3736 (f1fd58c0-5cbd-438c-ba6f-7b2022aa3736): created successfully Sep 23 14:44:45 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-7e23f7b0-9946-4878-82c2-309adc1b39d1 tempest-TestServerVolumeAttachmentScenario-656438129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2226b450-0b19-4a81-9eb4-1192c4c108f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:44:45 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-7e23f7b0-9946-4878-82c2-309adc1b39d1 tempest-TestServerVolumeAttachmentScenario-656438129 None] Flow 'volume_create_manager' (3b73360c-b8cc-416d-b5a9-0c6c86e611dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:44:45 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-7e23f7b0-9946-4878-82c2-309adc1b39d1 tempest-TestServerVolumeAttachmentScenario-656438129 None] Created volume successfully. Sep 23 14:44:45 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-63cfc535-4879-41ab-9ddb-6e76b2990b77 tempest-TestImageHashVerification-489684057 None] Created reservations ['f90632d6-527f-41a4-b7f4-e0d5eeea9598', '93f47a79-690a-4f43-8fc2-0e536c9d992b', '9c33e7cd-bc92-4b67-b97f-5cce60b1c9b2', '78bf888e-0aba-46cc-ae73-31de85eca95b'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:44:45 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-63cfc535-4879-41ab-9ddb-6e76b2990b77 tempest-TestImageHashVerification-489684057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:44:45 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-63cfc535-4879-41ab-9ddb-6e76b2990b77 tempest-TestImageHashVerification-489684057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:44:45 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-63cfc535-4879-41ab-9ddb-6e76b2990b77 tempest-TestImageHashVerification-489684057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:44:45 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-63cfc535-4879-41ab-9ddb-6e76b2990b77 tempest-TestImageHashVerification-489684057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:44:45 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-63cfc535-4879-41ab-9ddb-6e76b2990b77 tempest-TestImageHashVerification-489684057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:44:45 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-63cfc535-4879-41ab-9ddb-6e76b2990b77 tempest-TestImageHashVerification-489684057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:44:45 devstack sudo[99641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:44:45 devstack sudo[99641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:44:45 devstack sudo[99634]: pam_unix(sudo:session): session closed for user root Sep 23 14:44:45 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-22867f21-ccd6-4408-b098-a14bc5a37cf2 tempest-VolumesGetTest-1470935452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0cd395f9-e766-4e32-94b1-775454bf3449_tzwrn54udevstack@QuobyteHD" returned: 0 in 0.521s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:44:45 devstack cinder-volume[86310]: DEBUG cinder.image.image_utils [None req-22867f21-ccd6-4408-b098-a14bc5a37cf2 tempest-VolumesGetTest-1470935452 None] 0cd395f9-e766-4e32-94b1-775454bf3449 was qcow2, converting to qcow2 {{(pid=86310) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 23 14:44:45 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-22867f21-ccd6-4408-b098-a14bc5a37cf2 tempest-VolumesGetTest-1470935452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0cd395f9-e766-4e32-94b1-775454bf3449_tzwrn54udevstack@QuobyteHD /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e0e686dc-5da3-4f58-916a-2485094ad7ec {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:44:45 devstack sudo[99646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0cd395f9-e766-4e32-94b1-775454bf3449_tzwrn54udevstack@QuobyteHD /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e0e686dc-5da3-4f58-916a-2485094ad7ec Sep 23 14:44:45 devstack sudo[99646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:44:46 devstack sudo[99635]: pam_unix(sudo:session): session closed for user root Sep 23 14:44:46 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-688de64d-4b2e-4834-b043-dad79770c330 tempest-TestServerVolumeAttachmentScenario-656438129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-12ea1d58-2c36-4830-9bf1-88d6434e9148 1073741824" returned: 0 in 0.860s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:44:46 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-688de64d-4b2e-4834-b043-dad79770c330 tempest-TestServerVolumeAttachmentScenario-656438129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-12ea1d58-2c36-4830-9bf1-88d6434e9148 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:44:46 devstack sudo[99641]: pam_unix(sudo:session): session closed for user root Sep 23 14:44:46 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-63cfc535-4879-41ab-9ddb-6e76b2990b77 tempest-TestImageHashVerification-489684057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.605s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:44:46 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-63cfc535-4879-41ab-9ddb-6e76b2990b77 tempest-TestImageHashVerification-489684057 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:44:46 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-63cfc535-4879-41ab-9ddb-6e76b2990b77 tempest-TestImageHashVerification-489684057 None] Deleted volume successfully. Sep 23 14:44:46 devstack sudo[99655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-12ea1d58-2c36-4830-9bf1-88d6434e9148 Sep 23 14:44:46 devstack sudo[99655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:44:46 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-63cfc535-4879-41ab-9ddb-6e76b2990b77 tempest-TestImageHashVerification-489684057 None] Lock "cinder-93d6305d-bf3d-4857-bf3e-02ac4e7fe95e-delete_volume" released by "delete_volume" :: held 2.057s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:44:46 devstack sudo[99655]: pam_unix(sudo:session): session closed for user root Sep 23 14:44:46 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-688de64d-4b2e-4834-b043-dad79770c330 tempest-TestServerVolumeAttachmentScenario-656438129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-12ea1d58-2c36-4830-9bf1-88d6434e9148" returned: 0 in 0.448s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:44:46 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-688de64d-4b2e-4834-b043-dad79770c330 tempest-TestServerVolumeAttachmentScenario-656438129 None] <== create_volume: return (1397ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:44:46 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-688de64d-4b2e-4834-b043-dad79770c330 tempest-TestServerVolumeAttachmentScenario-656438129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.402s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:44:46 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-688de64d-4b2e-4834-b043-dad79770c330 tempest-TestServerVolumeAttachmentScenario-656438129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20f4aa70-2834-4d29-8786-f59c72e46dc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12ea1d58-2c36-4830-9bf1-88d6434e9148', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:44:46 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-688de64d-4b2e-4834-b043-dad79770c330 tempest-TestServerVolumeAttachmentScenario-656438129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abdef916-1e8b-4b19-95fe-64c8e739d7f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:44:46 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-688de64d-4b2e-4834-b043-dad79770c330 tempest-TestServerVolumeAttachmentScenario-656438129 None] Volume volume-12ea1d58-2c36-4830-9bf1-88d6434e9148 (12ea1d58-2c36-4830-9bf1-88d6434e9148): created successfully Sep 23 14:44:46 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-688de64d-4b2e-4834-b043-dad79770c330 tempest-TestServerVolumeAttachmentScenario-656438129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abdef916-1e8b-4b19-95fe-64c8e739d7f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:44:46 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-688de64d-4b2e-4834-b043-dad79770c330 tempest-TestServerVolumeAttachmentScenario-656438129 None] Flow 'volume_create_manager' (8866ef0e-ca13-4fbd-8ba9-bfae230c3035) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:44:46 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-688de64d-4b2e-4834-b043-dad79770c330 tempest-TestServerVolumeAttachmentScenario-656438129 None] Created volume successfully. Sep 23 14:44:48 devstack sudo[99646]: pam_unix(sudo:session): session closed for user root Sep 23 14:44:48 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-22867f21-ccd6-4408-b098-a14bc5a37cf2 tempest-VolumesGetTest-1470935452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0cd395f9-e766-4e32-94b1-775454bf3449_tzwrn54udevstack@QuobyteHD /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e0e686dc-5da3-4f58-916a-2485094ad7ec" returned: 0 in 3.132s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:44:48 devstack cinder-volume[86310]: DEBUG cinder.image.image_utils [None req-22867f21-ccd6-4408-b098-a14bc5a37cf2 tempest-VolumesGetTest-1470935452 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0cd395f9-e766-4e32-94b1-775454bf3449_tzwrn54udevstack@QuobyteHD, size 112.00 MB, duration 3.13 sec, destination /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e0e686dc-5da3-4f58-916a-2485094ad7ec {{(pid=86310) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 14:44:48 devstack cinder-volume[86310]: INFO cinder.image.image_utils [None req-22867f21-ccd6-4408-b098-a14bc5a37cf2 tempest-VolumesGetTest-1470935452 None] Converted 112.00 MB image at 35.74 MB/s Sep 23 14:44:48 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-22867f21-ccd6-4408-b098-a14bc5a37cf2 tempest-VolumesGetTest-1470935452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e0e686dc-5da3-4f58-916a-2485094ad7ec 1G {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:44:48 devstack sudo[99677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e0e686dc-5da3-4f58-916a-2485094ad7ec 1G Sep 23 14:44:48 devstack sudo[99677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:44:49 devstack sudo[99677]: pam_unix(sudo:session): session closed for user root Sep 23 14:44:49 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-22867f21-ccd6-4408-b098-a14bc5a37cf2 tempest-VolumesGetTest-1470935452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e0e686dc-5da3-4f58-916a-2485094ad7ec 1G" returned: 0 in 0.407s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:44:49 devstack cinder-volume[86310]: DEBUG cinder.volume.volume_utils [None req-22867f21-ccd6-4408-b098-a14bc5a37cf2 tempest-VolumesGetTest-1470935452 None] Downloaded image 0cd395f9-e766-4e32-94b1-775454bf3449 ((None, [{'url': 'file:///opt/stack/data/glance/images/0cd395f9-e766-4e32-94b1-775454bf3449', 'metadata': {}}])) to volume e0e686dc-5da3-4f58-916a-2485094ad7ec successfully. {{(pid=86310) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 23 14:44:49 devstack cinder-volume[86310]: DEBUG cinder.image.image_utils [None req-22867f21-ccd6-4408-b098-a14bc5a37cf2 tempest-VolumesGetTest-1470935452 None] Temporary image 0cd395f9-e766-4e32-94b1-775454bf3449 for user 31a6159d91a940a48f5b4070277146b2 is deleted. {{(pid=86310) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 23 14:44:49 devstack cinder-volume[86310]: DEBUG cinder.volume.volume_utils [None req-22867f21-ccd6-4408-b098-a14bc5a37cf2 tempest-VolumesGetTest-1470935452 None] Marking volume e0e686dc-5da3-4f58-916a-2485094ad7ec as bootable. {{(pid=86310) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 23 14:44:49 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-22867f21-ccd6-4408-b098-a14bc5a37cf2 tempest-VolumesGetTest-1470935452 None] Copying metadata from image 0cd395f9-e766-4e32-94b1-775454bf3449 to e0e686dc-5da3-4f58-916a-2485094ad7ec. {{(pid=86310) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 23 14:44:49 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-22867f21-ccd6-4408-b098-a14bc5a37cf2 tempest-VolumesGetTest-1470935452 None] Creating volume glance metadata for volume e0e686dc-5da3-4f58-916a-2485094ad7ec backed by image 0cd395f9-e766-4e32-94b1-775454bf3449 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0cd395f9-e766-4e32-94b1-775454bf3449', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86310) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 23 14:44:49 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-22867f21-ccd6-4408-b098-a14bc5a37cf2 tempest-VolumesGetTest-1470935452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d38728b0-23ea-4632-991f-3694449749ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0e686dc-5da3-4f58-916a-2485094ad7ec', 'volume_size': 1, 'image_id': '0cd395f9-e766-4e32-94b1-775454bf3449', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0cd395f9-e766-4e32-94b1-775454bf3449', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7fa20aad952548c880b3288dd7d64dbc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0cd395f9-e766-4e32-94b1-775454bf3449', 'created_at': datetime.datetime(2026, 9, 23, 12, 25, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 23, 12, 25, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0cd395f9-e766-4e32-94b1-775454bf3449/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:44:49 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-22867f21-ccd6-4408-b098-a14bc5a37cf2 tempest-VolumesGetTest-1470935452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c98ae3b-49ae-4f4d-ac5a-2e8f2cd014db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:44:49 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-22867f21-ccd6-4408-b098-a14bc5a37cf2 tempest-VolumesGetTest-1470935452 None] Volume volume-e0e686dc-5da3-4f58-916a-2485094ad7ec (e0e686dc-5da3-4f58-916a-2485094ad7ec): created successfully Sep 23 14:44:49 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-22867f21-ccd6-4408-b098-a14bc5a37cf2 tempest-VolumesGetTest-1470935452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c98ae3b-49ae-4f4d-ac5a-2e8f2cd014db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:44:49 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-22867f21-ccd6-4408-b098-a14bc5a37cf2 tempest-VolumesGetTest-1470935452 None] Flow 'volume_create_manager' (ed33ccbe-5960-4131-a0eb-a2fa2d246131) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:44:49 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-22867f21-ccd6-4408-b098-a14bc5a37cf2 tempest-VolumesGetTest-1470935452 None] Created volume successfully. Sep 23 14:44:50 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-0118b73b-4e61-41d2-b5d9-a8b158de955b tempest-VolumesGetTest-1470935452 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:44:50 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-0118b73b-4e61-41d2-b5d9-a8b158de955b tempest-VolumesGetTest-1470935452 None] Flow 'volume_create_manager' (a0413bea-c543-4d3a-8d87-be063240adcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:44:50 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-0118b73b-4e61-41d2-b5d9-a8b158de955b tempest-VolumesGetTest-1470935452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (604ebc6d-6e26-4ff1-bc88-ba2e5b3379d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:44:50 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-0118b73b-4e61-41d2-b5d9-a8b158de955b tempest-VolumesGetTest-1470935452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (604ebc6d-6e26-4ff1-bc88-ba2e5b3379d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:44:50Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1990409605',display_name='tempest-VolumesGetTest-Volume-1731383396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08b3629a-56d9-478f-9969-2450e5b72324,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00651445389c45f2aa5764549f6a9307',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:44:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:44:50Z,use_quota=True,user_id='31a6159d91a940a48f5b4070277146b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:44:50 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-0118b73b-4e61-41d2-b5d9-a8b158de955b tempest-VolumesGetTest-1470935452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (337111f3-96d6-4cf5-8cf5-c45e67e853cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:44:50 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-0118b73b-4e61-41d2-b5d9-a8b158de955b tempest-VolumesGetTest-1470935452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (337111f3-96d6-4cf5-8cf5-c45e67e853cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:44:50 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-0118b73b-4e61-41d2-b5d9-a8b158de955b tempest-VolumesGetTest-1470935452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89c48008-6e90-4443-afea-b1dae87c58fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:44:50 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-0118b73b-4e61-41d2-b5d9-a8b158de955b tempest-VolumesGetTest-1470935452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89c48008-6e90-4443-afea-b1dae87c58fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08b3629a-56d9-478f-9969-2450e5b72324', 'volume_name': 'volume-08b3629a-56d9-478f-9969-2450e5b72324', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:44:50 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-0118b73b-4e61-41d2-b5d9-a8b158de955b tempest-VolumesGetTest-1470935452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb908518-ccee-4c7a-941c-8e5408c050d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:44:50 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-0118b73b-4e61-41d2-b5d9-a8b158de955b tempest-VolumesGetTest-1470935452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb908518-ccee-4c7a-941c-8e5408c050d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:44:50 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-0118b73b-4e61-41d2-b5d9-a8b158de955b tempest-VolumesGetTest-1470935452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2db65b7-9b3f-478a-9b29-f659d35c2455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:44:50 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-0118b73b-4e61-41d2-b5d9-a8b158de955b tempest-VolumesGetTest-1470935452 None] Volume 08b3629a-56d9-478f-9969-2450e5b72324: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08b3629a-56d9-478f-9969-2450e5b72324', 'volume_size': 1} Sep 23 14:44:50 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-0118b73b-4e61-41d2-b5d9-a8b158de955b tempest-VolumesGetTest-1470935452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:44:50 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-0118b73b-4e61-41d2-b5d9-a8b158de955b tempest-VolumesGetTest-1470935452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:44:50 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-0118b73b-4e61-41d2-b5d9-a8b158de955b tempest-VolumesGetTest-1470935452 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:44:50Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1990409605',display_name='tempest-VolumesGetTest-Volume-1731383396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08b3629a-56d9-478f-9969-2450e5b72324,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00651445389c45f2aa5764549f6a9307',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:44:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:44:50Z,use_quota=True,user_id='31a6159d91a940a48f5b4070277146b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:44:50 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-0118b73b-4e61-41d2-b5d9-a8b158de955b tempest-VolumesGetTest-1470935452 None] Creating volume 08b3629a-56d9-478f-9969-2450e5b72324 {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:44:50 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-0118b73b-4e61-41d2-b5d9-a8b158de955b tempest-VolumesGetTest-1470935452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:44:50 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-0118b73b-4e61-41d2-b5d9-a8b158de955b tempest-VolumesGetTest-1470935452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:44:50 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-0118b73b-4e61-41d2-b5d9-a8b158de955b tempest-VolumesGetTest-1470935452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:44:50 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-0118b73b-4e61-41d2-b5d9-a8b158de955b tempest-VolumesGetTest-1470935452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:44:50 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-0118b73b-4e61-41d2-b5d9-a8b158de955b tempest-VolumesGetTest-1470935452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:44:50 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-0118b73b-4e61-41d2-b5d9-a8b158de955b tempest-VolumesGetTest-1470935452 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:44:50 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-0118b73b-4e61-41d2-b5d9-a8b158de955b tempest-VolumesGetTest-1470935452 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:44:50 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-0118b73b-4e61-41d2-b5d9-a8b158de955b tempest-VolumesGetTest-1470935452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-08b3629a-56d9-478f-9969-2450e5b72324 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:44:50 devstack sudo[99686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-08b3629a-56d9-478f-9969-2450e5b72324 1073741824 Sep 23 14:44:50 devstack sudo[99686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:44:51 devstack sudo[99686]: pam_unix(sudo:session): session closed for user root Sep 23 14:44:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-0118b73b-4e61-41d2-b5d9-a8b158de955b tempest-VolumesGetTest-1470935452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-08b3629a-56d9-478f-9969-2450e5b72324 1073741824" returned: 0 in 0.486s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:44:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-0118b73b-4e61-41d2-b5d9-a8b158de955b tempest-VolumesGetTest-1470935452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-08b3629a-56d9-478f-9969-2450e5b72324 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:44:51 devstack sudo[99692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-08b3629a-56d9-478f-9969-2450e5b72324 Sep 23 14:44:51 devstack sudo[99692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:44:51 devstack sudo[99692]: pam_unix(sudo:session): session closed for user root Sep 23 14:44:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-0118b73b-4e61-41d2-b5d9-a8b158de955b tempest-VolumesGetTest-1470935452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-08b3629a-56d9-478f-9969-2450e5b72324" returned: 0 in 0.252s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:44:51 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-0118b73b-4e61-41d2-b5d9-a8b158de955b tempest-VolumesGetTest-1470935452 None] <== create_volume: return (789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:44:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-0118b73b-4e61-41d2-b5d9-a8b158de955b tempest-VolumesGetTest-1470935452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.793s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:44:51 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-0118b73b-4e61-41d2-b5d9-a8b158de955b tempest-VolumesGetTest-1470935452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2db65b7-9b3f-478a-9b29-f659d35c2455) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08b3629a-56d9-478f-9969-2450e5b72324', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:44:51 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-0118b73b-4e61-41d2-b5d9-a8b158de955b tempest-VolumesGetTest-1470935452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0bdcd0f-0c31-4d08-adfe-e2abc510b945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:44:51 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-0118b73b-4e61-41d2-b5d9-a8b158de955b tempest-VolumesGetTest-1470935452 None] Volume volume-08b3629a-56d9-478f-9969-2450e5b72324 (08b3629a-56d9-478f-9969-2450e5b72324): created successfully Sep 23 14:44:51 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-0118b73b-4e61-41d2-b5d9-a8b158de955b tempest-VolumesGetTest-1470935452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0bdcd0f-0c31-4d08-adfe-e2abc510b945) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:44:51 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-0118b73b-4e61-41d2-b5d9-a8b158de955b tempest-VolumesGetTest-1470935452 None] Flow 'volume_create_manager' (a0413bea-c543-4d3a-8d87-be063240adcc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:44:51 devstack cinder-volume[86310]: DEBUG oslo_service.periodic_task [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86310) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 14:44:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:44:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:44:51 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:44:51 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:44:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:44:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:44:51 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-0118b73b-4e61-41d2-b5d9-a8b158de955b tempest-VolumesGetTest-1470935452 None] Created volume successfully. Sep 23 14:44:51 devstack sudo[99695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:44:51 devstack sudo[99695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:44:51 devstack sudo[99695]: pam_unix(sudo:session): session closed for user root Sep 23 14:44:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.285s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:44:51 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:44:51 devstack cinder-volume[86310]: DEBUG oslo_service.periodic_task [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Running periodic task VolumeManager._thread_info {{(pid=86310) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 14:44:51 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] thread count: 28 {{(pid=86310) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 14:44:51 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] thread info: [<_MainThread(MainThread, started 128854208852096)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86310) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 14:44:52 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-d9da8a9e-74d9-47dc-b3c2-d7b977db13ef tempest-VolumesGetTest-1470935452 None] Acquiring lock "cinder-08b3629a-56d9-478f-9969-2450e5b72324-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:44:52 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-d9da8a9e-74d9-47dc-b3c2-d7b977db13ef tempest-VolumesGetTest-1470935452 None] Lock "cinder-08b3629a-56d9-478f-9969-2450e5b72324-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:44:52 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-d9da8a9e-74d9-47dc-b3c2-d7b977db13ef tempest-VolumesGetTest-1470935452 None] Acquiring lock "cinder-quobyte-08b3629a-56d9-478f-9969-2450e5b72324" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:44:52 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-d9da8a9e-74d9-47dc-b3c2-d7b977db13ef tempest-VolumesGetTest-1470935452 None] Lock "cinder-quobyte-08b3629a-56d9-478f-9969-2450e5b72324" acquired by "delete_volume" :: waited 0.027s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:44:52 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[23b2ab16-f543-46d5-824e-c23072b01808]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:44:52 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d9da8a9e-74d9-47dc-b3c2-d7b977db13ef tempest-VolumesGetTest-1470935452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-08b3629a-56d9-478f-9969-2450e5b72324 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:44:53 devstack sudo[99699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-08b3629a-56d9-478f-9969-2450e5b72324 Sep 23 14:44:53 devstack sudo[99699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:44:53 devstack sudo[99699]: pam_unix(sudo:session): session closed for user root Sep 23 14:44:53 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d9da8a9e-74d9-47dc-b3c2-d7b977db13ef tempest-VolumesGetTest-1470935452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-08b3629a-56d9-478f-9969-2450e5b72324" returned: 0 in 0.447s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:44:53 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d9da8a9e-74d9-47dc-b3c2-d7b977db13ef tempest-VolumesGetTest-1470935452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-08b3629a-56d9-478f-9969-2450e5b72324 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:44:53 devstack sudo[99705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-08b3629a-56d9-478f-9969-2450e5b72324 Sep 23 14:44:53 devstack sudo[99705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:44:53 devstack sudo[99705]: pam_unix(sudo:session): session closed for user root Sep 23 14:44:53 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d9da8a9e-74d9-47dc-b3c2-d7b977db13ef tempest-VolumesGetTest-1470935452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-08b3629a-56d9-478f-9969-2450e5b72324" returned: 0 in 0.298s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:44:53 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-d9da8a9e-74d9-47dc-b3c2-d7b977db13ef tempest-VolumesGetTest-1470935452 None] Lock "cinder-quobyte-08b3629a-56d9-478f-9969-2450e5b72324" released by "delete_volume" :: held 0.809s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:44:53 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-d9da8a9e-74d9-47dc-b3c2-d7b977db13ef tempest-VolumesGetTest-1470935452 None] Created reservations ['d1ed78d0-11bf-4395-9f00-e346d5628a70', '5d1f596d-0522-4fb4-a4c9-78725fd39c00', '8ab64d28-eef4-4756-882e-c8b3e83ebd98', '08bb17a9-963e-450b-97cc-8714945be2e9'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:44:53 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-d9da8a9e-74d9-47dc-b3c2-d7b977db13ef tempest-VolumesGetTest-1470935452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:44:53 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-d9da8a9e-74d9-47dc-b3c2-d7b977db13ef tempest-VolumesGetTest-1470935452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:44:53 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-d9da8a9e-74d9-47dc-b3c2-d7b977db13ef tempest-VolumesGetTest-1470935452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:44:53 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-d9da8a9e-74d9-47dc-b3c2-d7b977db13ef tempest-VolumesGetTest-1470935452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:44:53 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-d9da8a9e-74d9-47dc-b3c2-d7b977db13ef tempest-VolumesGetTest-1470935452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:44:53 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d9da8a9e-74d9-47dc-b3c2-d7b977db13ef tempest-VolumesGetTest-1470935452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:44:53 devstack sudo[99708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:44:53 devstack sudo[99708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:44:54 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-d7f4b7b3-727b-47d2-8edd-4c70f2b4f78a tempest-VolumesGetTest-1470935452 None] Acquiring lock "cinder-e0e686dc-5da3-4f58-916a-2485094ad7ec-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:44:54 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-d7f4b7b3-727b-47d2-8edd-4c70f2b4f78a tempest-VolumesGetTest-1470935452 None] Lock "cinder-e0e686dc-5da3-4f58-916a-2485094ad7ec-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:44:54 devstack sudo[99708]: pam_unix(sudo:session): session closed for user root Sep 23 14:44:54 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d9da8a9e-74d9-47dc-b3c2-d7b977db13ef tempest-VolumesGetTest-1470935452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.481s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:44:54 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-d9da8a9e-74d9-47dc-b3c2-d7b977db13ef tempest-VolumesGetTest-1470935452 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:44:54 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-d9da8a9e-74d9-47dc-b3c2-d7b977db13ef tempest-VolumesGetTest-1470935452 None] Deleted volume successfully. Sep 23 14:44:54 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-d7f4b7b3-727b-47d2-8edd-4c70f2b4f78a tempest-VolumesGetTest-1470935452 None] Acquiring lock "cinder-quobyte-e0e686dc-5da3-4f58-916a-2485094ad7ec" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:44:54 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-d9da8a9e-74d9-47dc-b3c2-d7b977db13ef tempest-VolumesGetTest-1470935452 None] Lock "cinder-08b3629a-56d9-478f-9969-2450e5b72324-delete_volume" released by "delete_volume" :: held 1.564s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:44:54 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-d7f4b7b3-727b-47d2-8edd-4c70f2b4f78a tempest-VolumesGetTest-1470935452 None] Lock "cinder-quobyte-e0e686dc-5da3-4f58-916a-2485094ad7ec" acquired by "delete_volume" :: waited 0.020s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:44:54 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[9240a781-809c-473b-b782-cb83b41f1236]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:44:54 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d7f4b7b3-727b-47d2-8edd-4c70f2b4f78a tempest-VolumesGetTest-1470935452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e0e686dc-5da3-4f58-916a-2485094ad7ec {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:44:54 devstack sudo[99712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e0e686dc-5da3-4f58-916a-2485094ad7ec Sep 23 14:44:54 devstack sudo[99712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:44:54 devstack sudo[99712]: pam_unix(sudo:session): session closed for user root Sep 23 14:44:54 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d7f4b7b3-727b-47d2-8edd-4c70f2b4f78a tempest-VolumesGetTest-1470935452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e0e686dc-5da3-4f58-916a-2485094ad7ec" returned: 0 in 0.411s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:44:54 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d7f4b7b3-727b-47d2-8edd-4c70f2b4f78a tempest-VolumesGetTest-1470935452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e0e686dc-5da3-4f58-916a-2485094ad7ec {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:44:54 devstack sudo[99717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e0e686dc-5da3-4f58-916a-2485094ad7ec Sep 23 14:44:54 devstack sudo[99717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:44:55 devstack sudo[99717]: pam_unix(sudo:session): session closed for user root Sep 23 14:44:55 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d7f4b7b3-727b-47d2-8edd-4c70f2b4f78a tempest-VolumesGetTest-1470935452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e0e686dc-5da3-4f58-916a-2485094ad7ec" returned: 0 in 0.286s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:44:55 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-d7f4b7b3-727b-47d2-8edd-4c70f2b4f78a tempest-VolumesGetTest-1470935452 None] Lock "cinder-quobyte-e0e686dc-5da3-4f58-916a-2485094ad7ec" released by "delete_volume" :: held 0.760s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:44:55 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-d7f4b7b3-727b-47d2-8edd-4c70f2b4f78a tempest-VolumesGetTest-1470935452 None] Created reservations ['cf91968d-c6c3-4bac-a5a2-15ef0e2e88f5', 'b3451dfd-eaef-4aca-b63c-8b766ea416be', '412be8d4-16c8-4a76-ba93-851d475639ca', 'c40169d0-3b4c-48a0-be20-1f4f8c1c6921'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:44:55 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-d7f4b7b3-727b-47d2-8edd-4c70f2b4f78a tempest-VolumesGetTest-1470935452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:44:55 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-d7f4b7b3-727b-47d2-8edd-4c70f2b4f78a tempest-VolumesGetTest-1470935452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:44:55 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-d7f4b7b3-727b-47d2-8edd-4c70f2b4f78a tempest-VolumesGetTest-1470935452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:44:55 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-d7f4b7b3-727b-47d2-8edd-4c70f2b4f78a tempest-VolumesGetTest-1470935452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:44:55 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-d7f4b7b3-727b-47d2-8edd-4c70f2b4f78a tempest-VolumesGetTest-1470935452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:44:55 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d7f4b7b3-727b-47d2-8edd-4c70f2b4f78a tempest-VolumesGetTest-1470935452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:44:55 devstack sudo[99720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:44:55 devstack sudo[99720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:44:55 devstack sudo[99720]: pam_unix(sudo:session): session closed for user root Sep 23 14:44:55 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d7f4b7b3-727b-47d2-8edd-4c70f2b4f78a tempest-VolumesGetTest-1470935452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.316s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:44:55 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-d7f4b7b3-727b-47d2-8edd-4c70f2b4f78a tempest-VolumesGetTest-1470935452 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:44:55 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-d7f4b7b3-727b-47d2-8edd-4c70f2b4f78a tempest-VolumesGetTest-1470935452 None] Deleted volume successfully. Sep 23 14:44:55 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-d7f4b7b3-727b-47d2-8edd-4c70f2b4f78a tempest-VolumesGetTest-1470935452 None] Lock "cinder-e0e686dc-5da3-4f58-916a-2485094ad7ec-delete_volume" released by "delete_volume" :: held 1.413s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:45:04 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-0175d4ae-2641-457c-92d9-f68eac21bd64 tempest-VolumesSnapshotListTestJSON-824608936 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:45:04 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-0175d4ae-2641-457c-92d9-f68eac21bd64 tempest-VolumesSnapshotListTestJSON-824608936 None] Flow 'volume_create_manager' (5dbc4fe9-4e9e-418f-842a-fb82064ec039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:45:04 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-0175d4ae-2641-457c-92d9-f68eac21bd64 tempest-VolumesSnapshotListTestJSON-824608936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca78f47f-63ad-46dd-9329-1f38dbbacd5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:45:04 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-0175d4ae-2641-457c-92d9-f68eac21bd64 tempest-VolumesSnapshotListTestJSON-824608936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca78f47f-63ad-46dd-9329-1f38dbbacd5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:45:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-998432248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbcd2b4b-1d31-405f-883c-8488f4ec3563,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60cc157deebc4050bcced398a7d9089d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:45:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:45:05Z,use_quota=True,user_id='bb21e711d83c4f879493a3ddcf815183',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:45:04 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-0175d4ae-2641-457c-92d9-f68eac21bd64 tempest-VolumesSnapshotListTestJSON-824608936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4988168-5e74-430e-9c27-465f6336d6b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:45:04 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-0175d4ae-2641-457c-92d9-f68eac21bd64 tempest-VolumesSnapshotListTestJSON-824608936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4988168-5e74-430e-9c27-465f6336d6b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:45:04 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-0175d4ae-2641-457c-92d9-f68eac21bd64 tempest-VolumesSnapshotListTestJSON-824608936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64c33b1d-42d4-49d9-ba5f-ad4f2acfc397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:45:04 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-0175d4ae-2641-457c-92d9-f68eac21bd64 tempest-VolumesSnapshotListTestJSON-824608936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64c33b1d-42d4-49d9-ba5f-ad4f2acfc397) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bbcd2b4b-1d31-405f-883c-8488f4ec3563', 'volume_name': 'volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:45:05 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-0175d4ae-2641-457c-92d9-f68eac21bd64 tempest-VolumesSnapshotListTestJSON-824608936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71f9a1ca-6703-4cb4-9a8c-5eefcee02905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:45:05 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-0175d4ae-2641-457c-92d9-f68eac21bd64 tempest-VolumesSnapshotListTestJSON-824608936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71f9a1ca-6703-4cb4-9a8c-5eefcee02905) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:45:05 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-0175d4ae-2641-457c-92d9-f68eac21bd64 tempest-VolumesSnapshotListTestJSON-824608936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40175bbc-62f0-4103-9411-ad45345a4a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:45:05 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-0175d4ae-2641-457c-92d9-f68eac21bd64 tempest-VolumesSnapshotListTestJSON-824608936 None] Volume bbcd2b4b-1d31-405f-883c-8488f4ec3563: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563', 'volume_size': 1} Sep 23 14:45:05 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-0175d4ae-2641-457c-92d9-f68eac21bd64 tempest-VolumesSnapshotListTestJSON-824608936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:45:05 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-0175d4ae-2641-457c-92d9-f68eac21bd64 tempest-VolumesSnapshotListTestJSON-824608936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:45:05 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-0175d4ae-2641-457c-92d9-f68eac21bd64 tempest-VolumesSnapshotListTestJSON-824608936 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:45:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-998432248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbcd2b4b-1d31-405f-883c-8488f4ec3563,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60cc157deebc4050bcced398a7d9089d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:45:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:45:05Z,use_quota=True,user_id='bb21e711d83c4f879493a3ddcf815183',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:45:05 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-0175d4ae-2641-457c-92d9-f68eac21bd64 tempest-VolumesSnapshotListTestJSON-824608936 None] Creating volume bbcd2b4b-1d31-405f-883c-8488f4ec3563 {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:45:05 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-0175d4ae-2641-457c-92d9-f68eac21bd64 tempest-VolumesSnapshotListTestJSON-824608936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:45:05 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-0175d4ae-2641-457c-92d9-f68eac21bd64 tempest-VolumesSnapshotListTestJSON-824608936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:45:05 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-0175d4ae-2641-457c-92d9-f68eac21bd64 tempest-VolumesSnapshotListTestJSON-824608936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:45:05 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-0175d4ae-2641-457c-92d9-f68eac21bd64 tempest-VolumesSnapshotListTestJSON-824608936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:45:05 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-0175d4ae-2641-457c-92d9-f68eac21bd64 tempest-VolumesSnapshotListTestJSON-824608936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:45:05 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-0175d4ae-2641-457c-92d9-f68eac21bd64 tempest-VolumesSnapshotListTestJSON-824608936 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:45:05 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-0175d4ae-2641-457c-92d9-f68eac21bd64 tempest-VolumesSnapshotListTestJSON-824608936 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:45:05 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-0175d4ae-2641-457c-92d9-f68eac21bd64 tempest-VolumesSnapshotListTestJSON-824608936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:45:05 devstack sudo[99798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563 1073741824 Sep 23 14:45:05 devstack sudo[99798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:45:05 devstack sudo[99798]: pam_unix(sudo:session): session closed for user root Sep 23 14:45:05 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-0175d4ae-2641-457c-92d9-f68eac21bd64 tempest-VolumesSnapshotListTestJSON-824608936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563 1073741824" returned: 0 in 0.696s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:45:05 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-0175d4ae-2641-457c-92d9-f68eac21bd64 tempest-VolumesSnapshotListTestJSON-824608936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:45:05 devstack sudo[99805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563 Sep 23 14:45:05 devstack sudo[99805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:45:06 devstack sudo[99805]: pam_unix(sudo:session): session closed for user root Sep 23 14:45:06 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-0175d4ae-2641-457c-92d9-f68eac21bd64 tempest-VolumesSnapshotListTestJSON-824608936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563" returned: 0 in 0.355s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:45:06 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-0175d4ae-2641-457c-92d9-f68eac21bd64 tempest-VolumesSnapshotListTestJSON-824608936 None] <== create_volume: return (1138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:45:06 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-0175d4ae-2641-457c-92d9-f68eac21bd64 tempest-VolumesSnapshotListTestJSON-824608936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.141s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:45:06 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-0175d4ae-2641-457c-92d9-f68eac21bd64 tempest-VolumesSnapshotListTestJSON-824608936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40175bbc-62f0-4103-9411-ad45345a4a7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:45:06 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-0175d4ae-2641-457c-92d9-f68eac21bd64 tempest-VolumesSnapshotListTestJSON-824608936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fd6dc74-cf75-4c35-90f6-fd9a9ec5bb1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:45:06 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-0175d4ae-2641-457c-92d9-f68eac21bd64 tempest-VolumesSnapshotListTestJSON-824608936 None] Volume volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563 (bbcd2b4b-1d31-405f-883c-8488f4ec3563): created successfully Sep 23 14:45:06 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-0175d4ae-2641-457c-92d9-f68eac21bd64 tempest-VolumesSnapshotListTestJSON-824608936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fd6dc74-cf75-4c35-90f6-fd9a9ec5bb1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:45:06 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-0175d4ae-2641-457c-92d9-f68eac21bd64 tempest-VolumesSnapshotListTestJSON-824608936 None] Flow 'volume_create_manager' (5dbc4fe9-4e9e-418f-842a-fb82064ec039) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:45:06 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-0175d4ae-2641-457c-92d9-f68eac21bd64 tempest-VolumesSnapshotListTestJSON-824608936 None] Created volume successfully. Sep 23 14:45:07 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-89c5ec30-c286-42a4-84eb-e76edd261f50 tempest-VolumesSnapshotListTestJSON-824608936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:45:07 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-89c5ec30-c286-42a4-84eb-e76edd261f50 tempest-VolumesSnapshotListTestJSON-824608936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:45:07 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-89c5ec30-c286-42a4-84eb-e76edd261f50 tempest-VolumesSnapshotListTestJSON-824608936 None] Creating offline snapshot 4739aa02-2a83-443d-8539-2fed83d51e26 of volume bbcd2b4b-1d31-405f-883c-8488f4ec3563 {{(pid=86310) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 14:45:07 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[c76532f8-e3a4-4905-add1-b7c324fe3f89]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:45:07 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-89c5ec30-c286-42a4-84eb-e76edd261f50 tempest-VolumesSnapshotListTestJSON-824608936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:45:07 devstack sudo[99809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563 Sep 23 14:45:07 devstack sudo[99809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:45:07 devstack sudo[99809]: pam_unix(sudo:session): session closed for user root Sep 23 14:45:07 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-89c5ec30-c286-42a4-84eb-e76edd261f50 tempest-VolumesSnapshotListTestJSON-824608936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563" returned: 0 in 0.591s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:45:07 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-89c5ec30-c286-42a4-84eb-e76edd261f50 tempest-VolumesSnapshotListTestJSON-824608936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563.4739aa02-2a83-443d-8539-2fed83d51e26 1G {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:45:07 devstack sudo[99814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563.4739aa02-2a83-443d-8539-2fed83d51e26 1G Sep 23 14:45:07 devstack sudo[99814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:45:08 devstack sudo[99814]: pam_unix(sudo:session): session closed for user root Sep 23 14:45:08 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-89c5ec30-c286-42a4-84eb-e76edd261f50 tempest-VolumesSnapshotListTestJSON-824608936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563.4739aa02-2a83-443d-8539-2fed83d51e26 1G" returned: 0 in 0.614s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:45:08 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-89c5ec30-c286-42a4-84eb-e76edd261f50 tempest-VolumesSnapshotListTestJSON-824608936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563 -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563.4739aa02-2a83-443d-8539-2fed83d51e26 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:45:08 devstack sudo[99821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563 -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563.4739aa02-2a83-443d-8539-2fed83d51e26 Sep 23 14:45:08 devstack sudo[99821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:45:09 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d62d64a-e262-43c5-a171-fb6604b11b87 tempest-TestInstancesWithCinderVolumes-584005076 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:45:09 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-9d62d64a-e262-43c5-a171-fb6604b11b87 tempest-TestInstancesWithCinderVolumes-584005076 None] Flow 'volume_create_manager' (d0088c1d-d771-4169-86db-66d25ccb981a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:45:09 devstack sudo[99821]: pam_unix(sudo:session): session closed for user root Sep 23 14:45:09 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-9d62d64a-e262-43c5-a171-fb6604b11b87 tempest-TestInstancesWithCinderVolumes-584005076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f37e1f20-c41e-44db-ae2d-0590cc222035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:45:09 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-89c5ec30-c286-42a4-84eb-e76edd261f50 tempest-VolumesSnapshotListTestJSON-824608936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563 -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563.4739aa02-2a83-443d-8539-2fed83d51e26" returned: 0 in 0.672s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:45:09 devstack cinder-volume[86310]: WARNING cinder.volume.drivers.remotefs [None req-89c5ec30-c286-42a4-84eb-e76edd261f50 tempest-VolumesSnapshotListTestJSON-824608936 None] /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563.4739aa02-2a83-443d-8539-2fed83d51e26 is being set with open permissions: ugo+rw Sep 23 14:45:09 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-89c5ec30-c286-42a4-84eb-e76edd261f50 tempest-VolumesSnapshotListTestJSON-824608936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563.4739aa02-2a83-443d-8539-2fed83d51e26 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:45:09 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-9d62d64a-e262-43c5-a171-fb6604b11b87 tempest-TestInstancesWithCinderVolumes-584005076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f37e1f20-c41e-44db-ae2d-0590cc222035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:45:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1980461044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a36fcb4-8339-49f1-8cbc-ae270f617ddf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2af96813b5e94a57b353ae4dd2bacfe0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:45:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:45:09Z,use_quota=True,user_id='f7186e9930a44e2fa9d4e9b8fcf4d990',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13a83a90-a323-440e-87f9-c9468622f90a),volume_type_id=13a83a90-a323-440e-87f9-c9468622f90a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:45:09 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-9d62d64a-e262-43c5-a171-fb6604b11b87 tempest-TestInstancesWithCinderVolumes-584005076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f15aef0-5c79-4566-b590-ca4a2392d2bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:45:09 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-9d62d64a-e262-43c5-a171-fb6604b11b87 tempest-TestInstancesWithCinderVolumes-584005076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f15aef0-5c79-4566-b590-ca4a2392d2bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:45:09 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-9d62d64a-e262-43c5-a171-fb6604b11b87 tempest-TestInstancesWithCinderVolumes-584005076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (748e3c0c-962c-481d-8da6-83aaa98f2421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:45:09 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-9d62d64a-e262-43c5-a171-fb6604b11b87 tempest-TestInstancesWithCinderVolumes-584005076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (748e3c0c-962c-481d-8da6-83aaa98f2421) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a36fcb4-8339-49f1-8cbc-ae270f617ddf', 'volume_name': 'volume-9a36fcb4-8339-49f1-8cbc-ae270f617ddf', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:45:09 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-9d62d64a-e262-43c5-a171-fb6604b11b87 tempest-TestInstancesWithCinderVolumes-584005076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6968614-45d5-428b-936b-cdb1dc9a6ddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:45:09 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-9d62d64a-e262-43c5-a171-fb6604b11b87 tempest-TestInstancesWithCinderVolumes-584005076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6968614-45d5-428b-936b-cdb1dc9a6ddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:45:09 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-9d62d64a-e262-43c5-a171-fb6604b11b87 tempest-TestInstancesWithCinderVolumes-584005076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f980833a-48e1-4b9e-b518-efa6d2539378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:45:09 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-9d62d64a-e262-43c5-a171-fb6604b11b87 tempest-TestInstancesWithCinderVolumes-584005076 None] Volume 9a36fcb4-8339-49f1-8cbc-ae270f617ddf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a36fcb4-8339-49f1-8cbc-ae270f617ddf', 'volume_size': 1} Sep 23 14:45:09 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-9d62d64a-e262-43c5-a171-fb6604b11b87 tempest-TestInstancesWithCinderVolumes-584005076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:45:09 devstack sudo[99826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563.4739aa02-2a83-443d-8539-2fed83d51e26 Sep 23 14:45:09 devstack sudo[99826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:45:09 devstack sudo[99826]: pam_unix(sudo:session): session closed for user root Sep 23 14:45:09 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9c8b3ca-3ffc-43f2-a14b-7336e58cc766 tempest-TestInstancesWithCinderVolumes-584005076 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:45:09 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-a9c8b3ca-3ffc-43f2-a14b-7336e58cc766 tempest-TestInstancesWithCinderVolumes-584005076 None] Flow 'volume_create_manager' (366beeef-73ad-4450-b7c9-b02d4436a48c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:45:09 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-a9c8b3ca-3ffc-43f2-a14b-7336e58cc766 tempest-TestInstancesWithCinderVolumes-584005076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac6801f8-81ec-4667-96e2-d3a83e2e0073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:45:09 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-89c5ec30-c286-42a4-84eb-e76edd261f50 tempest-VolumesSnapshotListTestJSON-824608936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563.4739aa02-2a83-443d-8539-2fed83d51e26" returned: 0 in 0.483s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:45:09 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-a9c8b3ca-3ffc-43f2-a14b-7336e58cc766 tempest-TestInstancesWithCinderVolumes-584005076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac6801f8-81ec-4667-96e2-d3a83e2e0073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:45:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-191372202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=114fc2d4-faab-401b-818b-46d764af0586,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2af96813b5e94a57b353ae4dd2bacfe0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:45:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:45:10Z,use_quota=True,user_id='f7186e9930a44e2fa9d4e9b8fcf4d990',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8653b524-1fe4-4231-ae4f-a7f055241362),volume_type_id=8653b524-1fe4-4231-ae4f-a7f055241362)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:45:09 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-a9c8b3ca-3ffc-43f2-a14b-7336e58cc766 tempest-TestInstancesWithCinderVolumes-584005076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (139eaa6a-8167-41fe-8220-f2580d15566c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:45:09 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-a9c8b3ca-3ffc-43f2-a14b-7336e58cc766 tempest-TestInstancesWithCinderVolumes-584005076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (139eaa6a-8167-41fe-8220-f2580d15566c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:45:09 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-a9c8b3ca-3ffc-43f2-a14b-7336e58cc766 tempest-TestInstancesWithCinderVolumes-584005076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f40650a2-ab1e-47ee-8f72-87e47a6334ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:45:09 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-a9c8b3ca-3ffc-43f2-a14b-7336e58cc766 tempest-TestInstancesWithCinderVolumes-584005076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f40650a2-ab1e-47ee-8f72-87e47a6334ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '114fc2d4-faab-401b-818b-46d764af0586', 'volume_name': 'volume-114fc2d4-faab-401b-818b-46d764af0586', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:45:09 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-a9c8b3ca-3ffc-43f2-a14b-7336e58cc766 tempest-TestInstancesWithCinderVolumes-584005076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30a802bc-1828-4474-a024-20a5b81d551a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:45:09 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-a9c8b3ca-3ffc-43f2-a14b-7336e58cc766 tempest-TestInstancesWithCinderVolumes-584005076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30a802bc-1828-4474-a024-20a5b81d551a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:45:09 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-a9c8b3ca-3ffc-43f2-a14b-7336e58cc766 tempest-TestInstancesWithCinderVolumes-584005076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ddda75b-a482-4582-ade9-a77522ca1f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:45:09 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-a9c8b3ca-3ffc-43f2-a14b-7336e58cc766 tempest-TestInstancesWithCinderVolumes-584005076 None] Volume 114fc2d4-faab-401b-818b-46d764af0586: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-114fc2d4-faab-401b-818b-46d764af0586', 'volume_size': 1} Sep 23 14:45:09 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-a9c8b3ca-3ffc-43f2-a14b-7336e58cc766 tempest-TestInstancesWithCinderVolumes-584005076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:45:09 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-89c5ec30-c286-42a4-84eb-e76edd261f50 tempest-VolumesSnapshotListTestJSON-824608936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563.info {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:45:09 devstack sudo[99829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563.info Sep 23 14:45:09 devstack sudo[99829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:45:10 devstack sudo[99829]: pam_unix(sudo:session): session closed for user root Sep 23 14:45:10 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-89c5ec30-c286-42a4-84eb-e76edd261f50 tempest-VolumesSnapshotListTestJSON-824608936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563.info" returned: 0 in 0.427s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:45:10 devstack cinder-volume[86310]: WARNING cinder.volume.drivers.remotefs [None req-89c5ec30-c286-42a4-84eb-e76edd261f50 tempest-VolumesSnapshotListTestJSON-824608936 None] /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563.info is being set with open permissions: ugo+rw Sep 23 14:45:10 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-89c5ec30-c286-42a4-84eb-e76edd261f50 tempest-VolumesSnapshotListTestJSON-824608936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563.info {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:45:10 devstack sudo[99832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563.info Sep 23 14:45:10 devstack sudo[99832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:45:10 devstack sudo[99832]: pam_unix(sudo:session): session closed for user root Sep 23 14:45:10 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-89c5ec30-c286-42a4-84eb-e76edd261f50 tempest-VolumesSnapshotListTestJSON-824608936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563.info" returned: 0 in 0.338s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:45:10 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-89c5ec30-c286-42a4-84eb-e76edd261f50 tempest-VolumesSnapshotListTestJSON-824608936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.352s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:45:10 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-9d62d64a-e262-43c5-a171-fb6604b11b87 tempest-TestInstancesWithCinderVolumes-584005076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.321s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:45:10 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-9d62d64a-e262-43c5-a171-fb6604b11b87 tempest-TestInstancesWithCinderVolumes-584005076 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:45:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1980461044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a36fcb4-8339-49f1-8cbc-ae270f617ddf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2af96813b5e94a57b353ae4dd2bacfe0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:45:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:45:09Z,use_quota=True,user_id='f7186e9930a44e2fa9d4e9b8fcf4d990',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13a83a90-a323-440e-87f9-c9468622f90a),volume_type_id=13a83a90-a323-440e-87f9-c9468622f90a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:45:10 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-9d62d64a-e262-43c5-a171-fb6604b11b87 tempest-TestInstancesWithCinderVolumes-584005076 None] Creating volume 9a36fcb4-8339-49f1-8cbc-ae270f617ddf {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:45:10 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-9d62d64a-e262-43c5-a171-fb6604b11b87 tempest-TestInstancesWithCinderVolumes-584005076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:45:10 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-9d62d64a-e262-43c5-a171-fb6604b11b87 tempest-TestInstancesWithCinderVolumes-584005076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:45:10 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-9d62d64a-e262-43c5-a171-fb6604b11b87 tempest-TestInstancesWithCinderVolumes-584005076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:45:10 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-9d62d64a-e262-43c5-a171-fb6604b11b87 tempest-TestInstancesWithCinderVolumes-584005076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:45:10 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-9d62d64a-e262-43c5-a171-fb6604b11b87 tempest-TestInstancesWithCinderVolumes-584005076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:45:10 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-9d62d64a-e262-43c5-a171-fb6604b11b87 tempest-TestInstancesWithCinderVolumes-584005076 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:45:10 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-9d62d64a-e262-43c5-a171-fb6604b11b87 tempest-TestInstancesWithCinderVolumes-584005076 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:45:10 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-9d62d64a-e262-43c5-a171-fb6604b11b87 tempest-TestInstancesWithCinderVolumes-584005076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-9a36fcb4-8339-49f1-8cbc-ae270f617ddf 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:45:10 devstack sudo[99835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-9a36fcb4-8339-49f1-8cbc-ae270f617ddf 1073741824 Sep 23 14:45:10 devstack sudo[99835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:45:10 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-89c5ec30-c286-42a4-84eb-e76edd261f50 tempest-VolumesSnapshotListTestJSON-824608936 None] Create snapshot completed successfully Sep 23 14:45:11 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-03a364f0-dacf-4a6a-9014-a258ac63c3a9 tempest-TestInstancesWithCinderVolumes-584005076 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:45:11 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-03a364f0-dacf-4a6a-9014-a258ac63c3a9 tempest-TestInstancesWithCinderVolumes-584005076 None] Flow 'volume_create_manager' (c2eee6b6-6693-4649-8a21-b5b8ce44feb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:45:11 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-03a364f0-dacf-4a6a-9014-a258ac63c3a9 tempest-TestInstancesWithCinderVolumes-584005076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83ee719b-1ee7-4d3b-a30f-6e7fd2bd5823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:45:11 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-03a364f0-dacf-4a6a-9014-a258ac63c3a9 tempest-TestInstancesWithCinderVolumes-584005076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83ee719b-1ee7-4d3b-a30f-6e7fd2bd5823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:45:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-875942443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7229c51-b135-4bf7-b03a-c85b483bbab5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2af96813b5e94a57b353ae4dd2bacfe0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:45:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:45:11Z,use_quota=True,user_id='f7186e9930a44e2fa9d4e9b8fcf4d990',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(133ec01a-6f23-48a8-a2d7-029c2586453b),volume_type_id=133ec01a-6f23-48a8-a2d7-029c2586453b)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:45:11 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-03a364f0-dacf-4a6a-9014-a258ac63c3a9 tempest-TestInstancesWithCinderVolumes-584005076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a13d515-cedf-452d-9797-397dd3576e81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:45:11 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-03a364f0-dacf-4a6a-9014-a258ac63c3a9 tempest-TestInstancesWithCinderVolumes-584005076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a13d515-cedf-452d-9797-397dd3576e81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:45:11 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-03a364f0-dacf-4a6a-9014-a258ac63c3a9 tempest-TestInstancesWithCinderVolumes-584005076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (645cdb7e-4a55-41f1-b812-5055bea74436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:45:11 devstack cinder-volume[86310]: DEBUG cinder.image.glance [None req-03a364f0-dacf-4a6a-9014-a258ac63c3a9 tempest-TestInstancesWithCinderVolumes-584005076 None] Creating Keystone auth plugin from conf {{(pid=86310) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 23 14:45:11 devstack sudo[99835]: pam_unix(sudo:session): session closed for user root Sep 23 14:45:11 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-9d62d64a-e262-43c5-a171-fb6604b11b87 tempest-TestInstancesWithCinderVolumes-584005076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-9a36fcb4-8339-49f1-8cbc-ae270f617ddf 1073741824" returned: 0 in 0.686s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:45:11 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-9d62d64a-e262-43c5-a171-fb6604b11b87 tempest-TestInstancesWithCinderVolumes-584005076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-9a36fcb4-8339-49f1-8cbc-ae270f617ddf {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:45:11 devstack sudo[99842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-9a36fcb4-8339-49f1-8cbc-ae270f617ddf Sep 23 14:45:11 devstack sudo[99842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:45:11 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-03a364f0-dacf-4a6a-9014-a258ac63c3a9 tempest-TestInstancesWithCinderVolumes-584005076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (645cdb7e-4a55-41f1-b812-5055bea74436) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b7229c51-b135-4bf7-b03a-c85b483bbab5', 'volume_name': 'volume-b7229c51-b135-4bf7-b03a-c85b483bbab5', 'volume_size': 1, 'image_id': 'eaed620a-2e6e-4338-80ac-22a3e46f2f90', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eaed620a-2e6e-4338-80ac-22a3e46f2f90', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--905226345', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2af96813b5e94a57b353ae4dd2bacfe0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'eaed620a-2e6e-4338-80ac-22a3e46f2f90', 'created_at': datetime.datetime(2026, 9, 23, 12, 45, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 23, 12, 45, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eaed620a-2e6e-4338-80ac-22a3e46f2f90/file', 'properties': {}}, 'image_service': }' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:45:11 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-03a364f0-dacf-4a6a-9014-a258ac63c3a9 tempest-TestInstancesWithCinderVolumes-584005076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23ce9f96-7d62-4f5c-951f-727c013571e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:45:11 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-03a364f0-dacf-4a6a-9014-a258ac63c3a9 tempest-TestInstancesWithCinderVolumes-584005076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23ce9f96-7d62-4f5c-951f-727c013571e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:45:11 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-03a364f0-dacf-4a6a-9014-a258ac63c3a9 tempest-TestInstancesWithCinderVolumes-584005076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d71523c-99f8-4abf-b88a-f488de80cab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:45:11 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-03a364f0-dacf-4a6a-9014-a258ac63c3a9 tempest-TestInstancesWithCinderVolumes-584005076 None] Volume b7229c51-b135-4bf7-b03a-c85b483bbab5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b7229c51-b135-4bf7-b03a-c85b483bbab5', 'volume_size': 1, 'image_id': 'eaed620a-2e6e-4338-80ac-22a3e46f2f90', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eaed620a-2e6e-4338-80ac-22a3e46f2f90', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--905226345', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2af96813b5e94a57b353ae4dd2bacfe0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'eaed620a-2e6e-4338-80ac-22a3e46f2f90', 'created_at': datetime.datetime(2026, 9, 23, 12, 45, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 23, 12, 45, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eaed620a-2e6e-4338-80ac-22a3e46f2f90/file', 'properties': {}}, 'image_service': } Sep 23 14:45:11 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-03a364f0-dacf-4a6a-9014-a258ac63c3a9 tempest-TestInstancesWithCinderVolumes-584005076 None] Trying to clone b7229c51-b135-4bf7-b03a-c85b483bbab5 from image eaed620a-2e6e-4338-80ac-22a3e46f2f90 at location (None, [{'url': 'file:///opt/stack/data/glance/images/eaed620a-2e6e-4338-80ac-22a3e46f2f90', 'metadata': {}}]). {{(pid=86310) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 23 14:45:11 devstack sudo[99842]: pam_unix(sudo:session): session closed for user root Sep 23 14:45:11 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-9d62d64a-e262-43c5-a171-fb6604b11b87 tempest-TestInstancesWithCinderVolumes-584005076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-9a36fcb4-8339-49f1-8cbc-ae270f617ddf" returned: 0 in 0.468s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:45:11 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-9d62d64a-e262-43c5-a171-fb6604b11b87 tempest-TestInstancesWithCinderVolumes-584005076 None] <== create_volume: return (1240ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:45:11 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-9d62d64a-e262-43c5-a171-fb6604b11b87 tempest-TestInstancesWithCinderVolumes-584005076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.247s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:45:11 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-a9c8b3ca-3ffc-43f2-a14b-7336e58cc766 tempest-TestInstancesWithCinderVolumes-584005076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.097s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:45:11 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-a9c8b3ca-3ffc-43f2-a14b-7336e58cc766 tempest-TestInstancesWithCinderVolumes-584005076 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:45:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-191372202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=114fc2d4-faab-401b-818b-46d764af0586,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2af96813b5e94a57b353ae4dd2bacfe0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:45:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:45:10Z,use_quota=True,user_id='f7186e9930a44e2fa9d4e9b8fcf4d990',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8653b524-1fe4-4231-ae4f-a7f055241362),volume_type_id=8653b524-1fe4-4231-ae4f-a7f055241362)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:45:11 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-a9c8b3ca-3ffc-43f2-a14b-7336e58cc766 tempest-TestInstancesWithCinderVolumes-584005076 None] Creating volume 114fc2d4-faab-401b-818b-46d764af0586 {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:45:11 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-a9c8b3ca-3ffc-43f2-a14b-7336e58cc766 tempest-TestInstancesWithCinderVolumes-584005076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:45:11 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-a9c8b3ca-3ffc-43f2-a14b-7336e58cc766 tempest-TestInstancesWithCinderVolumes-584005076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:45:11 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-a9c8b3ca-3ffc-43f2-a14b-7336e58cc766 tempest-TestInstancesWithCinderVolumes-584005076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:45:11 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-a9c8b3ca-3ffc-43f2-a14b-7336e58cc766 tempest-TestInstancesWithCinderVolumes-584005076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:45:11 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-a9c8b3ca-3ffc-43f2-a14b-7336e58cc766 tempest-TestInstancesWithCinderVolumes-584005076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:45:11 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-a9c8b3ca-3ffc-43f2-a14b-7336e58cc766 tempest-TestInstancesWithCinderVolumes-584005076 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:45:11 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-a9c8b3ca-3ffc-43f2-a14b-7336e58cc766 tempest-TestInstancesWithCinderVolumes-584005076 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:45:11 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a9c8b3ca-3ffc-43f2-a14b-7336e58cc766 tempest-TestInstancesWithCinderVolumes-584005076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-114fc2d4-faab-401b-818b-46d764af0586 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:45:11 devstack sudo[99846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-114fc2d4-faab-401b-818b-46d764af0586 1073741824 Sep 23 14:45:11 devstack sudo[99846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:45:11 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-9d62d64a-e262-43c5-a171-fb6604b11b87 tempest-TestInstancesWithCinderVolumes-584005076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f980833a-48e1-4b9e-b518-efa6d2539378) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a36fcb4-8339-49f1-8cbc-ae270f617ddf', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:45:11 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-9d62d64a-e262-43c5-a171-fb6604b11b87 tempest-TestInstancesWithCinderVolumes-584005076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d31261c-f293-488c-a7a2-b5c6758b0d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:45:12 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-7edc4ab0-8767-44ff-8fa3-640e0c8144f0 tempest-VolumesSnapshotListTestJSON-824608936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:45:12 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-9d62d64a-e262-43c5-a171-fb6604b11b87 tempest-TestInstancesWithCinderVolumes-584005076 None] Volume volume-9a36fcb4-8339-49f1-8cbc-ae270f617ddf (9a36fcb4-8339-49f1-8cbc-ae270f617ddf): created successfully Sep 23 14:45:12 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-9d62d64a-e262-43c5-a171-fb6604b11b87 tempest-TestInstancesWithCinderVolumes-584005076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d31261c-f293-488c-a7a2-b5c6758b0d13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:45:12 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-9d62d64a-e262-43c5-a171-fb6604b11b87 tempest-TestInstancesWithCinderVolumes-584005076 None] Flow 'volume_create_manager' (d0088c1d-d771-4169-86db-66d25ccb981a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:45:12 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-9d62d64a-e262-43c5-a171-fb6604b11b87 tempest-TestInstancesWithCinderVolumes-584005076 None] Created volume successfully. Sep 23 14:45:12 devstack sudo[99846]: pam_unix(sudo:session): session closed for user root Sep 23 14:45:12 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a9c8b3ca-3ffc-43f2-a14b-7336e58cc766 tempest-TestInstancesWithCinderVolumes-584005076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-114fc2d4-faab-401b-818b-46d764af0586 1073741824" returned: 0 in 0.667s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:45:12 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a9c8b3ca-3ffc-43f2-a14b-7336e58cc766 tempest-TestInstancesWithCinderVolumes-584005076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-114fc2d4-faab-401b-818b-46d764af0586 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:45:12 devstack sudo[99852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-114fc2d4-faab-401b-818b-46d764af0586 Sep 23 14:45:12 devstack sudo[99852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:45:12 devstack sudo[99852]: pam_unix(sudo:session): session closed for user root Sep 23 14:45:12 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a9c8b3ca-3ffc-43f2-a14b-7336e58cc766 tempest-TestInstancesWithCinderVolumes-584005076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-114fc2d4-faab-401b-818b-46d764af0586" returned: 0 in 0.373s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:45:12 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-a9c8b3ca-3ffc-43f2-a14b-7336e58cc766 tempest-TestInstancesWithCinderVolumes-584005076 None] <== create_volume: return (1122ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:45:12 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-a9c8b3ca-3ffc-43f2-a14b-7336e58cc766 tempest-TestInstancesWithCinderVolumes-584005076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.124s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:45:12 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-7edc4ab0-8767-44ff-8fa3-640e0c8144f0 tempest-VolumesSnapshotListTestJSON-824608936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.980s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:45:13 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-a9c8b3ca-3ffc-43f2-a14b-7336e58cc766 tempest-TestInstancesWithCinderVolumes-584005076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ddda75b-a482-4582-ade9-a77522ca1f42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-114fc2d4-faab-401b-818b-46d764af0586', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:45:13 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-a9c8b3ca-3ffc-43f2-a14b-7336e58cc766 tempest-TestInstancesWithCinderVolumes-584005076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9504690f-c5bc-4622-b439-592bf95fcfb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:45:13 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-7edc4ab0-8767-44ff-8fa3-640e0c8144f0 tempest-VolumesSnapshotListTestJSON-824608936 None] Creating offline snapshot 4052f265-5c0e-428f-a139-ad9fd6d85f35 of volume bbcd2b4b-1d31-405f-883c-8488f4ec3563 {{(pid=86310) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 14:45:13 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-a9c8b3ca-3ffc-43f2-a14b-7336e58cc766 tempest-TestInstancesWithCinderVolumes-584005076 None] Volume volume-114fc2d4-faab-401b-818b-46d764af0586 (114fc2d4-faab-401b-818b-46d764af0586): created successfully Sep 23 14:45:13 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-a9c8b3ca-3ffc-43f2-a14b-7336e58cc766 tempest-TestInstancesWithCinderVolumes-584005076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9504690f-c5bc-4622-b439-592bf95fcfb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:45:13 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-a9c8b3ca-3ffc-43f2-a14b-7336e58cc766 tempest-TestInstancesWithCinderVolumes-584005076 None] Flow 'volume_create_manager' (366beeef-73ad-4450-b7c9-b02d4436a48c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:45:13 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[f31ca5cc-3302-47bc-8216-1b26ee3d1662]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:45:13 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-7edc4ab0-8767-44ff-8fa3-640e0c8144f0 tempest-VolumesSnapshotListTestJSON-824608936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563.4739aa02-2a83-443d-8539-2fed83d51e26 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:45:13 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-a9c8b3ca-3ffc-43f2-a14b-7336e58cc766 tempest-TestInstancesWithCinderVolumes-584005076 None] Created volume successfully. Sep 23 14:45:13 devstack sudo[99855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563.4739aa02-2a83-443d-8539-2fed83d51e26 Sep 23 14:45:13 devstack sudo[99855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:45:13 devstack sudo[99855]: pam_unix(sudo:session): session closed for user root Sep 23 14:45:13 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-7edc4ab0-8767-44ff-8fa3-640e0c8144f0 tempest-VolumesSnapshotListTestJSON-824608936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563.4739aa02-2a83-443d-8539-2fed83d51e26" returned: 0 in 0.515s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:45:13 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-7edc4ab0-8767-44ff-8fa3-640e0c8144f0 tempest-VolumesSnapshotListTestJSON-824608936 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 14:45:13 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-7edc4ab0-8767-44ff-8fa3-640e0c8144f0 tempest-VolumesSnapshotListTestJSON-824608936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563.4739aa02-2a83-443d-8539-2fed83d51e26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563.4052f265-5c0e-428f-a139-ad9fd6d85f35 1G {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:45:13 devstack sudo[99860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563.4739aa02-2a83-443d-8539-2fed83d51e26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563.4052f265-5c0e-428f-a139-ad9fd6d85f35 1G Sep 23 14:45:13 devstack sudo[99860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:45:14 devstack sudo[99860]: pam_unix(sudo:session): session closed for user root Sep 23 14:45:14 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-7edc4ab0-8767-44ff-8fa3-640e0c8144f0 tempest-VolumesSnapshotListTestJSON-824608936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563.4739aa02-2a83-443d-8539-2fed83d51e26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563.4052f265-5c0e-428f-a139-ad9fd6d85f35 1G" returned: 0 in 0.767s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:45:14 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-7edc4ab0-8767-44ff-8fa3-640e0c8144f0 tempest-VolumesSnapshotListTestJSON-824608936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563.4739aa02-2a83-443d-8539-2fed83d51e26 -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563.4052f265-5c0e-428f-a139-ad9fd6d85f35 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:45:14 devstack sudo[99881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563.4739aa02-2a83-443d-8539-2fed83d51e26 -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563.4052f265-5c0e-428f-a139-ad9fd6d85f35 Sep 23 14:45:14 devstack sudo[99881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:45:14 devstack sudo[99881]: pam_unix(sudo:session): session closed for user root Sep 23 14:45:14 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-7edc4ab0-8767-44ff-8fa3-640e0c8144f0 tempest-VolumesSnapshotListTestJSON-824608936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563.4739aa02-2a83-443d-8539-2fed83d51e26 -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563.4052f265-5c0e-428f-a139-ad9fd6d85f35" returned: 0 in 0.320s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:45:14 devstack cinder-volume[86310]: WARNING cinder.volume.drivers.remotefs [None req-7edc4ab0-8767-44ff-8fa3-640e0c8144f0 tempest-VolumesSnapshotListTestJSON-824608936 None] /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563.4052f265-5c0e-428f-a139-ad9fd6d85f35 is being set with open permissions: ugo+rw Sep 23 14:45:14 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-7edc4ab0-8767-44ff-8fa3-640e0c8144f0 tempest-VolumesSnapshotListTestJSON-824608936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563.4052f265-5c0e-428f-a139-ad9fd6d85f35 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:45:14 devstack sudo[99886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563.4052f265-5c0e-428f-a139-ad9fd6d85f35 Sep 23 14:45:14 devstack sudo[99886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:45:14 devstack sudo[99886]: pam_unix(sudo:session): session closed for user root Sep 23 14:45:15 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-7edc4ab0-8767-44ff-8fa3-640e0c8144f0 tempest-VolumesSnapshotListTestJSON-824608936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563.4052f265-5c0e-428f-a139-ad9fd6d85f35" returned: 0 in 0.291s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:45:15 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-7edc4ab0-8767-44ff-8fa3-640e0c8144f0 tempest-VolumesSnapshotListTestJSON-824608936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.052s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:45:15 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-7edc4ab0-8767-44ff-8fa3-640e0c8144f0 tempest-VolumesSnapshotListTestJSON-824608936 None] Create snapshot completed successfully Sep 23 14:45:16 devstack cinder-volume[86310]: DEBUG cinder.image.image_utils [None req-03a364f0-dacf-4a6a-9014-a258ac63c3a9 tempest-TestInstancesWithCinderVolumes-584005076 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_eaed620a-2e6e-4338-80ac-22a3e46f2f90_425vy1wkdevstack@QuobyteHD, size 20.69 MB, duration 4.46 sec {{(pid=86310) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 23 14:45:16 devstack cinder-volume[86310]: INFO cinder.image.image_utils [None req-03a364f0-dacf-4a6a-9014-a258ac63c3a9 tempest-TestInstancesWithCinderVolumes-584005076 None] Image download 20.69 MB at 4.64 MB/s Sep 23 14:45:16 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0b613b9-4862-4c37-a587-1682ef6ac74e]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:45:16 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-03a364f0-dacf-4a6a-9014-a258ac63c3a9 tempest-TestInstancesWithCinderVolumes-584005076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eaed620a-2e6e-4338-80ac-22a3e46f2f90_425vy1wkdevstack@QuobyteHD {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:45:16 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-e0063713-c5d4-43d3-8f52-16b1c225c839 tempest-VolumesSnapshotListTestJSON-824608936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:45:16 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-e0063713-c5d4-43d3-8f52-16b1c225c839 tempest-VolumesSnapshotListTestJSON-824608936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:45:16 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-e0063713-c5d4-43d3-8f52-16b1c225c839 tempest-VolumesSnapshotListTestJSON-824608936 None] Creating offline snapshot 2435ccb8-457f-4def-970c-db788e4da02a of volume bbcd2b4b-1d31-405f-883c-8488f4ec3563 {{(pid=86310) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 14:45:16 devstack sudo[99889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eaed620a-2e6e-4338-80ac-22a3e46f2f90_425vy1wkdevstack@QuobyteHD Sep 23 14:45:16 devstack sudo[99889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:45:16 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[adb6a4f3-9db5-4735-92c2-e988144f3344]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:45:16 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-e0063713-c5d4-43d3-8f52-16b1c225c839 tempest-VolumesSnapshotListTestJSON-824608936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563.4052f265-5c0e-428f-a139-ad9fd6d85f35 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:45:16 devstack sudo[99891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563.4052f265-5c0e-428f-a139-ad9fd6d85f35 Sep 23 14:45:16 devstack sudo[99891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:45:16 devstack sudo[99889]: pam_unix(sudo:session): session closed for user root Sep 23 14:45:16 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-03a364f0-dacf-4a6a-9014-a258ac63c3a9 tempest-TestInstancesWithCinderVolumes-584005076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eaed620a-2e6e-4338-80ac-22a3e46f2f90_425vy1wkdevstack@QuobyteHD" returned: 0 in 0.427s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:45:16 devstack cinder-volume[86310]: DEBUG cinder.image.image_utils [None req-03a364f0-dacf-4a6a-9014-a258ac63c3a9 tempest-TestInstancesWithCinderVolumes-584005076 None] Temporary image eaed620a-2e6e-4338-80ac-22a3e46f2f90 is fetched for user f7186e9930a44e2fa9d4e9b8fcf4d990. {{(pid=86310) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 23 14:45:16 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[a52a365e-b5ab-4d34-a016-67df7779ee06]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:45:16 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-03a364f0-dacf-4a6a-9014-a258ac63c3a9 tempest-TestInstancesWithCinderVolumes-584005076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eaed620a-2e6e-4338-80ac-22a3e46f2f90_425vy1wkdevstack@QuobyteHD {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:45:16 devstack sudo[99896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eaed620a-2e6e-4338-80ac-22a3e46f2f90_425vy1wkdevstack@QuobyteHD Sep 23 14:45:16 devstack sudo[99896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:45:16 devstack sudo[99891]: pam_unix(sudo:session): session closed for user root Sep 23 14:45:16 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-e0063713-c5d4-43d3-8f52-16b1c225c839 tempest-VolumesSnapshotListTestJSON-824608936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563.4052f265-5c0e-428f-a139-ad9fd6d85f35" returned: 0 in 0.522s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:45:16 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-e0063713-c5d4-43d3-8f52-16b1c225c839 tempest-VolumesSnapshotListTestJSON-824608936 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 14:45:16 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-e0063713-c5d4-43d3-8f52-16b1c225c839 tempest-VolumesSnapshotListTestJSON-824608936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563.4052f265-5c0e-428f-a139-ad9fd6d85f35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563.2435ccb8-457f-4def-970c-db788e4da02a 1G {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:45:16 devstack sudo[99901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563.4052f265-5c0e-428f-a139-ad9fd6d85f35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563.2435ccb8-457f-4def-970c-db788e4da02a 1G Sep 23 14:45:16 devstack sudo[99901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:45:17 devstack sudo[99896]: pam_unix(sudo:session): session closed for user root Sep 23 14:45:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-03a364f0-dacf-4a6a-9014-a258ac63c3a9 tempest-TestInstancesWithCinderVolumes-584005076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eaed620a-2e6e-4338-80ac-22a3e46f2f90_425vy1wkdevstack@QuobyteHD" returned: 0 in 0.516s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:45:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-03a364f0-dacf-4a6a-9014-a258ac63c3a9 tempest-TestInstancesWithCinderVolumes-584005076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:45:17 devstack sudo[99901]: pam_unix(sudo:session): session closed for user root Sep 23 14:45:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-e0063713-c5d4-43d3-8f52-16b1c225c839 tempest-VolumesSnapshotListTestJSON-824608936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563.4052f265-5c0e-428f-a139-ad9fd6d85f35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563.2435ccb8-457f-4def-970c-db788e4da02a 1G" returned: 0 in 0.645s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:45:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-e0063713-c5d4-43d3-8f52-16b1c225c839 tempest-VolumesSnapshotListTestJSON-824608936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563.4052f265-5c0e-428f-a139-ad9fd6d85f35 -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563.2435ccb8-457f-4def-970c-db788e4da02a {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:45:17 devstack sudo[99910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563.4052f265-5c0e-428f-a139-ad9fd6d85f35 -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563.2435ccb8-457f-4def-970c-db788e4da02a Sep 23 14:45:17 devstack sudo[99910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:45:17 devstack sudo[99910]: pam_unix(sudo:session): session closed for user root Sep 23 14:45:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-e0063713-c5d4-43d3-8f52-16b1c225c839 tempest-VolumesSnapshotListTestJSON-824608936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563.4052f265-5c0e-428f-a139-ad9fd6d85f35 -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563.2435ccb8-457f-4def-970c-db788e4da02a" returned: 0 in 0.336s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:45:17 devstack cinder-volume[86310]: WARNING cinder.volume.drivers.remotefs [None req-e0063713-c5d4-43d3-8f52-16b1c225c839 tempest-VolumesSnapshotListTestJSON-824608936 None] /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563.2435ccb8-457f-4def-970c-db788e4da02a is being set with open permissions: ugo+rw Sep 23 14:45:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-e0063713-c5d4-43d3-8f52-16b1c225c839 tempest-VolumesSnapshotListTestJSON-824608936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563.2435ccb8-457f-4def-970c-db788e4da02a {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:45:17 devstack sudo[99915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563.2435ccb8-457f-4def-970c-db788e4da02a Sep 23 14:45:17 devstack sudo[99915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:45:18 devstack sudo[99915]: pam_unix(sudo:session): session closed for user root Sep 23 14:45:18 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-e0063713-c5d4-43d3-8f52-16b1c225c839 tempest-VolumesSnapshotListTestJSON-824608936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563.2435ccb8-457f-4def-970c-db788e4da02a" returned: 0 in 0.269s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:45:18 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-e0063713-c5d4-43d3-8f52-16b1c225c839 tempest-VolumesSnapshotListTestJSON-824608936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.942s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:45:18 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-03a364f0-dacf-4a6a-9014-a258ac63c3a9 tempest-TestInstancesWithCinderVolumes-584005076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.956s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:45:18 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-03a364f0-dacf-4a6a-9014-a258ac63c3a9 tempest-TestInstancesWithCinderVolumes-584005076 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:45:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-875942443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7229c51-b135-4bf7-b03a-c85b483bbab5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2af96813b5e94a57b353ae4dd2bacfe0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:45:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:45:11Z,use_quota=True,user_id='f7186e9930a44e2fa9d4e9b8fcf4d990',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(133ec01a-6f23-48a8-a2d7-029c2586453b),volume_type_id=133ec01a-6f23-48a8-a2d7-029c2586453b)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:45:18 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-03a364f0-dacf-4a6a-9014-a258ac63c3a9 tempest-TestInstancesWithCinderVolumes-584005076 None] Creating volume b7229c51-b135-4bf7-b03a-c85b483bbab5 {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:45:18 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-03a364f0-dacf-4a6a-9014-a258ac63c3a9 tempest-TestInstancesWithCinderVolumes-584005076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:45:18 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-03a364f0-dacf-4a6a-9014-a258ac63c3a9 tempest-TestInstancesWithCinderVolumes-584005076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:45:18 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-03a364f0-dacf-4a6a-9014-a258ac63c3a9 tempest-TestInstancesWithCinderVolumes-584005076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:45:18 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-03a364f0-dacf-4a6a-9014-a258ac63c3a9 tempest-TestInstancesWithCinderVolumes-584005076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:45:18 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-03a364f0-dacf-4a6a-9014-a258ac63c3a9 tempest-TestInstancesWithCinderVolumes-584005076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:45:18 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-03a364f0-dacf-4a6a-9014-a258ac63c3a9 tempest-TestInstancesWithCinderVolumes-584005076 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:45:18 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-03a364f0-dacf-4a6a-9014-a258ac63c3a9 tempest-TestInstancesWithCinderVolumes-584005076 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:45:18 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-03a364f0-dacf-4a6a-9014-a258ac63c3a9 tempest-TestInstancesWithCinderVolumes-584005076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b7229c51-b135-4bf7-b03a-c85b483bbab5 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:45:18 devstack sudo[99918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b7229c51-b135-4bf7-b03a-c85b483bbab5 1073741824 Sep 23 14:45:18 devstack sudo[99918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:45:18 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-e0063713-c5d4-43d3-8f52-16b1c225c839 tempest-VolumesSnapshotListTestJSON-824608936 None] Create snapshot completed successfully Sep 23 14:45:18 devstack sudo[99918]: pam_unix(sudo:session): session closed for user root Sep 23 14:45:18 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-03a364f0-dacf-4a6a-9014-a258ac63c3a9 tempest-TestInstancesWithCinderVolumes-584005076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b7229c51-b135-4bf7-b03a-c85b483bbab5 1073741824" returned: 0 in 0.619s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:45:18 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-03a364f0-dacf-4a6a-9014-a258ac63c3a9 tempest-TestInstancesWithCinderVolumes-584005076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b7229c51-b135-4bf7-b03a-c85b483bbab5 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:45:18 devstack sudo[99924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b7229c51-b135-4bf7-b03a-c85b483bbab5 Sep 23 14:45:18 devstack sudo[99924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:45:19 devstack sudo[99924]: pam_unix(sudo:session): session closed for user root Sep 23 14:45:19 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-03a364f0-dacf-4a6a-9014-a258ac63c3a9 tempest-TestInstancesWithCinderVolumes-584005076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b7229c51-b135-4bf7-b03a-c85b483bbab5" returned: 0 in 0.313s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:45:19 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-03a364f0-dacf-4a6a-9014-a258ac63c3a9 tempest-TestInstancesWithCinderVolumes-584005076 None] <== create_volume: return (989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:45:19 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-03a364f0-dacf-4a6a-9014-a258ac63c3a9 tempest-TestInstancesWithCinderVolumes-584005076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.995s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:45:19 devstack cinder-volume[86310]: DEBUG cinder.volume.volume_utils [None req-03a364f0-dacf-4a6a-9014-a258ac63c3a9 tempest-TestInstancesWithCinderVolumes-584005076 None] Attempting download of eaed620a-2e6e-4338-80ac-22a3e46f2f90 ((None, [{'url': 'file:///opt/stack/data/glance/images/eaed620a-2e6e-4338-80ac-22a3e46f2f90', 'metadata': {}}])) to volume b7229c51-b135-4bf7-b03a-c85b483bbab5. {{(pid=86310) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 23 14:45:19 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a413967-8e25-4ff5-8b71-08730e46f178]: (4, 'raw') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:45:19 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-03a364f0-dacf-4a6a-9014-a258ac63c3a9 tempest-TestInstancesWithCinderVolumes-584005076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eaed620a-2e6e-4338-80ac-22a3e46f2f90_n1nq3s08 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:45:19 devstack sudo[99927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eaed620a-2e6e-4338-80ac-22a3e46f2f90_n1nq3s08 Sep 23 14:45:19 devstack sudo[99927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:45:19 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-30d0a192-cb17-4c9f-b8b0-9ec0434b61e7 tempest-VolumesSnapshotListTestJSON-824608936 None] Acquiring lock "cinder-2435ccb8-457f-4def-970c-db788e4da02a-delete_snapshot" by "delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:45:19 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-30d0a192-cb17-4c9f-b8b0-9ec0434b61e7 tempest-VolumesSnapshotListTestJSON-824608936 None] Lock "cinder-2435ccb8-457f-4def-970c-db788e4da02a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.057s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:45:19 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-30d0a192-cb17-4c9f-b8b0-9ec0434b61e7 tempest-VolumesSnapshotListTestJSON-824608936 None] Acquiring lock "cinder-quobyte-bbcd2b4b-1d31-405f-883c-8488f4ec3563" by "delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:45:19 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-30d0a192-cb17-4c9f-b8b0-9ec0434b61e7 tempest-VolumesSnapshotListTestJSON-824608936 None] Lock "cinder-quobyte-bbcd2b4b-1d31-405f-883c-8488f4ec3563" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:45:19 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-30d0a192-cb17-4c9f-b8b0-9ec0434b61e7 tempest-VolumesSnapshotListTestJSON-824608936 None] Acquiring lock "cinder-quobyte-2435ccb8-457f-4def-970c-db788e4da02a" by "_delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:45:19 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-30d0a192-cb17-4c9f-b8b0-9ec0434b61e7 tempest-VolumesSnapshotListTestJSON-824608936 None] Lock "cinder-quobyte-2435ccb8-457f-4def-970c-db788e4da02a" acquired by "_delete_snapshot" :: waited 0.056s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:45:19 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-30d0a192-cb17-4c9f-b8b0-9ec0434b61e7 tempest-VolumesSnapshotListTestJSON-824608936 None] Deleting offline snapshot 2435ccb8-457f-4def-970c-db788e4da02a of volume bbcd2b4b-1d31-405f-883c-8488f4ec3563 {{(pid=86310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 14:45:19 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-30d0a192-cb17-4c9f-b8b0-9ec0434b61e7 tempest-VolumesSnapshotListTestJSON-824608936 None] snapshot_file for this snap is: volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563.2435ccb8-457f-4def-970c-db788e4da02a {{(pid=86310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 14:45:19 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d8475b8-e37a-4ce8-80fe-6df450252f2e]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:45:19 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-30d0a192-cb17-4c9f-b8b0-9ec0434b61e7 tempest-VolumesSnapshotListTestJSON-824608936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563.2435ccb8-457f-4def-970c-db788e4da02a {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:45:19 devstack sudo[99927]: pam_unix(sudo:session): session closed for user root Sep 23 14:45:19 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-03a364f0-dacf-4a6a-9014-a258ac63c3a9 tempest-TestInstancesWithCinderVolumes-584005076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eaed620a-2e6e-4338-80ac-22a3e46f2f90_n1nq3s08" returned: 0 in 0.410s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:45:19 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-03a364f0-dacf-4a6a-9014-a258ac63c3a9 tempest-TestInstancesWithCinderVolumes-584005076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eaed620a-2e6e-4338-80ac-22a3e46f2f90_n1nq3s08 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:45:19 devstack sudo[99929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563.2435ccb8-457f-4def-970c-db788e4da02a Sep 23 14:45:19 devstack sudo[99929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:45:19 devstack sudo[99932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eaed620a-2e6e-4338-80ac-22a3e46f2f90_n1nq3s08 Sep 23 14:45:19 devstack sudo[99932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:45:20 devstack sudo[99929]: pam_unix(sudo:session): session closed for user root Sep 23 14:45:20 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-30d0a192-cb17-4c9f-b8b0-9ec0434b61e7 tempest-VolumesSnapshotListTestJSON-824608936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563.2435ccb8-457f-4def-970c-db788e4da02a" returned: 0 in 0.400s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:45:20 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-30d0a192-cb17-4c9f-b8b0-9ec0434b61e7 tempest-VolumesSnapshotListTestJSON-824608936 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 14:45:20 devstack sudo[99932]: pam_unix(sudo:session): session closed for user root Sep 23 14:45:20 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-03a364f0-dacf-4a6a-9014-a258ac63c3a9 tempest-TestInstancesWithCinderVolumes-584005076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eaed620a-2e6e-4338-80ac-22a3e46f2f90_n1nq3s08" returned: 1 in 0.400s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:45:20 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-03a364f0-dacf-4a6a-9014-a258ac63c3a9 tempest-TestInstancesWithCinderVolumes-584005076 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eaed620a-2e6e-4338-80ac-22a3e46f2f90_n1nq3s08' failed. Not Retrying. {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 14:45:20 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[80fa391c-7ba1-43ab-bdd3-5973a33e6141]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:45:20 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[130234fc-1d59-4f57-89b2-bc70cdd01049]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:45:20 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-03a364f0-dacf-4a6a-9014-a258ac63c3a9 tempest-TestInstancesWithCinderVolumes-584005076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eaed620a-2e6e-4338-80ac-22a3e46f2f90_425vy1wkdevstack@QuobyteHD {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:45:20 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-30d0a192-cb17-4c9f-b8b0-9ec0434b61e7 tempest-VolumesSnapshotListTestJSON-824608936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563.4052f265-5c0e-428f-a139-ad9fd6d85f35 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:45:20 devstack sudo[99941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eaed620a-2e6e-4338-80ac-22a3e46f2f90_425vy1wkdevstack@QuobyteHD Sep 23 14:45:20 devstack sudo[99941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:45:20 devstack sudo[99942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563.4052f265-5c0e-428f-a139-ad9fd6d85f35 Sep 23 14:45:20 devstack sudo[99942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:45:20 devstack sudo[99941]: pam_unix(sudo:session): session closed for user root Sep 23 14:45:20 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-03a364f0-dacf-4a6a-9014-a258ac63c3a9 tempest-TestInstancesWithCinderVolumes-584005076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eaed620a-2e6e-4338-80ac-22a3e46f2f90_425vy1wkdevstack@QuobyteHD" returned: 0 in 0.401s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:45:20 devstack cinder-volume[86310]: DEBUG cinder.image.image_utils [None req-03a364f0-dacf-4a6a-9014-a258ac63c3a9 tempest-TestInstancesWithCinderVolumes-584005076 None] eaed620a-2e6e-4338-80ac-22a3e46f2f90 was qcow2, converting to qcow2 {{(pid=86310) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 23 14:45:20 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-03a364f0-dacf-4a6a-9014-a258ac63c3a9 tempest-TestInstancesWithCinderVolumes-584005076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_eaed620a-2e6e-4338-80ac-22a3e46f2f90_425vy1wkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b7229c51-b135-4bf7-b03a-c85b483bbab5 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:45:20 devstack sudo[99951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_eaed620a-2e6e-4338-80ac-22a3e46f2f90_425vy1wkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b7229c51-b135-4bf7-b03a-c85b483bbab5 Sep 23 14:45:20 devstack sudo[99951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:45:20 devstack sudo[99942]: pam_unix(sudo:session): session closed for user root Sep 23 14:45:20 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-30d0a192-cb17-4c9f-b8b0-9ec0434b61e7 tempest-VolumesSnapshotListTestJSON-824608936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563.4052f265-5c0e-428f-a139-ad9fd6d85f35" returned: 0 in 0.505s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:45:20 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-30d0a192-cb17-4c9f-b8b0-9ec0434b61e7 tempest-VolumesSnapshotListTestJSON-824608936 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 14:45:20 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-30d0a192-cb17-4c9f-b8b0-9ec0434b61e7 tempest-VolumesSnapshotListTestJSON-824608936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563.2435ccb8-457f-4def-970c-db788e4da02a {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:45:20 devstack sudo[99954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563.2435ccb8-457f-4def-970c-db788e4da02a Sep 23 14:45:20 devstack sudo[99954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:45:21 devstack sudo[99954]: pam_unix(sudo:session): session closed for user root Sep 23 14:45:21 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-30d0a192-cb17-4c9f-b8b0-9ec0434b61e7 tempest-VolumesSnapshotListTestJSON-824608936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563.2435ccb8-457f-4def-970c-db788e4da02a" returned: 0 in 0.528s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:45:21 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-30d0a192-cb17-4c9f-b8b0-9ec0434b61e7 tempest-VolumesSnapshotListTestJSON-824608936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563.2435ccb8-457f-4def-970c-db788e4da02a {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:45:21 devstack sudo[99965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563.2435ccb8-457f-4def-970c-db788e4da02a Sep 23 14:45:21 devstack sudo[99965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:45:21 devstack sudo[99965]: pam_unix(sudo:session): session closed for user root Sep 23 14:45:21 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-30d0a192-cb17-4c9f-b8b0-9ec0434b61e7 tempest-VolumesSnapshotListTestJSON-824608936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563.2435ccb8-457f-4def-970c-db788e4da02a" returned: 0 in 0.319s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:45:21 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-30d0a192-cb17-4c9f-b8b0-9ec0434b61e7 tempest-VolumesSnapshotListTestJSON-824608936 None] Lock "cinder-quobyte-2435ccb8-457f-4def-970c-db788e4da02a" released by "_delete_snapshot" :: held 1.947s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:45:21 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-30d0a192-cb17-4c9f-b8b0-9ec0434b61e7 tempest-VolumesSnapshotListTestJSON-824608936 None] Lock "cinder-quobyte-bbcd2b4b-1d31-405f-883c-8488f4ec3563" released by "delete_snapshot" :: held 2.018s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:45:21 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-30d0a192-cb17-4c9f-b8b0-9ec0434b61e7 tempest-VolumesSnapshotListTestJSON-824608936 None] Created reservations ['09437134-8c0c-42a1-b095-95ac1aef5a77', 'c8cbbee8-c90b-47c8-b112-24bdff6b8b40', 'd92d9e21-a01f-4d8f-8147-0fec63f1b0e1', 'c18ff522-848f-4f72-8af8-e45e2d724855'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:45:21 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-30d0a192-cb17-4c9f-b8b0-9ec0434b61e7 tempest-VolumesSnapshotListTestJSON-824608936 None] Delete snapshot completed successfully. Sep 23 14:45:21 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-30d0a192-cb17-4c9f-b8b0-9ec0434b61e7 tempest-VolumesSnapshotListTestJSON-824608936 None] Lock "cinder-2435ccb8-457f-4def-970c-db788e4da02a-delete_snapshot" released by "delete_snapshot" :: held 2.295s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:45:22 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-ccc48391-6625-4ab9-8529-a43be3025bbd tempest-VolumesSnapshotListTestJSON-824608936 None] Acquiring lock "cinder-4052f265-5c0e-428f-a139-ad9fd6d85f35-delete_snapshot" by "delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:45:22 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-ccc48391-6625-4ab9-8529-a43be3025bbd tempest-VolumesSnapshotListTestJSON-824608936 None] Lock "cinder-4052f265-5c0e-428f-a139-ad9fd6d85f35-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:45:22 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-ccc48391-6625-4ab9-8529-a43be3025bbd tempest-VolumesSnapshotListTestJSON-824608936 None] Acquiring lock "cinder-quobyte-bbcd2b4b-1d31-405f-883c-8488f4ec3563" by "delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:45:22 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-ccc48391-6625-4ab9-8529-a43be3025bbd tempest-VolumesSnapshotListTestJSON-824608936 None] Lock "cinder-quobyte-bbcd2b4b-1d31-405f-883c-8488f4ec3563" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:45:22 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-ccc48391-6625-4ab9-8529-a43be3025bbd tempest-VolumesSnapshotListTestJSON-824608936 None] Acquiring lock "cinder-quobyte-4052f265-5c0e-428f-a139-ad9fd6d85f35" by "_delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:45:22 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-ccc48391-6625-4ab9-8529-a43be3025bbd tempest-VolumesSnapshotListTestJSON-824608936 None] Lock "cinder-quobyte-4052f265-5c0e-428f-a139-ad9fd6d85f35" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:45:22 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-ccc48391-6625-4ab9-8529-a43be3025bbd tempest-VolumesSnapshotListTestJSON-824608936 None] Deleting offline snapshot 4052f265-5c0e-428f-a139-ad9fd6d85f35 of volume bbcd2b4b-1d31-405f-883c-8488f4ec3563 {{(pid=86310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 14:45:22 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-ccc48391-6625-4ab9-8529-a43be3025bbd tempest-VolumesSnapshotListTestJSON-824608936 None] snapshot_file for this snap is: volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563.4052f265-5c0e-428f-a139-ad9fd6d85f35 {{(pid=86310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 14:45:22 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc1bee93-4363-4c08-83ce-c405dc904640]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:45:22 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ccc48391-6625-4ab9-8529-a43be3025bbd tempest-VolumesSnapshotListTestJSON-824608936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563.4052f265-5c0e-428f-a139-ad9fd6d85f35 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:45:23 devstack sudo[99970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563.4052f265-5c0e-428f-a139-ad9fd6d85f35 Sep 23 14:45:23 devstack sudo[99970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:45:23 devstack sudo[99951]: pam_unix(sudo:session): session closed for user root Sep 23 14:45:23 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-03a364f0-dacf-4a6a-9014-a258ac63c3a9 tempest-TestInstancesWithCinderVolumes-584005076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_eaed620a-2e6e-4338-80ac-22a3e46f2f90_425vy1wkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b7229c51-b135-4bf7-b03a-c85b483bbab5" returned: 0 in 2.548s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:45:23 devstack cinder-volume[86310]: DEBUG cinder.image.image_utils [None req-03a364f0-dacf-4a6a-9014-a258ac63c3a9 tempest-TestInstancesWithCinderVolumes-584005076 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_eaed620a-2e6e-4338-80ac-22a3e46f2f90_425vy1wkdevstack@QuobyteHD, size 112.00 MB, duration 2.55 sec, destination /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b7229c51-b135-4bf7-b03a-c85b483bbab5 {{(pid=86310) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 14:45:23 devstack cinder-volume[86310]: INFO cinder.image.image_utils [None req-03a364f0-dacf-4a6a-9014-a258ac63c3a9 tempest-TestInstancesWithCinderVolumes-584005076 None] Converted 112.00 MB image at 43.91 MB/s Sep 23 14:45:23 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-03a364f0-dacf-4a6a-9014-a258ac63c3a9 tempest-TestInstancesWithCinderVolumes-584005076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b7229c51-b135-4bf7-b03a-c85b483bbab5 1G {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:45:23 devstack sudo[99972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b7229c51-b135-4bf7-b03a-c85b483bbab5 1G Sep 23 14:45:23 devstack sudo[99972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:45:23 devstack sudo[99970]: pam_unix(sudo:session): session closed for user root Sep 23 14:45:23 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ccc48391-6625-4ab9-8529-a43be3025bbd tempest-VolumesSnapshotListTestJSON-824608936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563.4052f265-5c0e-428f-a139-ad9fd6d85f35" returned: 0 in 0.484s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:45:23 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-ccc48391-6625-4ab9-8529-a43be3025bbd tempest-VolumesSnapshotListTestJSON-824608936 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 14:45:23 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[f888dff7-f0c0-4980-8bf5-f4b6df2b1607]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:45:23 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ccc48391-6625-4ab9-8529-a43be3025bbd tempest-VolumesSnapshotListTestJSON-824608936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563.4739aa02-2a83-443d-8539-2fed83d51e26 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:45:23 devstack sudo[99972]: pam_unix(sudo:session): session closed for user root Sep 23 14:45:23 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-03a364f0-dacf-4a6a-9014-a258ac63c3a9 tempest-TestInstancesWithCinderVolumes-584005076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b7229c51-b135-4bf7-b03a-c85b483bbab5 1G" returned: 0 in 0.370s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:45:23 devstack cinder-volume[86310]: DEBUG cinder.volume.volume_utils [None req-03a364f0-dacf-4a6a-9014-a258ac63c3a9 tempest-TestInstancesWithCinderVolumes-584005076 None] Downloaded image eaed620a-2e6e-4338-80ac-22a3e46f2f90 ((None, [{'url': 'file:///opt/stack/data/glance/images/eaed620a-2e6e-4338-80ac-22a3e46f2f90', 'metadata': {}}])) to volume b7229c51-b135-4bf7-b03a-c85b483bbab5 successfully. {{(pid=86310) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 23 14:45:23 devstack cinder-volume[86310]: DEBUG cinder.image.image_utils [None req-03a364f0-dacf-4a6a-9014-a258ac63c3a9 tempest-TestInstancesWithCinderVolumes-584005076 None] Temporary image eaed620a-2e6e-4338-80ac-22a3e46f2f90 for user f7186e9930a44e2fa9d4e9b8fcf4d990 is deleted. {{(pid=86310) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 23 14:45:23 devstack cinder-volume[86310]: DEBUG cinder.volume.volume_utils [None req-03a364f0-dacf-4a6a-9014-a258ac63c3a9 tempest-TestInstancesWithCinderVolumes-584005076 None] Marking volume b7229c51-b135-4bf7-b03a-c85b483bbab5 as bootable. {{(pid=86310) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 23 14:45:23 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-03a364f0-dacf-4a6a-9014-a258ac63c3a9 tempest-TestInstancesWithCinderVolumes-584005076 None] Copying metadata from image eaed620a-2e6e-4338-80ac-22a3e46f2f90 to b7229c51-b135-4bf7-b03a-c85b483bbab5. {{(pid=86310) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 23 14:45:23 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-03a364f0-dacf-4a6a-9014-a258ac63c3a9 tempest-TestInstancesWithCinderVolumes-584005076 None] Creating volume glance metadata for volume b7229c51-b135-4bf7-b03a-c85b483bbab5 backed by image eaed620a-2e6e-4338-80ac-22a3e46f2f90 with: {'image_id': 'eaed620a-2e6e-4338-80ac-22a3e46f2f90', 'image_name': 'tempest-scenario-img--905226345', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86310) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 23 14:45:23 devstack sudo[99981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563.4739aa02-2a83-443d-8539-2fed83d51e26 Sep 23 14:45:23 devstack sudo[99981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:45:23 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-03a364f0-dacf-4a6a-9014-a258ac63c3a9 tempest-TestInstancesWithCinderVolumes-584005076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d71523c-99f8-4abf-b88a-f488de80cab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7229c51-b135-4bf7-b03a-c85b483bbab5', 'volume_size': 1, 'image_id': 'eaed620a-2e6e-4338-80ac-22a3e46f2f90', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eaed620a-2e6e-4338-80ac-22a3e46f2f90', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--905226345', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2af96813b5e94a57b353ae4dd2bacfe0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'eaed620a-2e6e-4338-80ac-22a3e46f2f90', 'created_at': datetime.datetime(2026, 9, 23, 12, 45, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 23, 12, 45, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eaed620a-2e6e-4338-80ac-22a3e46f2f90/file', 'properties': {}}, 'image_service': }' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:45:23 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-03a364f0-dacf-4a6a-9014-a258ac63c3a9 tempest-TestInstancesWithCinderVolumes-584005076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ba5424c-153e-44fb-b736-cd84eea8c559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:45:23 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-03a364f0-dacf-4a6a-9014-a258ac63c3a9 tempest-TestInstancesWithCinderVolumes-584005076 None] Volume volume-b7229c51-b135-4bf7-b03a-c85b483bbab5 (b7229c51-b135-4bf7-b03a-c85b483bbab5): created successfully Sep 23 14:45:23 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-03a364f0-dacf-4a6a-9014-a258ac63c3a9 tempest-TestInstancesWithCinderVolumes-584005076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ba5424c-153e-44fb-b736-cd84eea8c559) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:45:23 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-03a364f0-dacf-4a6a-9014-a258ac63c3a9 tempest-TestInstancesWithCinderVolumes-584005076 None] Flow 'volume_create_manager' (c2eee6b6-6693-4649-8a21-b5b8ce44feb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:45:23 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-03a364f0-dacf-4a6a-9014-a258ac63c3a9 tempest-TestInstancesWithCinderVolumes-584005076 None] Created volume successfully. Sep 23 14:45:23 devstack sudo[99981]: pam_unix(sudo:session): session closed for user root Sep 23 14:45:23 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ccc48391-6625-4ab9-8529-a43be3025bbd tempest-VolumesSnapshotListTestJSON-824608936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563.4739aa02-2a83-443d-8539-2fed83d51e26" returned: 0 in 0.459s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:45:23 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-ccc48391-6625-4ab9-8529-a43be3025bbd tempest-VolumesSnapshotListTestJSON-824608936 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 14:45:23 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ccc48391-6625-4ab9-8529-a43be3025bbd tempest-VolumesSnapshotListTestJSON-824608936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563.4052f265-5c0e-428f-a139-ad9fd6d85f35 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:45:23 devstack sudo[99987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563.4052f265-5c0e-428f-a139-ad9fd6d85f35 Sep 23 14:45:23 devstack sudo[99987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:45:24 devstack sudo[99987]: pam_unix(sudo:session): session closed for user root Sep 23 14:45:24 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ccc48391-6625-4ab9-8529-a43be3025bbd tempest-VolumesSnapshotListTestJSON-824608936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563.4052f265-5c0e-428f-a139-ad9fd6d85f35" returned: 0 in 0.423s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:45:24 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ccc48391-6625-4ab9-8529-a43be3025bbd tempest-VolumesSnapshotListTestJSON-824608936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563.4052f265-5c0e-428f-a139-ad9fd6d85f35 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:45:24 devstack sudo[99992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563.4052f265-5c0e-428f-a139-ad9fd6d85f35 Sep 23 14:45:24 devstack sudo[99992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:45:24 devstack sudo[99992]: pam_unix(sudo:session): session closed for user root Sep 23 14:45:24 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ccc48391-6625-4ab9-8529-a43be3025bbd tempest-VolumesSnapshotListTestJSON-824608936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563.4052f265-5c0e-428f-a139-ad9fd6d85f35" returned: 0 in 0.282s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:45:24 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-ccc48391-6625-4ab9-8529-a43be3025bbd tempest-VolumesSnapshotListTestJSON-824608936 None] Lock "cinder-quobyte-4052f265-5c0e-428f-a139-ad9fd6d85f35" released by "_delete_snapshot" :: held 1.798s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:45:24 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-ccc48391-6625-4ab9-8529-a43be3025bbd tempest-VolumesSnapshotListTestJSON-824608936 None] Lock "cinder-quobyte-bbcd2b4b-1d31-405f-883c-8488f4ec3563" released by "delete_snapshot" :: held 1.826s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:45:24 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-ccc48391-6625-4ab9-8529-a43be3025bbd tempest-VolumesSnapshotListTestJSON-824608936 None] Created reservations ['fe18e6ff-5516-4921-a7c3-a62751fb93d1', 'f77f706e-6ba6-4f3a-8208-f517ccca9792', '6186adc9-704f-401e-b58d-74506b342f57', '57ff0fc4-0ea1-4ab7-ad36-5c9b0862b58d'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:45:24 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-ccc48391-6625-4ab9-8529-a43be3025bbd tempest-VolumesSnapshotListTestJSON-824608936 None] Delete snapshot completed successfully. Sep 23 14:45:24 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-ccc48391-6625-4ab9-8529-a43be3025bbd tempest-VolumesSnapshotListTestJSON-824608936 None] Lock "cinder-4052f265-5c0e-428f-a139-ad9fd6d85f35-delete_snapshot" released by "delete_snapshot" :: held 1.998s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:45:25 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-d834c255-05ff-4aab-8c83-9dd4bfd60eb4 tempest-VolumesSnapshotListTestJSON-824608936 None] Acquiring lock "cinder-4739aa02-2a83-443d-8539-2fed83d51e26-delete_snapshot" by "delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:45:25 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-d834c255-05ff-4aab-8c83-9dd4bfd60eb4 tempest-VolumesSnapshotListTestJSON-824608936 None] Lock "cinder-4739aa02-2a83-443d-8539-2fed83d51e26-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:45:25 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-d834c255-05ff-4aab-8c83-9dd4bfd60eb4 tempest-VolumesSnapshotListTestJSON-824608936 None] Acquiring lock "cinder-quobyte-bbcd2b4b-1d31-405f-883c-8488f4ec3563" by "delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:45:25 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-d834c255-05ff-4aab-8c83-9dd4bfd60eb4 tempest-VolumesSnapshotListTestJSON-824608936 None] Lock "cinder-quobyte-bbcd2b4b-1d31-405f-883c-8488f4ec3563" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:45:25 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-d834c255-05ff-4aab-8c83-9dd4bfd60eb4 tempest-VolumesSnapshotListTestJSON-824608936 None] Acquiring lock "cinder-quobyte-4739aa02-2a83-443d-8539-2fed83d51e26" by "_delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:45:25 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-d834c255-05ff-4aab-8c83-9dd4bfd60eb4 tempest-VolumesSnapshotListTestJSON-824608936 None] Lock "cinder-quobyte-4739aa02-2a83-443d-8539-2fed83d51e26" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:45:25 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-d834c255-05ff-4aab-8c83-9dd4bfd60eb4 tempest-VolumesSnapshotListTestJSON-824608936 None] Deleting offline snapshot 4739aa02-2a83-443d-8539-2fed83d51e26 of volume bbcd2b4b-1d31-405f-883c-8488f4ec3563 {{(pid=86310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 14:45:25 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-d834c255-05ff-4aab-8c83-9dd4bfd60eb4 tempest-VolumesSnapshotListTestJSON-824608936 None] snapshot_file for this snap is: volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563.4739aa02-2a83-443d-8539-2fed83d51e26 {{(pid=86310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 14:45:25 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[d81794a3-5b1a-4b0e-9912-21d9170e6cb0]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:45:25 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d834c255-05ff-4aab-8c83-9dd4bfd60eb4 tempest-VolumesSnapshotListTestJSON-824608936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563.4739aa02-2a83-443d-8539-2fed83d51e26 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:45:25 devstack sudo[100009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563.4739aa02-2a83-443d-8539-2fed83d51e26 Sep 23 14:45:25 devstack sudo[100009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:45:25 devstack sudo[100009]: pam_unix(sudo:session): session closed for user root Sep 23 14:45:25 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d834c255-05ff-4aab-8c83-9dd4bfd60eb4 tempest-VolumesSnapshotListTestJSON-824608936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563.4739aa02-2a83-443d-8539-2fed83d51e26" returned: 0 in 0.665s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:45:25 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-d834c255-05ff-4aab-8c83-9dd4bfd60eb4 tempest-VolumesSnapshotListTestJSON-824608936 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 14:45:25 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[135f242d-ae9c-4a36-841a-dc95ecb2dc9e]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:45:25 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d834c255-05ff-4aab-8c83-9dd4bfd60eb4 tempest-VolumesSnapshotListTestJSON-824608936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:45:25 devstack sudo[100039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563 Sep 23 14:45:25 devstack sudo[100039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:45:26 devstack sudo[100039]: pam_unix(sudo:session): session closed for user root Sep 23 14:45:26 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d834c255-05ff-4aab-8c83-9dd4bfd60eb4 tempest-VolumesSnapshotListTestJSON-824608936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563" returned: 0 in 0.546s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:45:26 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d834c255-05ff-4aab-8c83-9dd4bfd60eb4 tempest-VolumesSnapshotListTestJSON-824608936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563.4739aa02-2a83-443d-8539-2fed83d51e26 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:45:26 devstack sudo[100048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563.4739aa02-2a83-443d-8539-2fed83d51e26 Sep 23 14:45:26 devstack sudo[100048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:45:26 devstack sudo[100048]: pam_unix(sudo:session): session closed for user root Sep 23 14:45:26 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d834c255-05ff-4aab-8c83-9dd4bfd60eb4 tempest-VolumesSnapshotListTestJSON-824608936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563.4739aa02-2a83-443d-8539-2fed83d51e26" returned: 0 in 0.576s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:45:26 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d834c255-05ff-4aab-8c83-9dd4bfd60eb4 tempest-VolumesSnapshotListTestJSON-824608936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563.4739aa02-2a83-443d-8539-2fed83d51e26 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:45:27 devstack sudo[100053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563.4739aa02-2a83-443d-8539-2fed83d51e26 Sep 23 14:45:27 devstack sudo[100053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:45:27 devstack sudo[100053]: pam_unix(sudo:session): session closed for user root Sep 23 14:45:27 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d834c255-05ff-4aab-8c83-9dd4bfd60eb4 tempest-VolumesSnapshotListTestJSON-824608936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563.4739aa02-2a83-443d-8539-2fed83d51e26" returned: 0 in 0.438s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:45:27 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-d834c255-05ff-4aab-8c83-9dd4bfd60eb4 tempest-VolumesSnapshotListTestJSON-824608936 None] Lock "cinder-quobyte-4739aa02-2a83-443d-8539-2fed83d51e26" released by "_delete_snapshot" :: held 2.425s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:45:27 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-d834c255-05ff-4aab-8c83-9dd4bfd60eb4 tempest-VolumesSnapshotListTestJSON-824608936 None] Lock "cinder-quobyte-bbcd2b4b-1d31-405f-883c-8488f4ec3563" released by "delete_snapshot" :: held 2.456s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:45:27 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-d834c255-05ff-4aab-8c83-9dd4bfd60eb4 tempest-VolumesSnapshotListTestJSON-824608936 None] Created reservations ['bd87e8ca-73e2-4fbc-a904-03bf4466d7c7', '141f6b9e-61a2-4412-9a72-8f9208af85a0', '18fa29f3-07ac-4e50-9317-f12d545ddccd', 'ddb975f6-c491-467c-9ea7-5f57ad6b1b42'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:45:27 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-d834c255-05ff-4aab-8c83-9dd4bfd60eb4 tempest-VolumesSnapshotListTestJSON-824608936 None] Delete snapshot completed successfully. Sep 23 14:45:27 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-d834c255-05ff-4aab-8c83-9dd4bfd60eb4 tempest-VolumesSnapshotListTestJSON-824608936 None] Lock "cinder-4739aa02-2a83-443d-8539-2fed83d51e26-delete_snapshot" released by "delete_snapshot" :: held 2.717s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:45:27 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [req-7d3fb7d7-4c7c-4608-a384-3b4fcfd906ea req-21b57c34-888f-4d05-8120-246212551245 tempest-TestInstancesWithCinderVolumes-584005076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:45:27 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [req-7d3fb7d7-4c7c-4608-a384-3b4fcfd906ea req-21b57c34-888f-4d05-8120-246212551245 tempest-TestInstancesWithCinderVolumes-584005076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:45:27 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [req-7d3fb7d7-4c7c-4608-a384-3b4fcfd906ea req-21b57c34-888f-4d05-8120-246212551245 tempest-TestInstancesWithCinderVolumes-584005076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.034s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:45:27 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [req-7d3fb7d7-4c7c-4608-a384-3b4fcfd906ea req-21b57c34-888f-4d05-8120-246212551245 tempest-TestInstancesWithCinderVolumes-584005076 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362', 'name': 'volume-b7229c51-b135-4bf7-b03a-c85b483bbab5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c6fd3255-366f-4211-9f47-0f388c64a406', 'enforce_multipath': True} {{(pid=86310) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 14:45:28 devstack cinder-volume[86310]: INFO cinder.volume.manager [req-7d3fb7d7-4c7c-4608-a384-3b4fcfd906ea req-21b57c34-888f-4d05-8120-246212551245 tempest-TestInstancesWithCinderVolumes-584005076 None] attachment_update completed successfully. Sep 23 14:45:28 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [req-3e57bdce-b03a-4e09-8edf-d1e9e3848131 req-4615ab46-fba8-4e9c-86df-fa49b21ef488 tempest-TestServerVolumeAttachmentScenario-656438129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:45:28 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [req-3e57bdce-b03a-4e09-8edf-d1e9e3848131 req-4615ab46-fba8-4e9c-86df-fa49b21ef488 tempest-TestServerVolumeAttachmentScenario-656438129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:45:28 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [req-3e57bdce-b03a-4e09-8edf-d1e9e3848131 req-4615ab46-fba8-4e9c-86df-fa49b21ef488 tempest-TestServerVolumeAttachmentScenario-656438129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:45:28 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [req-3e57bdce-b03a-4e09-8edf-d1e9e3848131 req-4615ab46-fba8-4e9c-86df-fa49b21ef488 tempest-TestServerVolumeAttachmentScenario-656438129 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362', 'name': 'volume-f1fd58c0-5cbd-438c-ba6f-7b2022aa3736', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2d8b7f26-92c7-4bb7-bc7a-65a8d836c0ed', 'enforce_multipath': True} {{(pid=86310) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 14:45:28 devstack cinder-volume[86310]: INFO cinder.volume.manager [req-3e57bdce-b03a-4e09-8edf-d1e9e3848131 req-4615ab46-fba8-4e9c-86df-fa49b21ef488 tempest-TestServerVolumeAttachmentScenario-656438129 None] attachment_update completed successfully. Sep 23 14:45:28 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-4f6d8ed4-5d72-44dc-9ef1-5802c7ad4f39 tempest-VolumesSnapshotListTestJSON-824608936 None] Acquiring lock "cinder-bbcd2b4b-1d31-405f-883c-8488f4ec3563-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:45:28 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-4f6d8ed4-5d72-44dc-9ef1-5802c7ad4f39 tempest-VolumesSnapshotListTestJSON-824608936 None] Lock "cinder-bbcd2b4b-1d31-405f-883c-8488f4ec3563-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:45:28 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-4f6d8ed4-5d72-44dc-9ef1-5802c7ad4f39 tempest-VolumesSnapshotListTestJSON-824608936 None] Acquiring lock "cinder-quobyte-bbcd2b4b-1d31-405f-883c-8488f4ec3563" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:45:28 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-4f6d8ed4-5d72-44dc-9ef1-5802c7ad4f39 tempest-VolumesSnapshotListTestJSON-824608936 None] Lock "cinder-quobyte-bbcd2b4b-1d31-405f-883c-8488f4ec3563" acquired by "delete_volume" :: waited 0.030s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:45:28 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0fafbd4-446d-481d-8c77-8b3436b390a8]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:45:28 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-4f6d8ed4-5d72-44dc-9ef1-5802c7ad4f39 tempest-VolumesSnapshotListTestJSON-824608936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:45:28 devstack sudo[100099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563 Sep 23 14:45:28 devstack sudo[100099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:45:29 devstack sudo[100099]: pam_unix(sudo:session): session closed for user root Sep 23 14:45:29 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-4f6d8ed4-5d72-44dc-9ef1-5802c7ad4f39 tempest-VolumesSnapshotListTestJSON-824608936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563" returned: 0 in 0.522s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:45:29 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-4f6d8ed4-5d72-44dc-9ef1-5802c7ad4f39 tempest-VolumesSnapshotListTestJSON-824608936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:45:29 devstack sudo[100492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563 Sep 23 14:45:29 devstack sudo[100492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:45:29 devstack sudo[100492]: pam_unix(sudo:session): session closed for user root Sep 23 14:45:29 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-4f6d8ed4-5d72-44dc-9ef1-5802c7ad4f39 tempest-VolumesSnapshotListTestJSON-824608936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bbcd2b4b-1d31-405f-883c-8488f4ec3563" returned: 0 in 0.392s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:45:29 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-4f6d8ed4-5d72-44dc-9ef1-5802c7ad4f39 tempest-VolumesSnapshotListTestJSON-824608936 None] Lock "cinder-quobyte-bbcd2b4b-1d31-405f-883c-8488f4ec3563" released by "delete_volume" :: held 1.025s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:45:29 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-4f6d8ed4-5d72-44dc-9ef1-5802c7ad4f39 tempest-VolumesSnapshotListTestJSON-824608936 None] Created reservations ['4b9f3e74-eeb3-41ef-a49f-3ea67467b2c0', '656eaed3-0fc7-4594-995c-0a5ccec7348c', '05c14e65-5a64-474b-a53c-26dac6a2e365', '24aac7f7-70f1-4bf2-bf0d-9919cd2e41f1'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:45:29 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-4f6d8ed4-5d72-44dc-9ef1-5802c7ad4f39 tempest-VolumesSnapshotListTestJSON-824608936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:45:29 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-4f6d8ed4-5d72-44dc-9ef1-5802c7ad4f39 tempest-VolumesSnapshotListTestJSON-824608936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:45:29 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-4f6d8ed4-5d72-44dc-9ef1-5802c7ad4f39 tempest-VolumesSnapshotListTestJSON-824608936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:45:29 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-4f6d8ed4-5d72-44dc-9ef1-5802c7ad4f39 tempest-VolumesSnapshotListTestJSON-824608936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:45:29 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-4f6d8ed4-5d72-44dc-9ef1-5802c7ad4f39 tempest-VolumesSnapshotListTestJSON-824608936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:45:29 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-4f6d8ed4-5d72-44dc-9ef1-5802c7ad4f39 tempest-VolumesSnapshotListTestJSON-824608936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:45:29 devstack sudo[100495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:45:29 devstack sudo[100495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:45:30 devstack sudo[100495]: pam_unix(sudo:session): session closed for user root Sep 23 14:45:30 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-4f6d8ed4-5d72-44dc-9ef1-5802c7ad4f39 tempest-VolumesSnapshotListTestJSON-824608936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.331s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:45:30 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-4f6d8ed4-5d72-44dc-9ef1-5802c7ad4f39 tempest-VolumesSnapshotListTestJSON-824608936 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:45:30 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-4f6d8ed4-5d72-44dc-9ef1-5802c7ad4f39 tempest-VolumesSnapshotListTestJSON-824608936 None] Deleted volume successfully. Sep 23 14:45:30 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-4f6d8ed4-5d72-44dc-9ef1-5802c7ad4f39 tempest-VolumesSnapshotListTestJSON-824608936 None] Lock "cinder-bbcd2b4b-1d31-405f-883c-8488f4ec3563-delete_volume" released by "delete_volume" :: held 1.716s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:45:35 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [req-3467b875-56a8-4003-875b-d578ebc84ff2 req-c4089f6d-3abb-473b-a9f1-fcd9144d5a8d tempest-TestServerVolumeAttachmentScenario-656438129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:45:35 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [req-3467b875-56a8-4003-875b-d578ebc84ff2 req-c4089f6d-3abb-473b-a9f1-fcd9144d5a8d tempest-TestServerVolumeAttachmentScenario-656438129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:45:35 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [req-3467b875-56a8-4003-875b-d578ebc84ff2 req-c4089f6d-3abb-473b-a9f1-fcd9144d5a8d tempest-TestServerVolumeAttachmentScenario-656438129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:45:35 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [req-3467b875-56a8-4003-875b-d578ebc84ff2 req-c4089f6d-3abb-473b-a9f1-fcd9144d5a8d tempest-TestServerVolumeAttachmentScenario-656438129 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362', 'name': 'volume-12ea1d58-2c36-4830-9bf1-88d6434e9148', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7228f36c-a124-4e63-9b1e-bb7906847e40', 'enforce_multipath': True} {{(pid=86310) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 14:45:35 devstack cinder-volume[86310]: INFO cinder.volume.manager [req-3467b875-56a8-4003-875b-d578ebc84ff2 req-c4089f6d-3abb-473b-a9f1-fcd9144d5a8d tempest-TestServerVolumeAttachmentScenario-656438129 None] attachment_update completed successfully. Sep 23 14:45:37 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-50c319ac-25e8-4e2a-a17d-5763dce268b5 tempest-CreateVolumesFromImageTest-620200213 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:45:37 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-50c319ac-25e8-4e2a-a17d-5763dce268b5 tempest-CreateVolumesFromImageTest-620200213 None] Flow 'volume_create_manager' (57289768-72ba-4aeb-8eb4-9fdd672790f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:45:37 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-50c319ac-25e8-4e2a-a17d-5763dce268b5 tempest-CreateVolumesFromImageTest-620200213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6798934d-de1a-4d6f-b642-76d5cbd1d025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:45:37 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-50c319ac-25e8-4e2a-a17d-5763dce268b5 tempest-CreateVolumesFromImageTest-620200213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6798934d-de1a-4d6f-b642-76d5cbd1d025) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:45:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1801389044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a7022ca-fa9f-48ea-99ed-af491e00190e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2299c9c68649439c8b77cf21346da41e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:45:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:45:37Z,use_quota=True,user_id='942a446682ad42a4a9783500ffe1aa33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:45:37 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-50c319ac-25e8-4e2a-a17d-5763dce268b5 tempest-CreateVolumesFromImageTest-620200213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4640265f-7945-4d24-8780-d1269d59cb8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:45:37 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-50c319ac-25e8-4e2a-a17d-5763dce268b5 tempest-CreateVolumesFromImageTest-620200213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4640265f-7945-4d24-8780-d1269d59cb8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:45:37 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-50c319ac-25e8-4e2a-a17d-5763dce268b5 tempest-CreateVolumesFromImageTest-620200213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d78bb39-2847-4979-8a62-eec77d570165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:45:37 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-50c319ac-25e8-4e2a-a17d-5763dce268b5 tempest-CreateVolumesFromImageTest-620200213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d78bb39-2847-4979-8a62-eec77d570165) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a7022ca-fa9f-48ea-99ed-af491e00190e', 'volume_name': 'volume-8a7022ca-fa9f-48ea-99ed-af491e00190e', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:45:37 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-50c319ac-25e8-4e2a-a17d-5763dce268b5 tempest-CreateVolumesFromImageTest-620200213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (106c3a59-94fe-4416-ba2e-d7c8341b1e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:45:37 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-50c319ac-25e8-4e2a-a17d-5763dce268b5 tempest-CreateVolumesFromImageTest-620200213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (106c3a59-94fe-4416-ba2e-d7c8341b1e7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:45:37 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-50c319ac-25e8-4e2a-a17d-5763dce268b5 tempest-CreateVolumesFromImageTest-620200213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b534a0a2-06f6-4341-928c-668b7982b7f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:45:37 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-50c319ac-25e8-4e2a-a17d-5763dce268b5 tempest-CreateVolumesFromImageTest-620200213 None] Volume 8a7022ca-fa9f-48ea-99ed-af491e00190e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a7022ca-fa9f-48ea-99ed-af491e00190e', 'volume_size': 1} Sep 23 14:45:37 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-50c319ac-25e8-4e2a-a17d-5763dce268b5 tempest-CreateVolumesFromImageTest-620200213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:45:37 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-50c319ac-25e8-4e2a-a17d-5763dce268b5 tempest-CreateVolumesFromImageTest-620200213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:45:37 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-50c319ac-25e8-4e2a-a17d-5763dce268b5 tempest-CreateVolumesFromImageTest-620200213 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:45:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1801389044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a7022ca-fa9f-48ea-99ed-af491e00190e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2299c9c68649439c8b77cf21346da41e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:45:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:45:37Z,use_quota=True,user_id='942a446682ad42a4a9783500ffe1aa33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:45:37 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-50c319ac-25e8-4e2a-a17d-5763dce268b5 tempest-CreateVolumesFromImageTest-620200213 None] Creating volume 8a7022ca-fa9f-48ea-99ed-af491e00190e {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:45:37 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-50c319ac-25e8-4e2a-a17d-5763dce268b5 tempest-CreateVolumesFromImageTest-620200213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:45:37 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-50c319ac-25e8-4e2a-a17d-5763dce268b5 tempest-CreateVolumesFromImageTest-620200213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:45:37 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-50c319ac-25e8-4e2a-a17d-5763dce268b5 tempest-CreateVolumesFromImageTest-620200213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:45:37 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-50c319ac-25e8-4e2a-a17d-5763dce268b5 tempest-CreateVolumesFromImageTest-620200213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:45:37 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-50c319ac-25e8-4e2a-a17d-5763dce268b5 tempest-CreateVolumesFromImageTest-620200213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:45:37 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-50c319ac-25e8-4e2a-a17d-5763dce268b5 tempest-CreateVolumesFromImageTest-620200213 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:45:37 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-50c319ac-25e8-4e2a-a17d-5763dce268b5 tempest-CreateVolumesFromImageTest-620200213 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:45:37 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-50c319ac-25e8-4e2a-a17d-5763dce268b5 tempest-CreateVolumesFromImageTest-620200213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8a7022ca-fa9f-48ea-99ed-af491e00190e 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:45:37 devstack sudo[100597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8a7022ca-fa9f-48ea-99ed-af491e00190e 1073741824 Sep 23 14:45:37 devstack sudo[100597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:45:38 devstack cinder-volume[86310]: DEBUG dbcounter [-] [86310] Writing DB stats cinder:UPDATE=85,cinder:SELECT=84,cinder:DELETE=10,cinder:INSERT=27 {{(pid=86310) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 14:45:38 devstack cinder-volume[86310]: DEBUG dbcounter [-] [86310] Writing DB stats cinder:SELECT=100,cinder:UPDATE=83,cinder:INSERT=31,cinder:DELETE=5 {{(pid=86310) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 14:45:38 devstack cinder-volume[86310]: INFO cinder.volume.manager [req-13ac070b-7a17-46c7-9bf3-9feac2b701e1 req-289689a4-6018-4c72-9f8e-5c60c911bb0b tempest-TestServerVolumeAttachmentScenario-656438129 None] Terminate volume connection completed successfully. Sep 23 14:45:38 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [req-13ac070b-7a17-46c7-9bf3-9feac2b701e1 req-289689a4-6018-4c72-9f8e-5c60c911bb0b tempest-TestServerVolumeAttachmentScenario-656438129 None] Deleting attachment 7228f36c-a124-4e63-9b1e-bb7906847e40. {{(pid=86310) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 14:45:38 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc9805dd-df39-4e21-b0d1-c17e9aacf1eb tempest-CreateVolumesFromImageTest-620200213 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:45:38 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-fc9805dd-df39-4e21-b0d1-c17e9aacf1eb tempest-CreateVolumesFromImageTest-620200213 None] Flow 'volume_create_manager' (00d56746-f97f-4dbd-aafb-f62eadfdd491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:45:38 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-fc9805dd-df39-4e21-b0d1-c17e9aacf1eb tempest-CreateVolumesFromImageTest-620200213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cee3986-5e8c-4835-b871-176d57d8510d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:45:38 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-fc9805dd-df39-4e21-b0d1-c17e9aacf1eb tempest-CreateVolumesFromImageTest-620200213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cee3986-5e8c-4835-b871-176d57d8510d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:45:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-837220505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fc9d9aa-3be5-44cd-b5e1-b839f1869846,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2299c9c68649439c8b77cf21346da41e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:45:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:45:38Z,use_quota=True,user_id='942a446682ad42a4a9783500ffe1aa33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:45:38 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-fc9805dd-df39-4e21-b0d1-c17e9aacf1eb tempest-CreateVolumesFromImageTest-620200213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45bc09ec-2490-4a9b-bddf-98cbda0dec30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:45:38 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-fc9805dd-df39-4e21-b0d1-c17e9aacf1eb tempest-CreateVolumesFromImageTest-620200213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45bc09ec-2490-4a9b-bddf-98cbda0dec30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:45:38 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-fc9805dd-df39-4e21-b0d1-c17e9aacf1eb tempest-CreateVolumesFromImageTest-620200213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8487b687-0289-493c-ac0b-5d4e858b93d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:45:38 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-fc9805dd-df39-4e21-b0d1-c17e9aacf1eb tempest-CreateVolumesFromImageTest-620200213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8487b687-0289-493c-ac0b-5d4e858b93d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0fc9d9aa-3be5-44cd-b5e1-b839f1869846', 'volume_name': 'volume-0fc9d9aa-3be5-44cd-b5e1-b839f1869846', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:45:38 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-fc9805dd-df39-4e21-b0d1-c17e9aacf1eb tempest-CreateVolumesFromImageTest-620200213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3d0015c-f17f-478f-ae5c-809a20ef0245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:45:38 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-fc9805dd-df39-4e21-b0d1-c17e9aacf1eb tempest-CreateVolumesFromImageTest-620200213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3d0015c-f17f-478f-ae5c-809a20ef0245) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:45:38 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-fc9805dd-df39-4e21-b0d1-c17e9aacf1eb tempest-CreateVolumesFromImageTest-620200213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd40cba7-8fca-40b9-87aa-eabd346e99f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:45:38 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-fc9805dd-df39-4e21-b0d1-c17e9aacf1eb tempest-CreateVolumesFromImageTest-620200213 None] Volume 0fc9d9aa-3be5-44cd-b5e1-b839f1869846: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0fc9d9aa-3be5-44cd-b5e1-b839f1869846', 'volume_size': 1} Sep 23 14:45:38 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-fc9805dd-df39-4e21-b0d1-c17e9aacf1eb tempest-CreateVolumesFromImageTest-620200213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:45:38 devstack sudo[100597]: pam_unix(sudo:session): session closed for user root Sep 23 14:45:38 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-50c319ac-25e8-4e2a-a17d-5763dce268b5 tempest-CreateVolumesFromImageTest-620200213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8a7022ca-fa9f-48ea-99ed-af491e00190e 1073741824" returned: 0 in 1.176s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:45:38 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-50c319ac-25e8-4e2a-a17d-5763dce268b5 tempest-CreateVolumesFromImageTest-620200213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8a7022ca-fa9f-48ea-99ed-af491e00190e {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:45:38 devstack sudo[100605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8a7022ca-fa9f-48ea-99ed-af491e00190e Sep 23 14:45:38 devstack sudo[100605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:45:39 devstack sudo[100605]: pam_unix(sudo:session): session closed for user root Sep 23 14:45:39 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-50c319ac-25e8-4e2a-a17d-5763dce268b5 tempest-CreateVolumesFromImageTest-620200213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8a7022ca-fa9f-48ea-99ed-af491e00190e" returned: 0 in 0.492s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:45:39 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-50c319ac-25e8-4e2a-a17d-5763dce268b5 tempest-CreateVolumesFromImageTest-620200213 None] <== create_volume: return (1782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:45:39 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-50c319ac-25e8-4e2a-a17d-5763dce268b5 tempest-CreateVolumesFromImageTest-620200213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.791s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:45:39 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-fc9805dd-df39-4e21-b0d1-c17e9aacf1eb tempest-CreateVolumesFromImageTest-620200213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.649s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:45:39 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-fc9805dd-df39-4e21-b0d1-c17e9aacf1eb tempest-CreateVolumesFromImageTest-620200213 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:45:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-837220505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fc9d9aa-3be5-44cd-b5e1-b839f1869846,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2299c9c68649439c8b77cf21346da41e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:45:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:45:38Z,use_quota=True,user_id='942a446682ad42a4a9783500ffe1aa33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:45:39 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-fc9805dd-df39-4e21-b0d1-c17e9aacf1eb tempest-CreateVolumesFromImageTest-620200213 None] Creating volume 0fc9d9aa-3be5-44cd-b5e1-b839f1869846 {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:45:39 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-fc9805dd-df39-4e21-b0d1-c17e9aacf1eb tempest-CreateVolumesFromImageTest-620200213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:45:39 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-fc9805dd-df39-4e21-b0d1-c17e9aacf1eb tempest-CreateVolumesFromImageTest-620200213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:45:39 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-fc9805dd-df39-4e21-b0d1-c17e9aacf1eb tempest-CreateVolumesFromImageTest-620200213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:45:39 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-fc9805dd-df39-4e21-b0d1-c17e9aacf1eb tempest-CreateVolumesFromImageTest-620200213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:45:39 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-fc9805dd-df39-4e21-b0d1-c17e9aacf1eb tempest-CreateVolumesFromImageTest-620200213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:45:39 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-fc9805dd-df39-4e21-b0d1-c17e9aacf1eb tempest-CreateVolumesFromImageTest-620200213 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:45:39 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-fc9805dd-df39-4e21-b0d1-c17e9aacf1eb tempest-CreateVolumesFromImageTest-620200213 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:45:39 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-fc9805dd-df39-4e21-b0d1-c17e9aacf1eb tempest-CreateVolumesFromImageTest-620200213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-0fc9d9aa-3be5-44cd-b5e1-b839f1869846 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:45:39 devstack sudo[100608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-0fc9d9aa-3be5-44cd-b5e1-b839f1869846 1073741824 Sep 23 14:45:39 devstack sudo[100608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:45:39 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-50c319ac-25e8-4e2a-a17d-5763dce268b5 tempest-CreateVolumesFromImageTest-620200213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b534a0a2-06f6-4341-928c-668b7982b7f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a7022ca-fa9f-48ea-99ed-af491e00190e', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:45:39 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-50c319ac-25e8-4e2a-a17d-5763dce268b5 tempest-CreateVolumesFromImageTest-620200213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2f97b97-1d16-4716-b58f-b564d67c71fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:45:39 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-50c319ac-25e8-4e2a-a17d-5763dce268b5 tempest-CreateVolumesFromImageTest-620200213 None] Volume volume-8a7022ca-fa9f-48ea-99ed-af491e00190e (8a7022ca-fa9f-48ea-99ed-af491e00190e): created successfully Sep 23 14:45:39 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-50c319ac-25e8-4e2a-a17d-5763dce268b5 tempest-CreateVolumesFromImageTest-620200213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2f97b97-1d16-4716-b58f-b564d67c71fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:45:39 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-50c319ac-25e8-4e2a-a17d-5763dce268b5 tempest-CreateVolumesFromImageTest-620200213 None] Flow 'volume_create_manager' (57289768-72ba-4aeb-8eb4-9fdd672790f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:45:39 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-50c319ac-25e8-4e2a-a17d-5763dce268b5 tempest-CreateVolumesFromImageTest-620200213 None] Created volume successfully. Sep 23 14:45:39 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-488b40e1-70ae-4b51-9ad9-eb8d2cdaa383 tempest-CreateVolumesFromImageTest-620200213 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:45:39 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-488b40e1-70ae-4b51-9ad9-eb8d2cdaa383 tempest-CreateVolumesFromImageTest-620200213 None] Flow 'volume_create_manager' (d45f2f24-e03b-4235-a953-10388758080a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:45:39 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-488b40e1-70ae-4b51-9ad9-eb8d2cdaa383 tempest-CreateVolumesFromImageTest-620200213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f708c1dc-7543-46db-82d9-92d783c9b0dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:45:39 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-488b40e1-70ae-4b51-9ad9-eb8d2cdaa383 tempest-CreateVolumesFromImageTest-620200213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f708c1dc-7543-46db-82d9-92d783c9b0dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:45:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2082016459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2da4f0c5-9251-487c-81f7-07fc31bb901e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2299c9c68649439c8b77cf21346da41e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:45:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:45:40Z,use_quota=True,user_id='942a446682ad42a4a9783500ffe1aa33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:45:39 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-488b40e1-70ae-4b51-9ad9-eb8d2cdaa383 tempest-CreateVolumesFromImageTest-620200213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (841afe20-1a36-4a60-a3c5-d935dae98790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:45:39 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-488b40e1-70ae-4b51-9ad9-eb8d2cdaa383 tempest-CreateVolumesFromImageTest-620200213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (841afe20-1a36-4a60-a3c5-d935dae98790) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:45:39 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-488b40e1-70ae-4b51-9ad9-eb8d2cdaa383 tempest-CreateVolumesFromImageTest-620200213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (511f410f-3a45-4ba3-9299-c26e3f7878af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:45:39 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-488b40e1-70ae-4b51-9ad9-eb8d2cdaa383 tempest-CreateVolumesFromImageTest-620200213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (511f410f-3a45-4ba3-9299-c26e3f7878af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2da4f0c5-9251-487c-81f7-07fc31bb901e', 'volume_name': 'volume-2da4f0c5-9251-487c-81f7-07fc31bb901e', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:45:39 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-488b40e1-70ae-4b51-9ad9-eb8d2cdaa383 tempest-CreateVolumesFromImageTest-620200213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0b0e92f-3e3b-4dd6-bd31-8375cfcc5e8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:45:39 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-488b40e1-70ae-4b51-9ad9-eb8d2cdaa383 tempest-CreateVolumesFromImageTest-620200213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0b0e92f-3e3b-4dd6-bd31-8375cfcc5e8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:45:39 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-488b40e1-70ae-4b51-9ad9-eb8d2cdaa383 tempest-CreateVolumesFromImageTest-620200213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb05fe2c-7b09-4063-a89e-0fb1c1923703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:45:39 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-488b40e1-70ae-4b51-9ad9-eb8d2cdaa383 tempest-CreateVolumesFromImageTest-620200213 None] Volume 2da4f0c5-9251-487c-81f7-07fc31bb901e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2da4f0c5-9251-487c-81f7-07fc31bb901e', 'volume_size': 1} Sep 23 14:45:39 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-488b40e1-70ae-4b51-9ad9-eb8d2cdaa383 tempest-CreateVolumesFromImageTest-620200213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:45:40 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e54877b-db57-4dff-aa6b-1bfa506019da tempest-CreateVolumesFromImageTest-620200213 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:45:40 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-3e54877b-db57-4dff-aa6b-1bfa506019da tempest-CreateVolumesFromImageTest-620200213 None] Flow 'volume_create_manager' (f621ec83-f8f0-4be8-ba51-ef8931e1e44a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:45:40 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-3e54877b-db57-4dff-aa6b-1bfa506019da tempest-CreateVolumesFromImageTest-620200213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7f93f17-90c4-455f-9bca-21534a0bfb49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:45:40 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-3e54877b-db57-4dff-aa6b-1bfa506019da tempest-CreateVolumesFromImageTest-620200213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7f93f17-90c4-455f-9bca-21534a0bfb49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:45:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-414975135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a8b8b47-e3db-432a-a22f-789436be8606,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2299c9c68649439c8b77cf21346da41e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:45:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:45:40Z,use_quota=True,user_id='942a446682ad42a4a9783500ffe1aa33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:45:40 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-3e54877b-db57-4dff-aa6b-1bfa506019da tempest-CreateVolumesFromImageTest-620200213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75cf655b-ef20-4682-8539-ae1cdcc53067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:45:40 devstack sudo[100608]: pam_unix(sudo:session): session closed for user root Sep 23 14:45:40 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-3e54877b-db57-4dff-aa6b-1bfa506019da tempest-CreateVolumesFromImageTest-620200213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75cf655b-ef20-4682-8539-ae1cdcc53067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:45:40 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-3e54877b-db57-4dff-aa6b-1bfa506019da tempest-CreateVolumesFromImageTest-620200213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6733a7b-e92f-4e46-b58a-0d8b0d39cd4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:45:40 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-3e54877b-db57-4dff-aa6b-1bfa506019da tempest-CreateVolumesFromImageTest-620200213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6733a7b-e92f-4e46-b58a-0d8b0d39cd4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a8b8b47-e3db-432a-a22f-789436be8606', 'volume_name': 'volume-4a8b8b47-e3db-432a-a22f-789436be8606', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:45:40 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-3e54877b-db57-4dff-aa6b-1bfa506019da tempest-CreateVolumesFromImageTest-620200213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfc5202f-5100-4903-b284-952f23b64668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:45:40 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-3e54877b-db57-4dff-aa6b-1bfa506019da tempest-CreateVolumesFromImageTest-620200213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfc5202f-5100-4903-b284-952f23b64668) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:45:40 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-3e54877b-db57-4dff-aa6b-1bfa506019da tempest-CreateVolumesFromImageTest-620200213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b21ed1f6-ad58-4108-8cf1-55e3280fe40a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:45:40 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-3e54877b-db57-4dff-aa6b-1bfa506019da tempest-CreateVolumesFromImageTest-620200213 None] Volume 4a8b8b47-e3db-432a-a22f-789436be8606: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a8b8b47-e3db-432a-a22f-789436be8606', 'volume_size': 1} Sep 23 14:45:40 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-3e54877b-db57-4dff-aa6b-1bfa506019da tempest-CreateVolumesFromImageTest-620200213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:45:40 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-fc9805dd-df39-4e21-b0d1-c17e9aacf1eb tempest-CreateVolumesFromImageTest-620200213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-0fc9d9aa-3be5-44cd-b5e1-b839f1869846 1073741824" returned: 0 in 1.227s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:45:40 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-fc9805dd-df39-4e21-b0d1-c17e9aacf1eb tempest-CreateVolumesFromImageTest-620200213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-0fc9d9aa-3be5-44cd-b5e1-b839f1869846 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:45:40 devstack sudo[100614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-0fc9d9aa-3be5-44cd-b5e1-b839f1869846 Sep 23 14:45:40 devstack sudo[100614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:45:41 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5e8c216-fc5e-4bae-9663-b94e552f514a tempest-CreateVolumesFromImageTest-620200213 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:45:41 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-f5e8c216-fc5e-4bae-9663-b94e552f514a tempest-CreateVolumesFromImageTest-620200213 None] Flow 'volume_create_manager' (15345840-0a42-461f-920b-1e2153df7cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:45:41 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-f5e8c216-fc5e-4bae-9663-b94e552f514a tempest-CreateVolumesFromImageTest-620200213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (520f0a2e-af9f-4680-b22f-992e36983666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:45:41 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-f5e8c216-fc5e-4bae-9663-b94e552f514a tempest-CreateVolumesFromImageTest-620200213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (520f0a2e-af9f-4680-b22f-992e36983666) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:45:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1250641076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d85ca02-7e07-4c6a-94d5-9a565aa3777b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2299c9c68649439c8b77cf21346da41e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:45:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:45:41Z,use_quota=True,user_id='942a446682ad42a4a9783500ffe1aa33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:45:41 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-f5e8c216-fc5e-4bae-9663-b94e552f514a tempest-CreateVolumesFromImageTest-620200213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79822001-93de-46b5-a78a-02e42633ff02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:45:41 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-f5e8c216-fc5e-4bae-9663-b94e552f514a tempest-CreateVolumesFromImageTest-620200213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79822001-93de-46b5-a78a-02e42633ff02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:45:41 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-f5e8c216-fc5e-4bae-9663-b94e552f514a tempest-CreateVolumesFromImageTest-620200213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c99b028-8971-47ff-b599-8d02574c2661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:45:41 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-f5e8c216-fc5e-4bae-9663-b94e552f514a tempest-CreateVolumesFromImageTest-620200213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c99b028-8971-47ff-b599-8d02574c2661) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d85ca02-7e07-4c6a-94d5-9a565aa3777b', 'volume_name': 'volume-1d85ca02-7e07-4c6a-94d5-9a565aa3777b', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:45:41 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-f5e8c216-fc5e-4bae-9663-b94e552f514a tempest-CreateVolumesFromImageTest-620200213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75584e28-fbe9-4d8e-bb47-9aac50cc8cd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:45:41 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-f5e8c216-fc5e-4bae-9663-b94e552f514a tempest-CreateVolumesFromImageTest-620200213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75584e28-fbe9-4d8e-bb47-9aac50cc8cd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:45:41 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-f5e8c216-fc5e-4bae-9663-b94e552f514a tempest-CreateVolumesFromImageTest-620200213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7bd9130-4ca4-4f55-a6fc-7ba6c742d2a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:45:41 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-f5e8c216-fc5e-4bae-9663-b94e552f514a tempest-CreateVolumesFromImageTest-620200213 None] Volume 1d85ca02-7e07-4c6a-94d5-9a565aa3777b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d85ca02-7e07-4c6a-94d5-9a565aa3777b', 'volume_size': 1} Sep 23 14:45:41 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-f5e8c216-fc5e-4bae-9663-b94e552f514a tempest-CreateVolumesFromImageTest-620200213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:45:41 devstack cinder-volume[86310]: INFO cinder.volume.manager [req-4460bac5-3c4a-4dfd-a9c3-59422e6fe3c1 req-7c4263ff-e753-42e8-a112-084598d8ed1a tempest-TestServerVolumeAttachmentScenario-656438129 None] Terminate volume connection completed successfully. Sep 23 14:45:41 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [req-4460bac5-3c4a-4dfd-a9c3-59422e6fe3c1 req-7c4263ff-e753-42e8-a112-084598d8ed1a tempest-TestServerVolumeAttachmentScenario-656438129 None] Deleting attachment 2d8b7f26-92c7-4bb7-bc7a-65a8d836c0ed. {{(pid=86310) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 14:45:41 devstack sudo[100614]: pam_unix(sudo:session): session closed for user root Sep 23 14:45:41 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-fc9805dd-df39-4e21-b0d1-c17e9aacf1eb tempest-CreateVolumesFromImageTest-620200213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-0fc9d9aa-3be5-44cd-b5e1-b839f1869846" returned: 0 in 0.694s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:45:41 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-fc9805dd-df39-4e21-b0d1-c17e9aacf1eb tempest-CreateVolumesFromImageTest-620200213 None] <== create_volume: return (2009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:45:41 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-fc9805dd-df39-4e21-b0d1-c17e9aacf1eb tempest-CreateVolumesFromImageTest-620200213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.034s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:45:41 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-488b40e1-70ae-4b51-9ad9-eb8d2cdaa383 tempest-CreateVolumesFromImageTest-620200213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.562s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:45:41 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-488b40e1-70ae-4b51-9ad9-eb8d2cdaa383 tempest-CreateVolumesFromImageTest-620200213 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:45:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2082016459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2da4f0c5-9251-487c-81f7-07fc31bb901e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2299c9c68649439c8b77cf21346da41e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:45:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:45:40Z,use_quota=True,user_id='942a446682ad42a4a9783500ffe1aa33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:45:41 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-488b40e1-70ae-4b51-9ad9-eb8d2cdaa383 tempest-CreateVolumesFromImageTest-620200213 None] Creating volume 2da4f0c5-9251-487c-81f7-07fc31bb901e {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:45:41 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-488b40e1-70ae-4b51-9ad9-eb8d2cdaa383 tempest-CreateVolumesFromImageTest-620200213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:45:41 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-488b40e1-70ae-4b51-9ad9-eb8d2cdaa383 tempest-CreateVolumesFromImageTest-620200213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:45:41 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-488b40e1-70ae-4b51-9ad9-eb8d2cdaa383 tempest-CreateVolumesFromImageTest-620200213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:45:41 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-488b40e1-70ae-4b51-9ad9-eb8d2cdaa383 tempest-CreateVolumesFromImageTest-620200213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:45:41 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-488b40e1-70ae-4b51-9ad9-eb8d2cdaa383 tempest-CreateVolumesFromImageTest-620200213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:45:41 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-488b40e1-70ae-4b51-9ad9-eb8d2cdaa383 tempest-CreateVolumesFromImageTest-620200213 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:45:41 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-488b40e1-70ae-4b51-9ad9-eb8d2cdaa383 tempest-CreateVolumesFromImageTest-620200213 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:45:41 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-488b40e1-70ae-4b51-9ad9-eb8d2cdaa383 tempest-CreateVolumesFromImageTest-620200213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2da4f0c5-9251-487c-81f7-07fc31bb901e 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:45:41 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-fc9805dd-df39-4e21-b0d1-c17e9aacf1eb tempest-CreateVolumesFromImageTest-620200213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd40cba7-8fca-40b9-87aa-eabd346e99f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fc9d9aa-3be5-44cd-b5e1-b839f1869846', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:45:41 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-fc9805dd-df39-4e21-b0d1-c17e9aacf1eb tempest-CreateVolumesFromImageTest-620200213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89f9cfa5-efc6-4542-b804-1d456703a081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:45:41 devstack sudo[100619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2da4f0c5-9251-487c-81f7-07fc31bb901e 1073741824 Sep 23 14:45:41 devstack sudo[100619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:45:41 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-fc9805dd-df39-4e21-b0d1-c17e9aacf1eb tempest-CreateVolumesFromImageTest-620200213 None] Volume volume-0fc9d9aa-3be5-44cd-b5e1-b839f1869846 (0fc9d9aa-3be5-44cd-b5e1-b839f1869846): created successfully Sep 23 14:45:41 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-fc9805dd-df39-4e21-b0d1-c17e9aacf1eb tempest-CreateVolumesFromImageTest-620200213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89f9cfa5-efc6-4542-b804-1d456703a081) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:45:41 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-fc9805dd-df39-4e21-b0d1-c17e9aacf1eb tempest-CreateVolumesFromImageTest-620200213 None] Flow 'volume_create_manager' (00d56746-f97f-4dbd-aafb-f62eadfdd491) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:45:41 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-fc9805dd-df39-4e21-b0d1-c17e9aacf1eb tempest-CreateVolumesFromImageTest-620200213 None] Created volume successfully. Sep 23 14:45:42 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-42a482fe-fd69-4ce3-b99a-50e8e05f1c32 tempest-TestStampPattern-1114451325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:45:42 devstack sudo[100619]: pam_unix(sudo:session): session closed for user root Sep 23 14:45:42 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-42a482fe-fd69-4ce3-b99a-50e8e05f1c32 tempest-TestStampPattern-1114451325 None] Flow 'volume_create_manager' (9e40f0ee-7d00-41ed-9515-70c71c39b55a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:45:42 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-42a482fe-fd69-4ce3-b99a-50e8e05f1c32 tempest-TestStampPattern-1114451325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ba4f92c-fbdc-4612-96b1-4725aa81c407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:45:42 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-488b40e1-70ae-4b51-9ad9-eb8d2cdaa383 tempest-CreateVolumesFromImageTest-620200213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2da4f0c5-9251-487c-81f7-07fc31bb901e 1073741824" returned: 0 in 1.263s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:45:42 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-42a482fe-fd69-4ce3-b99a-50e8e05f1c32 tempest-TestStampPattern-1114451325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ba4f92c-fbdc-4612-96b1-4725aa81c407) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:45:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-40990852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b48b56ce-ca56-4a1f-a71a-0c0613fd3960,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ded8fdf474e4fb08781afe95d47c048',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:45:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:45:42Z,use_quota=True,user_id='17f408cc27fa415a95492cad829abe52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:45:42 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-42a482fe-fd69-4ce3-b99a-50e8e05f1c32 tempest-TestStampPattern-1114451325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (393523be-980b-4d39-bd07-bddc739875c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:45:42 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-42a482fe-fd69-4ce3-b99a-50e8e05f1c32 tempest-TestStampPattern-1114451325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (393523be-980b-4d39-bd07-bddc739875c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:45:42 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-42a482fe-fd69-4ce3-b99a-50e8e05f1c32 tempest-TestStampPattern-1114451325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7a59153-df14-4880-a379-7afd1413fd20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:45:42 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-42a482fe-fd69-4ce3-b99a-50e8e05f1c32 tempest-TestStampPattern-1114451325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7a59153-df14-4880-a379-7afd1413fd20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b48b56ce-ca56-4a1f-a71a-0c0613fd3960', 'volume_name': 'volume-b48b56ce-ca56-4a1f-a71a-0c0613fd3960', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:45:42 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-42a482fe-fd69-4ce3-b99a-50e8e05f1c32 tempest-TestStampPattern-1114451325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d50e4ae-d6a9-47b8-9454-62048f6196bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:45:42 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-42a482fe-fd69-4ce3-b99a-50e8e05f1c32 tempest-TestStampPattern-1114451325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d50e4ae-d6a9-47b8-9454-62048f6196bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:45:42 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-42a482fe-fd69-4ce3-b99a-50e8e05f1c32 tempest-TestStampPattern-1114451325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3780a753-ba32-44f8-a767-1c8fd492b5e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:45:42 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-42a482fe-fd69-4ce3-b99a-50e8e05f1c32 tempest-TestStampPattern-1114451325 None] Volume b48b56ce-ca56-4a1f-a71a-0c0613fd3960: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b48b56ce-ca56-4a1f-a71a-0c0613fd3960', 'volume_size': 1} Sep 23 14:45:42 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-42a482fe-fd69-4ce3-b99a-50e8e05f1c32 tempest-TestStampPattern-1114451325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:45:42 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-488b40e1-70ae-4b51-9ad9-eb8d2cdaa383 tempest-CreateVolumesFromImageTest-620200213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2da4f0c5-9251-487c-81f7-07fc31bb901e {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:45:42 devstack sudo[100629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2da4f0c5-9251-487c-81f7-07fc31bb901e Sep 23 14:45:42 devstack sudo[100629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:45:43 devstack sudo[100629]: pam_unix(sudo:session): session closed for user root Sep 23 14:45:43 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-488b40e1-70ae-4b51-9ad9-eb8d2cdaa383 tempest-CreateVolumesFromImageTest-620200213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2da4f0c5-9251-487c-81f7-07fc31bb901e" returned: 0 in 0.652s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:45:43 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-488b40e1-70ae-4b51-9ad9-eb8d2cdaa383 tempest-CreateVolumesFromImageTest-620200213 None] <== create_volume: return (2057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:45:43 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-488b40e1-70ae-4b51-9ad9-eb8d2cdaa383 tempest-CreateVolumesFromImageTest-620200213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.062s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:45:43 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-3e54877b-db57-4dff-aa6b-1bfa506019da tempest-CreateVolumesFromImageTest-620200213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.825s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:45:43 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-3e54877b-db57-4dff-aa6b-1bfa506019da tempest-CreateVolumesFromImageTest-620200213 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:45:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-414975135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a8b8b47-e3db-432a-a22f-789436be8606,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2299c9c68649439c8b77cf21346da41e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:45:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:45:40Z,use_quota=True,user_id='942a446682ad42a4a9783500ffe1aa33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:45:43 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-3e54877b-db57-4dff-aa6b-1bfa506019da tempest-CreateVolumesFromImageTest-620200213 None] Creating volume 4a8b8b47-e3db-432a-a22f-789436be8606 {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:45:43 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-3e54877b-db57-4dff-aa6b-1bfa506019da tempest-CreateVolumesFromImageTest-620200213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:45:43 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-3e54877b-db57-4dff-aa6b-1bfa506019da tempest-CreateVolumesFromImageTest-620200213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:45:43 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-3e54877b-db57-4dff-aa6b-1bfa506019da tempest-CreateVolumesFromImageTest-620200213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:45:43 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-3e54877b-db57-4dff-aa6b-1bfa506019da tempest-CreateVolumesFromImageTest-620200213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:45:43 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-3e54877b-db57-4dff-aa6b-1bfa506019da tempest-CreateVolumesFromImageTest-620200213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:45:43 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-3e54877b-db57-4dff-aa6b-1bfa506019da tempest-CreateVolumesFromImageTest-620200213 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:45:43 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-3e54877b-db57-4dff-aa6b-1bfa506019da tempest-CreateVolumesFromImageTest-620200213 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:45:43 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-3e54877b-db57-4dff-aa6b-1bfa506019da tempest-CreateVolumesFromImageTest-620200213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4a8b8b47-e3db-432a-a22f-789436be8606 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:45:43 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-488b40e1-70ae-4b51-9ad9-eb8d2cdaa383 tempest-CreateVolumesFromImageTest-620200213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb05fe2c-7b09-4063-a89e-0fb1c1923703) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2da4f0c5-9251-487c-81f7-07fc31bb901e', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:45:43 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-488b40e1-70ae-4b51-9ad9-eb8d2cdaa383 tempest-CreateVolumesFromImageTest-620200213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e79e10c3-e5a2-4ea9-a1b3-112b0fe793d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:45:43 devstack sudo[100648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4a8b8b47-e3db-432a-a22f-789436be8606 1073741824 Sep 23 14:45:43 devstack sudo[100648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:45:43 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-488b40e1-70ae-4b51-9ad9-eb8d2cdaa383 tempest-CreateVolumesFromImageTest-620200213 None] Volume volume-2da4f0c5-9251-487c-81f7-07fc31bb901e (2da4f0c5-9251-487c-81f7-07fc31bb901e): created successfully Sep 23 14:45:43 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-488b40e1-70ae-4b51-9ad9-eb8d2cdaa383 tempest-CreateVolumesFromImageTest-620200213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e79e10c3-e5a2-4ea9-a1b3-112b0fe793d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:45:43 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-488b40e1-70ae-4b51-9ad9-eb8d2cdaa383 tempest-CreateVolumesFromImageTest-620200213 None] Flow 'volume_create_manager' (d45f2f24-e03b-4235-a953-10388758080a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:45:43 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-488b40e1-70ae-4b51-9ad9-eb8d2cdaa383 tempest-CreateVolumesFromImageTest-620200213 None] Created volume successfully. Sep 23 14:45:44 devstack sudo[100648]: pam_unix(sudo:session): session closed for user root Sep 23 14:45:44 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-3e54877b-db57-4dff-aa6b-1bfa506019da tempest-CreateVolumesFromImageTest-620200213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4a8b8b47-e3db-432a-a22f-789436be8606 1073741824" returned: 0 in 0.836s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:45:44 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-3e54877b-db57-4dff-aa6b-1bfa506019da tempest-CreateVolumesFromImageTest-620200213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4a8b8b47-e3db-432a-a22f-789436be8606 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:45:44 devstack sudo[100656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4a8b8b47-e3db-432a-a22f-789436be8606 Sep 23 14:45:44 devstack sudo[100656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:45:44 devstack sudo[100656]: pam_unix(sudo:session): session closed for user root Sep 23 14:45:44 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-3e54877b-db57-4dff-aa6b-1bfa506019da tempest-CreateVolumesFromImageTest-620200213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4a8b8b47-e3db-432a-a22f-789436be8606" returned: 0 in 0.357s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:45:44 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-3e54877b-db57-4dff-aa6b-1bfa506019da tempest-CreateVolumesFromImageTest-620200213 None] <== create_volume: return (1335ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:45:44 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-3e54877b-db57-4dff-aa6b-1bfa506019da tempest-CreateVolumesFromImageTest-620200213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.340s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:45:44 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-f5e8c216-fc5e-4bae-9663-b94e552f514a tempest-CreateVolumesFromImageTest-620200213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.474s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:45:44 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-f5e8c216-fc5e-4bae-9663-b94e552f514a tempest-CreateVolumesFromImageTest-620200213 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:45:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1250641076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d85ca02-7e07-4c6a-94d5-9a565aa3777b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2299c9c68649439c8b77cf21346da41e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:45:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:45:41Z,use_quota=True,user_id='942a446682ad42a4a9783500ffe1aa33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:45:44 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-f5e8c216-fc5e-4bae-9663-b94e552f514a tempest-CreateVolumesFromImageTest-620200213 None] Creating volume 1d85ca02-7e07-4c6a-94d5-9a565aa3777b {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:45:44 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-f5e8c216-fc5e-4bae-9663-b94e552f514a tempest-CreateVolumesFromImageTest-620200213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:45:44 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-f5e8c216-fc5e-4bae-9663-b94e552f514a tempest-CreateVolumesFromImageTest-620200213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:45:44 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-f5e8c216-fc5e-4bae-9663-b94e552f514a tempest-CreateVolumesFromImageTest-620200213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:45:44 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-f5e8c216-fc5e-4bae-9663-b94e552f514a tempest-CreateVolumesFromImageTest-620200213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:45:44 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-f5e8c216-fc5e-4bae-9663-b94e552f514a tempest-CreateVolumesFromImageTest-620200213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:45:44 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-f5e8c216-fc5e-4bae-9663-b94e552f514a tempest-CreateVolumesFromImageTest-620200213 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:45:44 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-f5e8c216-fc5e-4bae-9663-b94e552f514a tempest-CreateVolumesFromImageTest-620200213 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:45:44 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-f5e8c216-fc5e-4bae-9663-b94e552f514a tempest-CreateVolumesFromImageTest-620200213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-1d85ca02-7e07-4c6a-94d5-9a565aa3777b 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:45:44 devstack sudo[100659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-1d85ca02-7e07-4c6a-94d5-9a565aa3777b 1073741824 Sep 23 14:45:44 devstack sudo[100659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:45:44 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-3e54877b-db57-4dff-aa6b-1bfa506019da tempest-CreateVolumesFromImageTest-620200213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b21ed1f6-ad58-4108-8cf1-55e3280fe40a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a8b8b47-e3db-432a-a22f-789436be8606', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:45:44 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-3e54877b-db57-4dff-aa6b-1bfa506019da tempest-CreateVolumesFromImageTest-620200213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ef64aa9-92d3-41e4-946a-6c7e1d3ea4b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:45:44 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-3e54877b-db57-4dff-aa6b-1bfa506019da tempest-CreateVolumesFromImageTest-620200213 None] Volume volume-4a8b8b47-e3db-432a-a22f-789436be8606 (4a8b8b47-e3db-432a-a22f-789436be8606): created successfully Sep 23 14:45:44 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-3e54877b-db57-4dff-aa6b-1bfa506019da tempest-CreateVolumesFromImageTest-620200213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ef64aa9-92d3-41e4-946a-6c7e1d3ea4b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:45:44 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-3e54877b-db57-4dff-aa6b-1bfa506019da tempest-CreateVolumesFromImageTest-620200213 None] Flow 'volume_create_manager' (f621ec83-f8f0-4be8-ba51-ef8931e1e44a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:45:44 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-3e54877b-db57-4dff-aa6b-1bfa506019da tempest-CreateVolumesFromImageTest-620200213 None] Created volume successfully. Sep 23 14:45:45 devstack sudo[100659]: pam_unix(sudo:session): session closed for user root Sep 23 14:45:45 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-f5e8c216-fc5e-4bae-9663-b94e552f514a tempest-CreateVolumesFromImageTest-620200213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-1d85ca02-7e07-4c6a-94d5-9a565aa3777b 1073741824" returned: 0 in 0.699s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:45:45 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-f5e8c216-fc5e-4bae-9663-b94e552f514a tempest-CreateVolumesFromImageTest-620200213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-1d85ca02-7e07-4c6a-94d5-9a565aa3777b {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:45:45 devstack sudo[100668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-1d85ca02-7e07-4c6a-94d5-9a565aa3777b Sep 23 14:45:45 devstack sudo[100668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:45:45 devstack sudo[100668]: pam_unix(sudo:session): session closed for user root Sep 23 14:45:45 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-f5e8c216-fc5e-4bae-9663-b94e552f514a tempest-CreateVolumesFromImageTest-620200213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-1d85ca02-7e07-4c6a-94d5-9a565aa3777b" returned: 0 in 0.371s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:45:45 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-f5e8c216-fc5e-4bae-9663-b94e552f514a tempest-CreateVolumesFromImageTest-620200213 None] <== create_volume: return (1135ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:45:45 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-f5e8c216-fc5e-4bae-9663-b94e552f514a tempest-CreateVolumesFromImageTest-620200213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.146s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:45:45 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-42a482fe-fd69-4ce3-b99a-50e8e05f1c32 tempest-TestStampPattern-1114451325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.203s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:45:45 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-42a482fe-fd69-4ce3-b99a-50e8e05f1c32 tempest-TestStampPattern-1114451325 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:45:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-40990852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b48b56ce-ca56-4a1f-a71a-0c0613fd3960,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ded8fdf474e4fb08781afe95d47c048',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:45:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:45:42Z,use_quota=True,user_id='17f408cc27fa415a95492cad829abe52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:45:45 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-42a482fe-fd69-4ce3-b99a-50e8e05f1c32 tempest-TestStampPattern-1114451325 None] Creating volume b48b56ce-ca56-4a1f-a71a-0c0613fd3960 {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:45:45 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-42a482fe-fd69-4ce3-b99a-50e8e05f1c32 tempest-TestStampPattern-1114451325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:45:45 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-42a482fe-fd69-4ce3-b99a-50e8e05f1c32 tempest-TestStampPattern-1114451325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:45:45 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-42a482fe-fd69-4ce3-b99a-50e8e05f1c32 tempest-TestStampPattern-1114451325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:45:45 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-42a482fe-fd69-4ce3-b99a-50e8e05f1c32 tempest-TestStampPattern-1114451325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:45:45 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-42a482fe-fd69-4ce3-b99a-50e8e05f1c32 tempest-TestStampPattern-1114451325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:45:45 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-42a482fe-fd69-4ce3-b99a-50e8e05f1c32 tempest-TestStampPattern-1114451325 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:45:45 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-42a482fe-fd69-4ce3-b99a-50e8e05f1c32 tempest-TestStampPattern-1114451325 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:45:45 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-42a482fe-fd69-4ce3-b99a-50e8e05f1c32 tempest-TestStampPattern-1114451325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b48b56ce-ca56-4a1f-a71a-0c0613fd3960 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:45:46 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-f5e8c216-fc5e-4bae-9663-b94e552f514a tempest-CreateVolumesFromImageTest-620200213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7bd9130-4ca4-4f55-a6fc-7ba6c742d2a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d85ca02-7e07-4c6a-94d5-9a565aa3777b', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:45:46 devstack sudo[100672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b48b56ce-ca56-4a1f-a71a-0c0613fd3960 1073741824 Sep 23 14:45:46 devstack sudo[100672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:45:46 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-f5e8c216-fc5e-4bae-9663-b94e552f514a tempest-CreateVolumesFromImageTest-620200213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c03002e-53bd-4995-ba7f-04e4a1f5a7b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:45:46 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-f5e8c216-fc5e-4bae-9663-b94e552f514a tempest-CreateVolumesFromImageTest-620200213 None] Volume volume-1d85ca02-7e07-4c6a-94d5-9a565aa3777b (1d85ca02-7e07-4c6a-94d5-9a565aa3777b): created successfully Sep 23 14:45:46 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-f5e8c216-fc5e-4bae-9663-b94e552f514a tempest-CreateVolumesFromImageTest-620200213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c03002e-53bd-4995-ba7f-04e4a1f5a7b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:45:46 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-f5e8c216-fc5e-4bae-9663-b94e552f514a tempest-CreateVolumesFromImageTest-620200213 None] Flow 'volume_create_manager' (15345840-0a42-461f-920b-1e2153df7cec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:45:46 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-f5e8c216-fc5e-4bae-9663-b94e552f514a tempest-CreateVolumesFromImageTest-620200213 None] Created volume successfully. Sep 23 14:45:47 devstack sudo[100672]: pam_unix(sudo:session): session closed for user root Sep 23 14:45:47 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-42a482fe-fd69-4ce3-b99a-50e8e05f1c32 tempest-TestStampPattern-1114451325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b48b56ce-ca56-4a1f-a71a-0c0613fd3960 1073741824" returned: 0 in 1.264s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:45:47 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-42a482fe-fd69-4ce3-b99a-50e8e05f1c32 tempest-TestStampPattern-1114451325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b48b56ce-ca56-4a1f-a71a-0c0613fd3960 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:45:47 devstack sudo[100682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b48b56ce-ca56-4a1f-a71a-0c0613fd3960 Sep 23 14:45:47 devstack sudo[100682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:45:47 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-414b2d77-364f-4ccd-9b58-862e0e52f086 tempest-CreateVolumesFromImageTest-620200213 None] Acquiring lock "cinder-1d85ca02-7e07-4c6a-94d5-9a565aa3777b-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:45:47 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-414b2d77-364f-4ccd-9b58-862e0e52f086 tempest-CreateVolumesFromImageTest-620200213 None] Lock "cinder-1d85ca02-7e07-4c6a-94d5-9a565aa3777b-delete_volume" acquired by "delete_volume" :: waited 0.085s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:45:47 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-414b2d77-364f-4ccd-9b58-862e0e52f086 tempest-CreateVolumesFromImageTest-620200213 None] Acquiring lock "cinder-quobyte-1d85ca02-7e07-4c6a-94d5-9a565aa3777b" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:45:47 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-414b2d77-364f-4ccd-9b58-862e0e52f086 tempest-CreateVolumesFromImageTest-620200213 None] Lock "cinder-quobyte-1d85ca02-7e07-4c6a-94d5-9a565aa3777b" acquired by "delete_volume" :: waited 0.042s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:45:47 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[485151ff-5bd5-4c4a-bd34-20d57fc57cda]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:45:47 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-414b2d77-364f-4ccd-9b58-862e0e52f086 tempest-CreateVolumesFromImageTest-620200213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-1d85ca02-7e07-4c6a-94d5-9a565aa3777b {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:45:47 devstack sudo[100682]: pam_unix(sudo:session): session closed for user root Sep 23 14:45:47 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-42a482fe-fd69-4ce3-b99a-50e8e05f1c32 tempest-TestStampPattern-1114451325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b48b56ce-ca56-4a1f-a71a-0c0613fd3960" returned: 0 in 0.663s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:45:47 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-42a482fe-fd69-4ce3-b99a-50e8e05f1c32 tempest-TestStampPattern-1114451325 None] <== create_volume: return (2052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:45:47 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-42a482fe-fd69-4ce3-b99a-50e8e05f1c32 tempest-TestStampPattern-1114451325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.058s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:45:48 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-42a482fe-fd69-4ce3-b99a-50e8e05f1c32 tempest-TestStampPattern-1114451325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3780a753-ba32-44f8-a767-1c8fd492b5e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b48b56ce-ca56-4a1f-a71a-0c0613fd3960', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:45:48 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-42a482fe-fd69-4ce3-b99a-50e8e05f1c32 tempest-TestStampPattern-1114451325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (184a3668-103b-410b-9ad7-96b49663a05d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:45:48 devstack sudo[100684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-1d85ca02-7e07-4c6a-94d5-9a565aa3777b Sep 23 14:45:48 devstack sudo[100684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:45:48 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-42a482fe-fd69-4ce3-b99a-50e8e05f1c32 tempest-TestStampPattern-1114451325 None] Volume volume-b48b56ce-ca56-4a1f-a71a-0c0613fd3960 (b48b56ce-ca56-4a1f-a71a-0c0613fd3960): created successfully Sep 23 14:45:48 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-42a482fe-fd69-4ce3-b99a-50e8e05f1c32 tempest-TestStampPattern-1114451325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (184a3668-103b-410b-9ad7-96b49663a05d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:45:48 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-42a482fe-fd69-4ce3-b99a-50e8e05f1c32 tempest-TestStampPattern-1114451325 None] Flow 'volume_create_manager' (9e40f0ee-7d00-41ed-9515-70c71c39b55a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:45:48 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-42a482fe-fd69-4ce3-b99a-50e8e05f1c32 tempest-TestStampPattern-1114451325 None] Created volume successfully. Sep 23 14:45:48 devstack sudo[100684]: pam_unix(sudo:session): session closed for user root Sep 23 14:45:48 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-414b2d77-364f-4ccd-9b58-862e0e52f086 tempest-CreateVolumesFromImageTest-620200213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-1d85ca02-7e07-4c6a-94d5-9a565aa3777b" returned: 0 in 0.686s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:45:48 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-414b2d77-364f-4ccd-9b58-862e0e52f086 tempest-CreateVolumesFromImageTest-620200213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-1d85ca02-7e07-4c6a-94d5-9a565aa3777b {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:45:48 devstack sudo[100691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-1d85ca02-7e07-4c6a-94d5-9a565aa3777b Sep 23 14:45:48 devstack sudo[100691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:45:49 devstack sudo[100691]: pam_unix(sudo:session): session closed for user root Sep 23 14:45:49 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-414b2d77-364f-4ccd-9b58-862e0e52f086 tempest-CreateVolumesFromImageTest-620200213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-1d85ca02-7e07-4c6a-94d5-9a565aa3777b" returned: 0 in 0.564s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:45:49 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-414b2d77-364f-4ccd-9b58-862e0e52f086 tempest-CreateVolumesFromImageTest-620200213 None] Lock "cinder-quobyte-1d85ca02-7e07-4c6a-94d5-9a565aa3777b" released by "delete_volume" :: held 1.340s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:45:49 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-414b2d77-364f-4ccd-9b58-862e0e52f086 tempest-CreateVolumesFromImageTest-620200213 None] Created reservations ['c2571c90-da32-4f55-9dda-00f4a30b9f54', '16d3bf7f-44d9-4e86-9eb1-cd2a5f0d1e84', '92199ced-19bf-4fd6-9f08-ad59b537cd4e', '53af43f5-d156-4d08-8fea-d34c614d1b86'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:45:49 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-414b2d77-364f-4ccd-9b58-862e0e52f086 tempest-CreateVolumesFromImageTest-620200213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:45:49 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-414b2d77-364f-4ccd-9b58-862e0e52f086 tempest-CreateVolumesFromImageTest-620200213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:45:49 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-414b2d77-364f-4ccd-9b58-862e0e52f086 tempest-CreateVolumesFromImageTest-620200213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:45:49 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-414b2d77-364f-4ccd-9b58-862e0e52f086 tempest-CreateVolumesFromImageTest-620200213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:45:49 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-414b2d77-364f-4ccd-9b58-862e0e52f086 tempest-CreateVolumesFromImageTest-620200213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:45:49 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-414b2d77-364f-4ccd-9b58-862e0e52f086 tempest-CreateVolumesFromImageTest-620200213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:45:49 devstack sudo[100719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:45:49 devstack sudo[100719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:45:49 devstack sudo[100719]: pam_unix(sudo:session): session closed for user root Sep 23 14:45:49 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-2d6c3050-9a82-444b-97d6-0af44f5f35d1 tempest-TestServerVolumeAttachmentScenario-656438129 None] Acquiring lock "cinder-12ea1d58-2c36-4830-9bf1-88d6434e9148-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:45:49 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-414b2d77-364f-4ccd-9b58-862e0e52f086 tempest-CreateVolumesFromImageTest-620200213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.408s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:45:49 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-414b2d77-364f-4ccd-9b58-862e0e52f086 tempest-CreateVolumesFromImageTest-620200213 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:45:49 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-2d6c3050-9a82-444b-97d6-0af44f5f35d1 tempest-TestServerVolumeAttachmentScenario-656438129 None] Lock "cinder-12ea1d58-2c36-4830-9bf1-88d6434e9148-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:45:49 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-414b2d77-364f-4ccd-9b58-862e0e52f086 tempest-CreateVolumesFromImageTest-620200213 None] Deleted volume successfully. Sep 23 14:45:49 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-414b2d77-364f-4ccd-9b58-862e0e52f086 tempest-CreateVolumesFromImageTest-620200213 None] Lock "cinder-1d85ca02-7e07-4c6a-94d5-9a565aa3777b-delete_volume" released by "delete_volume" :: held 2.273s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:45:49 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-2d6c3050-9a82-444b-97d6-0af44f5f35d1 tempest-TestServerVolumeAttachmentScenario-656438129 None] Acquiring lock "cinder-quobyte-12ea1d58-2c36-4830-9bf1-88d6434e9148" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:45:49 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-2d6c3050-9a82-444b-97d6-0af44f5f35d1 tempest-TestServerVolumeAttachmentScenario-656438129 None] Lock "cinder-quobyte-12ea1d58-2c36-4830-9bf1-88d6434e9148" acquired by "delete_volume" :: waited 0.031s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:45:49 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[e85b360c-0075-4334-a1a6-4625d49071ca]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:45:49 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-2d6c3050-9a82-444b-97d6-0af44f5f35d1 tempest-TestServerVolumeAttachmentScenario-656438129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-12ea1d58-2c36-4830-9bf1-88d6434e9148 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:45:50 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-a2e6b873-559a-463d-81b1-675b511d546e tempest-CreateVolumesFromImageTest-620200213 None] Acquiring lock "cinder-4a8b8b47-e3db-432a-a22f-789436be8606-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:45:50 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-a2e6b873-559a-463d-81b1-675b511d546e tempest-CreateVolumesFromImageTest-620200213 None] Lock "cinder-4a8b8b47-e3db-432a-a22f-789436be8606-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:45:50 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-a2e6b873-559a-463d-81b1-675b511d546e tempest-CreateVolumesFromImageTest-620200213 None] Acquiring lock "cinder-quobyte-4a8b8b47-e3db-432a-a22f-789436be8606" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:45:50 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-a2e6b873-559a-463d-81b1-675b511d546e tempest-CreateVolumesFromImageTest-620200213 None] Lock "cinder-quobyte-4a8b8b47-e3db-432a-a22f-789436be8606" acquired by "delete_volume" :: waited 0.027s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:45:50 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[034e1dc1-719a-4e4d-a3df-7e161bc42eaf]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:45:50 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a2e6b873-559a-463d-81b1-675b511d546e tempest-CreateVolumesFromImageTest-620200213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4a8b8b47-e3db-432a-a22f-789436be8606 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:45:50 devstack sudo[100726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-12ea1d58-2c36-4830-9bf1-88d6434e9148 Sep 23 14:45:50 devstack sudo[100726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:45:50 devstack sudo[100736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4a8b8b47-e3db-432a-a22f-789436be8606 Sep 23 14:45:50 devstack sudo[100736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:45:50 devstack sudo[100726]: pam_unix(sudo:session): session closed for user root Sep 23 14:45:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-2d6c3050-9a82-444b-97d6-0af44f5f35d1 tempest-TestServerVolumeAttachmentScenario-656438129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-12ea1d58-2c36-4830-9bf1-88d6434e9148" returned: 0 in 1.013s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:45:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-2d6c3050-9a82-444b-97d6-0af44f5f35d1 tempest-TestServerVolumeAttachmentScenario-656438129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-12ea1d58-2c36-4830-9bf1-88d6434e9148 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:45:51 devstack sudo[100751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-12ea1d58-2c36-4830-9bf1-88d6434e9148 Sep 23 14:45:51 devstack sudo[100751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:45:51 devstack sudo[100736]: pam_unix(sudo:session): session closed for user root Sep 23 14:45:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a2e6b873-559a-463d-81b1-675b511d546e tempest-CreateVolumesFromImageTest-620200213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4a8b8b47-e3db-432a-a22f-789436be8606" returned: 0 in 0.757s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:45:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a2e6b873-559a-463d-81b1-675b511d546e tempest-CreateVolumesFromImageTest-620200213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4a8b8b47-e3db-432a-a22f-789436be8606 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:45:51 devstack sudo[100753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4a8b8b47-e3db-432a-a22f-789436be8606 Sep 23 14:45:51 devstack sudo[100753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:45:51 devstack cinder-volume[86310]: DEBUG oslo_service.periodic_task [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86310) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 14:45:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:45:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:45:51 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:45:51 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:45:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:45:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:45:51 devstack sudo[100751]: pam_unix(sudo:session): session closed for user root Sep 23 14:45:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-2d6c3050-9a82-444b-97d6-0af44f5f35d1 tempest-TestServerVolumeAttachmentScenario-656438129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-12ea1d58-2c36-4830-9bf1-88d6434e9148" returned: 0 in 0.480s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:45:51 devstack sudo[100756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:45:51 devstack sudo[100756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:45:51 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-2d6c3050-9a82-444b-97d6-0af44f5f35d1 tempest-TestServerVolumeAttachmentScenario-656438129 None] Lock "cinder-quobyte-12ea1d58-2c36-4830-9bf1-88d6434e9148" released by "delete_volume" :: held 1.646s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:45:51 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-2d6c3050-9a82-444b-97d6-0af44f5f35d1 tempest-TestServerVolumeAttachmentScenario-656438129 None] Created reservations ['6984c51d-0a91-4f51-b3d1-3cea7f9c0a4b', '97bad420-8d5f-40d9-a556-d3f0822ddbb4', 'e9dbaf23-8d8a-4186-b2d4-adab1606828a', '55909388-8d9e-4e1e-a39b-9d46212b77e8'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:45:51 devstack sudo[100753]: pam_unix(sudo:session): session closed for user root Sep 23 14:45:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a2e6b873-559a-463d-81b1-675b511d546e tempest-CreateVolumesFromImageTest-620200213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4a8b8b47-e3db-432a-a22f-789436be8606" returned: 0 in 0.583s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:45:51 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-a2e6b873-559a-463d-81b1-675b511d546e tempest-CreateVolumesFromImageTest-620200213 None] Lock "cinder-quobyte-4a8b8b47-e3db-432a-a22f-789436be8606" released by "delete_volume" :: held 1.436s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:45:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-2d6c3050-9a82-444b-97d6-0af44f5f35d1 tempest-TestServerVolumeAttachmentScenario-656438129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:45:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-2d6c3050-9a82-444b-97d6-0af44f5f35d1 tempest-TestServerVolumeAttachmentScenario-656438129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:45:51 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-2d6c3050-9a82-444b-97d6-0af44f5f35d1 tempest-TestServerVolumeAttachmentScenario-656438129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:45:51 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-2d6c3050-9a82-444b-97d6-0af44f5f35d1 tempest-TestServerVolumeAttachmentScenario-656438129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:45:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-2d6c3050-9a82-444b-97d6-0af44f5f35d1 tempest-TestServerVolumeAttachmentScenario-656438129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:45:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-2d6c3050-9a82-444b-97d6-0af44f5f35d1 tempest-TestServerVolumeAttachmentScenario-656438129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:45:51 devstack sudo[100756]: pam_unix(sudo:session): session closed for user root Sep 23 14:45:51 devstack sudo[100760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:45:51 devstack sudo[100760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:45:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.443s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:45:51 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:45:51 devstack cinder-volume[86310]: DEBUG oslo_service.periodic_task [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Running periodic task VolumeManager._thread_info {{(pid=86310) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 14:45:51 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] thread count: 28 {{(pid=86310) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 14:45:51 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] thread info: [<_MainThread(MainThread, started 128854208852096)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86310) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 14:45:51 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-a2e6b873-559a-463d-81b1-675b511d546e tempest-CreateVolumesFromImageTest-620200213 None] Created reservations ['8a2ba4cf-93c5-4d96-8beb-ddcd7ea69c9f', '31b50d90-b9e8-4973-bade-1d8845a65387', 'ad2112cf-9c69-43e2-8ded-c903a33fbc96', '0b7bc845-78bc-4807-9dd9-b23b71c0462a'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:45:52 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-a2e6b873-559a-463d-81b1-675b511d546e tempest-CreateVolumesFromImageTest-620200213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:45:52 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-a2e6b873-559a-463d-81b1-675b511d546e tempest-CreateVolumesFromImageTest-620200213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:45:52 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-a2e6b873-559a-463d-81b1-675b511d546e tempest-CreateVolumesFromImageTest-620200213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:45:52 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-a2e6b873-559a-463d-81b1-675b511d546e tempest-CreateVolumesFromImageTest-620200213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:45:52 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-a2e6b873-559a-463d-81b1-675b511d546e tempest-CreateVolumesFromImageTest-620200213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:45:52 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a2e6b873-559a-463d-81b1-675b511d546e tempest-CreateVolumesFromImageTest-620200213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:45:52 devstack sudo[100762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:45:52 devstack sudo[100762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:45:52 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-bc79c103-e48b-461c-95d3-f50637db4329 tempest-TestServerVolumeAttachmentScenario-656438129 None] Acquiring lock "cinder-f1fd58c0-5cbd-438c-ba6f-7b2022aa3736-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:45:52 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-bc79c103-e48b-461c-95d3-f50637db4329 tempest-TestServerVolumeAttachmentScenario-656438129 None] Lock "cinder-f1fd58c0-5cbd-438c-ba6f-7b2022aa3736-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:45:52 devstack sudo[100760]: pam_unix(sudo:session): session closed for user root Sep 23 14:45:52 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-2d6c3050-9a82-444b-97d6-0af44f5f35d1 tempest-TestServerVolumeAttachmentScenario-656438129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.516s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:45:52 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-2d6c3050-9a82-444b-97d6-0af44f5f35d1 tempest-TestServerVolumeAttachmentScenario-656438129 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:45:52 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-2d6c3050-9a82-444b-97d6-0af44f5f35d1 tempest-TestServerVolumeAttachmentScenario-656438129 None] Deleted volume successfully. Sep 23 14:45:52 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-2d6c3050-9a82-444b-97d6-0af44f5f35d1 tempest-TestServerVolumeAttachmentScenario-656438129 None] Lock "cinder-12ea1d58-2c36-4830-9bf1-88d6434e9148-delete_volume" released by "delete_volume" :: held 2.745s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:45:52 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-bc79c103-e48b-461c-95d3-f50637db4329 tempest-TestServerVolumeAttachmentScenario-656438129 None] Acquiring lock "cinder-quobyte-f1fd58c0-5cbd-438c-ba6f-7b2022aa3736" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:45:52 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-bc79c103-e48b-461c-95d3-f50637db4329 tempest-TestServerVolumeAttachmentScenario-656438129 None] Lock "cinder-quobyte-f1fd58c0-5cbd-438c-ba6f-7b2022aa3736" acquired by "delete_volume" :: waited 0.024s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:45:52 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[612cd81d-9eea-4df0-aebd-6eeee9989303]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:45:52 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-bc79c103-e48b-461c-95d3-f50637db4329 tempest-TestServerVolumeAttachmentScenario-656438129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-f1fd58c0-5cbd-438c-ba6f-7b2022aa3736 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:45:52 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-202134e6-acd0-4ff5-8767-eb6630b672de tempest-CreateVolumesFromImageTest-620200213 None] Acquiring lock "cinder-2da4f0c5-9251-487c-81f7-07fc31bb901e-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:45:52 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-202134e6-acd0-4ff5-8767-eb6630b672de tempest-CreateVolumesFromImageTest-620200213 None] Lock "cinder-2da4f0c5-9251-487c-81f7-07fc31bb901e-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:45:52 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-202134e6-acd0-4ff5-8767-eb6630b672de tempest-CreateVolumesFromImageTest-620200213 None] Acquiring lock "cinder-quobyte-2da4f0c5-9251-487c-81f7-07fc31bb901e" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:45:52 devstack sudo[100762]: pam_unix(sudo:session): session closed for user root Sep 23 14:45:52 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a2e6b873-559a-463d-81b1-675b511d546e tempest-CreateVolumesFromImageTest-620200213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.699s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:45:52 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-a2e6b873-559a-463d-81b1-675b511d546e tempest-CreateVolumesFromImageTest-620200213 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:45:52 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-202134e6-acd0-4ff5-8767-eb6630b672de tempest-CreateVolumesFromImageTest-620200213 None] Lock "cinder-quobyte-2da4f0c5-9251-487c-81f7-07fc31bb901e" acquired by "delete_volume" :: waited 0.046s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:45:52 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-a2e6b873-559a-463d-81b1-675b511d546e tempest-CreateVolumesFromImageTest-620200213 None] Deleted volume successfully. Sep 23 14:45:52 devstack sudo[100766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-f1fd58c0-5cbd-438c-ba6f-7b2022aa3736 Sep 23 14:45:52 devstack sudo[100766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:45:52 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[5710de05-1d9a-4212-9c78-ba860b08f247]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:45:52 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-202134e6-acd0-4ff5-8767-eb6630b672de tempest-CreateVolumesFromImageTest-620200213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2da4f0c5-9251-487c-81f7-07fc31bb901e {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:45:52 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-a2e6b873-559a-463d-81b1-675b511d546e tempest-CreateVolumesFromImageTest-620200213 None] Lock "cinder-4a8b8b47-e3db-432a-a22f-789436be8606-delete_volume" released by "delete_volume" :: held 2.811s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:45:53 devstack sudo[100769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2da4f0c5-9251-487c-81f7-07fc31bb901e Sep 23 14:45:53 devstack sudo[100769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:45:53 devstack sudo[100766]: pam_unix(sudo:session): session closed for user root Sep 23 14:45:53 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-bc79c103-e48b-461c-95d3-f50637db4329 tempest-TestServerVolumeAttachmentScenario-656438129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-f1fd58c0-5cbd-438c-ba6f-7b2022aa3736" returned: 0 in 0.744s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:45:53 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-bc79c103-e48b-461c-95d3-f50637db4329 tempest-TestServerVolumeAttachmentScenario-656438129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-f1fd58c0-5cbd-438c-ba6f-7b2022aa3736 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:45:53 devstack sudo[100774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-f1fd58c0-5cbd-438c-ba6f-7b2022aa3736 Sep 23 14:45:53 devstack sudo[100774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:45:53 devstack sudo[100769]: pam_unix(sudo:session): session closed for user root Sep 23 14:45:53 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-202134e6-acd0-4ff5-8767-eb6630b672de tempest-CreateVolumesFromImageTest-620200213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2da4f0c5-9251-487c-81f7-07fc31bb901e" returned: 0 in 0.957s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:45:53 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-202134e6-acd0-4ff5-8767-eb6630b672de tempest-CreateVolumesFromImageTest-620200213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2da4f0c5-9251-487c-81f7-07fc31bb901e {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:45:53 devstack sudo[100783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2da4f0c5-9251-487c-81f7-07fc31bb901e Sep 23 14:45:53 devstack sudo[100783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:45:53 devstack sudo[100774]: pam_unix(sudo:session): session closed for user root Sep 23 14:45:53 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-bc79c103-e48b-461c-95d3-f50637db4329 tempest-TestServerVolumeAttachmentScenario-656438129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-f1fd58c0-5cbd-438c-ba6f-7b2022aa3736" returned: 0 in 0.643s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:45:54 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-bc79c103-e48b-461c-95d3-f50637db4329 tempest-TestServerVolumeAttachmentScenario-656438129 None] Lock "cinder-quobyte-f1fd58c0-5cbd-438c-ba6f-7b2022aa3736" released by "delete_volume" :: held 1.471s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:45:54 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-bc79c103-e48b-461c-95d3-f50637db4329 tempest-TestServerVolumeAttachmentScenario-656438129 None] Created reservations ['d2d94a7a-5978-4de6-b09c-3b74def37360', '874c82d2-668e-4579-b12c-202de4a302f1', '3a30cdaa-df22-4ecd-9295-c1cba9a5849b', '5317d483-2a66-45a5-b651-5294dcdfc6e0'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:45:54 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-bc79c103-e48b-461c-95d3-f50637db4329 tempest-TestServerVolumeAttachmentScenario-656438129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:45:54 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-bc79c103-e48b-461c-95d3-f50637db4329 tempest-TestServerVolumeAttachmentScenario-656438129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:45:54 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-bc79c103-e48b-461c-95d3-f50637db4329 tempest-TestServerVolumeAttachmentScenario-656438129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:45:54 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-bc79c103-e48b-461c-95d3-f50637db4329 tempest-TestServerVolumeAttachmentScenario-656438129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:45:54 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-bc79c103-e48b-461c-95d3-f50637db4329 tempest-TestServerVolumeAttachmentScenario-656438129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:45:54 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-bc79c103-e48b-461c-95d3-f50637db4329 tempest-TestServerVolumeAttachmentScenario-656438129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:45:54 devstack sudo[100785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:45:54 devstack sudo[100785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:45:54 devstack sudo[100783]: pam_unix(sudo:session): session closed for user root Sep 23 14:45:54 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-202134e6-acd0-4ff5-8767-eb6630b672de tempest-CreateVolumesFromImageTest-620200213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2da4f0c5-9251-487c-81f7-07fc31bb901e" returned: 0 in 0.591s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:45:54 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-202134e6-acd0-4ff5-8767-eb6630b672de tempest-CreateVolumesFromImageTest-620200213 None] Lock "cinder-quobyte-2da4f0c5-9251-487c-81f7-07fc31bb901e" released by "delete_volume" :: held 1.676s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:45:54 devstack sudo[100785]: pam_unix(sudo:session): session closed for user root Sep 23 14:45:54 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-bc79c103-e48b-461c-95d3-f50637db4329 tempest-TestServerVolumeAttachmentScenario-656438129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.366s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:45:54 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-bc79c103-e48b-461c-95d3-f50637db4329 tempest-TestServerVolumeAttachmentScenario-656438129 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:45:54 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-bc79c103-e48b-461c-95d3-f50637db4329 tempest-TestServerVolumeAttachmentScenario-656438129 None] Deleted volume successfully. Sep 23 14:45:54 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-bc79c103-e48b-461c-95d3-f50637db4329 tempest-TestServerVolumeAttachmentScenario-656438129 None] Lock "cinder-f1fd58c0-5cbd-438c-ba6f-7b2022aa3736-delete_volume" released by "delete_volume" :: held 2.254s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:45:54 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-202134e6-acd0-4ff5-8767-eb6630b672de tempest-CreateVolumesFromImageTest-620200213 None] Created reservations ['2bb6d39d-3db4-44b7-97c7-4b10862535cd', '49762a8f-135a-4c88-8574-68f48151fa4a', '6111d6c3-bc38-45d1-a0ab-44cdd83ecce3', 'ae4a6a77-a1b5-472d-ab19-cce91b033440'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:45:54 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-202134e6-acd0-4ff5-8767-eb6630b672de tempest-CreateVolumesFromImageTest-620200213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:45:54 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-202134e6-acd0-4ff5-8767-eb6630b672de tempest-CreateVolumesFromImageTest-620200213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:45:54 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-202134e6-acd0-4ff5-8767-eb6630b672de tempest-CreateVolumesFromImageTest-620200213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:45:54 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-202134e6-acd0-4ff5-8767-eb6630b672de tempest-CreateVolumesFromImageTest-620200213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:45:54 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-202134e6-acd0-4ff5-8767-eb6630b672de tempest-CreateVolumesFromImageTest-620200213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:45:54 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-202134e6-acd0-4ff5-8767-eb6630b672de tempest-CreateVolumesFromImageTest-620200213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:45:54 devstack sudo[100792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:45:54 devstack sudo[100792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:45:55 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-dc27f70e-e8a3-4766-8ac3-21d76c05b8b3 tempest-CreateVolumesFromImageTest-620200213 None] Acquiring lock "cinder-0fc9d9aa-3be5-44cd-b5e1-b839f1869846-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:45:55 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-dc27f70e-e8a3-4766-8ac3-21d76c05b8b3 tempest-CreateVolumesFromImageTest-620200213 None] Lock "cinder-0fc9d9aa-3be5-44cd-b5e1-b839f1869846-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:45:55 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-dc27f70e-e8a3-4766-8ac3-21d76c05b8b3 tempest-CreateVolumesFromImageTest-620200213 None] Acquiring lock "cinder-quobyte-0fc9d9aa-3be5-44cd-b5e1-b839f1869846" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:45:55 devstack sudo[100792]: pam_unix(sudo:session): session closed for user root Sep 23 14:45:55 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-202134e6-acd0-4ff5-8767-eb6630b672de tempest-CreateVolumesFromImageTest-620200213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.697s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:45:55 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-202134e6-acd0-4ff5-8767-eb6630b672de tempest-CreateVolumesFromImageTest-620200213 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:45:55 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-202134e6-acd0-4ff5-8767-eb6630b672de tempest-CreateVolumesFromImageTest-620200213 None] Deleted volume successfully. Sep 23 14:45:55 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-dc27f70e-e8a3-4766-8ac3-21d76c05b8b3 tempest-CreateVolumesFromImageTest-620200213 None] Lock "cinder-quobyte-0fc9d9aa-3be5-44cd-b5e1-b839f1869846" acquired by "delete_volume" :: waited 0.067s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:45:55 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-202134e6-acd0-4ff5-8767-eb6630b672de tempest-CreateVolumesFromImageTest-620200213 None] Lock "cinder-2da4f0c5-9251-487c-81f7-07fc31bb901e-delete_volume" released by "delete_volume" :: held 2.903s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:45:55 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[c43e0e83-1a6c-4064-a9da-dbfb1dc1d744]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:45:55 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-dc27f70e-e8a3-4766-8ac3-21d76c05b8b3 tempest-CreateVolumesFromImageTest-620200213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-0fc9d9aa-3be5-44cd-b5e1-b839f1869846 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:45:55 devstack sudo[100838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-0fc9d9aa-3be5-44cd-b5e1-b839f1869846 Sep 23 14:45:55 devstack sudo[100838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:45:56 devstack sudo[100838]: pam_unix(sudo:session): session closed for user root Sep 23 14:45:56 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-dc27f70e-e8a3-4766-8ac3-21d76c05b8b3 tempest-CreateVolumesFromImageTest-620200213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-0fc9d9aa-3be5-44cd-b5e1-b839f1869846" returned: 0 in 0.660s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:45:56 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-dc27f70e-e8a3-4766-8ac3-21d76c05b8b3 tempest-CreateVolumesFromImageTest-620200213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-0fc9d9aa-3be5-44cd-b5e1-b839f1869846 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:45:56 devstack sudo[100865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-0fc9d9aa-3be5-44cd-b5e1-b839f1869846 Sep 23 14:45:56 devstack sudo[100865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:45:56 devstack sudo[100865]: pam_unix(sudo:session): session closed for user root Sep 23 14:45:56 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-dc27f70e-e8a3-4766-8ac3-21d76c05b8b3 tempest-CreateVolumesFromImageTest-620200213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-0fc9d9aa-3be5-44cd-b5e1-b839f1869846" returned: 0 in 0.602s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:45:56 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-dc27f70e-e8a3-4766-8ac3-21d76c05b8b3 tempest-CreateVolumesFromImageTest-620200213 None] Lock "cinder-quobyte-0fc9d9aa-3be5-44cd-b5e1-b839f1869846" released by "delete_volume" :: held 1.382s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:45:57 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-dc27f70e-e8a3-4766-8ac3-21d76c05b8b3 tempest-CreateVolumesFromImageTest-620200213 None] Created reservations ['2f66acfe-912f-43b9-aa23-50e6009a66e3', 'b389d0f8-720d-4d5b-b397-2ae2abdce3a8', 'ef546ce6-496a-4e94-bd2d-3145014b31e1', 'e5c14a7d-4b0d-48bc-8aa9-35c4bf860408'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:45:57 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-dc27f70e-e8a3-4766-8ac3-21d76c05b8b3 tempest-CreateVolumesFromImageTest-620200213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:45:57 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-dc27f70e-e8a3-4766-8ac3-21d76c05b8b3 tempest-CreateVolumesFromImageTest-620200213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:45:57 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-dc27f70e-e8a3-4766-8ac3-21d76c05b8b3 tempest-CreateVolumesFromImageTest-620200213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:45:57 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-dc27f70e-e8a3-4766-8ac3-21d76c05b8b3 tempest-CreateVolumesFromImageTest-620200213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:45:57 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-dc27f70e-e8a3-4766-8ac3-21d76c05b8b3 tempest-CreateVolumesFromImageTest-620200213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:45:57 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-dc27f70e-e8a3-4766-8ac3-21d76c05b8b3 tempest-CreateVolumesFromImageTest-620200213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:45:57 devstack sudo[100878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:45:57 devstack sudo[100878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:45:57 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-54a68488-debf-487a-bdc3-b9373c4131f7 tempest-CreateVolumesFromImageTest-620200213 None] Acquiring lock "cinder-8a7022ca-fa9f-48ea-99ed-af491e00190e-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:45:57 devstack sudo[100878]: pam_unix(sudo:session): session closed for user root Sep 23 14:45:57 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-dc27f70e-e8a3-4766-8ac3-21d76c05b8b3 tempest-CreateVolumesFromImageTest-620200213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.703s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:45:57 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-dc27f70e-e8a3-4766-8ac3-21d76c05b8b3 tempest-CreateVolumesFromImageTest-620200213 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:45:57 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-dc27f70e-e8a3-4766-8ac3-21d76c05b8b3 tempest-CreateVolumesFromImageTest-620200213 None] Deleted volume successfully. Sep 23 14:45:57 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-54a68488-debf-487a-bdc3-b9373c4131f7 tempest-CreateVolumesFromImageTest-620200213 None] Lock "cinder-8a7022ca-fa9f-48ea-99ed-af491e00190e-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:45:57 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-dc27f70e-e8a3-4766-8ac3-21d76c05b8b3 tempest-CreateVolumesFromImageTest-620200213 None] Lock "cinder-0fc9d9aa-3be5-44cd-b5e1-b839f1869846-delete_volume" released by "delete_volume" :: held 2.616s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:45:57 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-54a68488-debf-487a-bdc3-b9373c4131f7 tempest-CreateVolumesFromImageTest-620200213 None] Acquiring lock "cinder-quobyte-8a7022ca-fa9f-48ea-99ed-af491e00190e" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:45:57 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-54a68488-debf-487a-bdc3-b9373c4131f7 tempest-CreateVolumesFromImageTest-620200213 None] Lock "cinder-quobyte-8a7022ca-fa9f-48ea-99ed-af491e00190e" acquired by "delete_volume" :: waited 0.026s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:45:58 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f39a6d3-f014-464b-8870-747863ef78c8]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:45:58 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-54a68488-debf-487a-bdc3-b9373c4131f7 tempest-CreateVolumesFromImageTest-620200213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8a7022ca-fa9f-48ea-99ed-af491e00190e {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:45:58 devstack sudo[100882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8a7022ca-fa9f-48ea-99ed-af491e00190e Sep 23 14:45:58 devstack sudo[100882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:45:58 devstack sudo[100882]: pam_unix(sudo:session): session closed for user root Sep 23 14:45:58 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-54a68488-debf-487a-bdc3-b9373c4131f7 tempest-CreateVolumesFromImageTest-620200213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8a7022ca-fa9f-48ea-99ed-af491e00190e" returned: 0 in 0.470s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:45:58 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-54a68488-debf-487a-bdc3-b9373c4131f7 tempest-CreateVolumesFromImageTest-620200213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8a7022ca-fa9f-48ea-99ed-af491e00190e {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:45:58 devstack sudo[100888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8a7022ca-fa9f-48ea-99ed-af491e00190e Sep 23 14:45:58 devstack sudo[100888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:45:58 devstack sudo[100888]: pam_unix(sudo:session): session closed for user root Sep 23 14:45:58 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-54a68488-debf-487a-bdc3-b9373c4131f7 tempest-CreateVolumesFromImageTest-620200213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8a7022ca-fa9f-48ea-99ed-af491e00190e" returned: 0 in 0.299s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:45:58 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-54a68488-debf-487a-bdc3-b9373c4131f7 tempest-CreateVolumesFromImageTest-620200213 None] Lock "cinder-quobyte-8a7022ca-fa9f-48ea-99ed-af491e00190e" released by "delete_volume" :: held 0.892s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:45:58 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-54a68488-debf-487a-bdc3-b9373c4131f7 tempest-CreateVolumesFromImageTest-620200213 None] Created reservations ['50e6cf38-0fc3-4ab4-8a6f-b0f69567903b', '993e55e3-1571-41a5-b6dc-756a25d40f82', '0e24bf58-1a9e-47f7-a8f9-f189c35facdc', '0e0d33d3-d07b-4b47-b704-f6c77bb9c52c'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:45:59 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-54a68488-debf-487a-bdc3-b9373c4131f7 tempest-CreateVolumesFromImageTest-620200213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:45:59 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-54a68488-debf-487a-bdc3-b9373c4131f7 tempest-CreateVolumesFromImageTest-620200213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:45:59 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-54a68488-debf-487a-bdc3-b9373c4131f7 tempest-CreateVolumesFromImageTest-620200213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:45:59 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-54a68488-debf-487a-bdc3-b9373c4131f7 tempest-CreateVolumesFromImageTest-620200213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:45:59 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-54a68488-debf-487a-bdc3-b9373c4131f7 tempest-CreateVolumesFromImageTest-620200213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:45:59 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-54a68488-debf-487a-bdc3-b9373c4131f7 tempest-CreateVolumesFromImageTest-620200213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:45:59 devstack sudo[100891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:45:59 devstack sudo[100891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:45:59 devstack sudo[100891]: pam_unix(sudo:session): session closed for user root Sep 23 14:45:59 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-54a68488-debf-487a-bdc3-b9373c4131f7 tempest-CreateVolumesFromImageTest-620200213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.499s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:45:59 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-54a68488-debf-487a-bdc3-b9373c4131f7 tempest-CreateVolumesFromImageTest-620200213 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:45:59 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-54a68488-debf-487a-bdc3-b9373c4131f7 tempest-CreateVolumesFromImageTest-620200213 None] Deleted volume successfully. Sep 23 14:45:59 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-54a68488-debf-487a-bdc3-b9373c4131f7 tempest-CreateVolumesFromImageTest-620200213 None] Lock "cinder-8a7022ca-fa9f-48ea-99ed-af491e00190e-delete_volume" released by "delete_volume" :: held 1.786s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:46:09 devstack cinder-volume[86310]: DEBUG dbcounter [-] [86310] Writing DB stats cinder:UPDATE=70,cinder:SELECT=46,cinder:DELETE=6,cinder:INSERT=20 {{(pid=86310) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 14:46:09 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [req-cf4fee74-eb1c-4402-ad23-4a9877200f74 req-53a07c3a-1a9f-4e44-b566-6d5c7f6e755f tempest-TestInstancesWithCinderVolumes-584005076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:46:09 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [req-cf4fee74-eb1c-4402-ad23-4a9877200f74 req-53a07c3a-1a9f-4e44-b566-6d5c7f6e755f tempest-TestInstancesWithCinderVolumes-584005076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:46:09 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [req-cf4fee74-eb1c-4402-ad23-4a9877200f74 req-53a07c3a-1a9f-4e44-b566-6d5c7f6e755f tempest-TestInstancesWithCinderVolumes-584005076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.039s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:46:09 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [req-cf4fee74-eb1c-4402-ad23-4a9877200f74 req-53a07c3a-1a9f-4e44-b566-6d5c7f6e755f tempest-TestInstancesWithCinderVolumes-584005076 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362', 'name': 'volume-9a36fcb4-8339-49f1-8cbc-ae270f617ddf', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9c1b2591-bffc-4657-a408-49f378af1dc6', 'enforce_multipath': True} {{(pid=86310) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 14:46:09 devstack cinder-volume[86310]: INFO cinder.volume.manager [req-cf4fee74-eb1c-4402-ad23-4a9877200f74 req-53a07c3a-1a9f-4e44-b566-6d5c7f6e755f tempest-TestInstancesWithCinderVolumes-584005076 None] attachment_update completed successfully. Sep 23 14:46:12 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [req-41604187-8c57-4337-9837-514fc9dc2fc7 req-26d23d6e-ef86-42ee-9916-cd2e9e95c75b tempest-TestInstancesWithCinderVolumes-584005076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:46:12 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [req-41604187-8c57-4337-9837-514fc9dc2fc7 req-26d23d6e-ef86-42ee-9916-cd2e9e95c75b tempest-TestInstancesWithCinderVolumes-584005076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:46:12 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [req-41604187-8c57-4337-9837-514fc9dc2fc7 req-26d23d6e-ef86-42ee-9916-cd2e9e95c75b tempest-TestInstancesWithCinderVolumes-584005076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:46:12 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [req-41604187-8c57-4337-9837-514fc9dc2fc7 req-26d23d6e-ef86-42ee-9916-cd2e9e95c75b tempest-TestInstancesWithCinderVolumes-584005076 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362', 'name': 'volume-114fc2d4-faab-401b-818b-46d764af0586', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '78cb8053-c2e1-4388-9082-bd08bb5184e0', 'enforce_multipath': True} {{(pid=86310) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 14:46:12 devstack cinder-volume[86310]: INFO cinder.volume.manager [req-41604187-8c57-4337-9837-514fc9dc2fc7 req-26d23d6e-ef86-42ee-9916-cd2e9e95c75b tempest-TestInstancesWithCinderVolumes-584005076 None] attachment_update completed successfully. Sep 23 14:46:17 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-27aca492-dc6d-487d-a9f7-90b8e2c3d5dc tempest-ProjectReaderTests-1981877916 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:46:17 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-27aca492-dc6d-487d-a9f7-90b8e2c3d5dc tempest-ProjectReaderTests-1981877916 None] Flow 'volume_create_manager' (212bc0c5-eb27-4b55-b0e4-392cd755b8cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:46:17 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-27aca492-dc6d-487d-a9f7-90b8e2c3d5dc tempest-ProjectReaderTests-1981877916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e22951c3-4c23-4e24-9ad6-254fdecfd87f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:46:17 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-27aca492-dc6d-487d-a9f7-90b8e2c3d5dc tempest-ProjectReaderTests-1981877916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e22951c3-4c23-4e24-9ad6-254fdecfd87f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:46:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1065848353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f519cba4-2575-4c7a-9c19-63cd42f638f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a04cd61a1194d70b76a941cf38d538d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:46:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:46:18Z,use_quota=True,user_id='e21d082db06a4975be83d644c824ab63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:46:17 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-27aca492-dc6d-487d-a9f7-90b8e2c3d5dc tempest-ProjectReaderTests-1981877916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0312da18-2343-4a8e-b1fa-a4f92e8ae10f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:46:17 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-27aca492-dc6d-487d-a9f7-90b8e2c3d5dc tempest-ProjectReaderTests-1981877916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0312da18-2343-4a8e-b1fa-a4f92e8ae10f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:46:18 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-27aca492-dc6d-487d-a9f7-90b8e2c3d5dc tempest-ProjectReaderTests-1981877916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf10a24f-2896-4cdc-a9fa-7fb71cdef464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:46:18 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-27aca492-dc6d-487d-a9f7-90b8e2c3d5dc tempest-ProjectReaderTests-1981877916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf10a24f-2896-4cdc-a9fa-7fb71cdef464) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f519cba4-2575-4c7a-9c19-63cd42f638f4', 'volume_name': 'volume-f519cba4-2575-4c7a-9c19-63cd42f638f4', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:46:18 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-27aca492-dc6d-487d-a9f7-90b8e2c3d5dc tempest-ProjectReaderTests-1981877916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63637427-35ae-438b-a7c8-79a6b3a1ad39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:46:18 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-27aca492-dc6d-487d-a9f7-90b8e2c3d5dc tempest-ProjectReaderTests-1981877916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63637427-35ae-438b-a7c8-79a6b3a1ad39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:46:18 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-27aca492-dc6d-487d-a9f7-90b8e2c3d5dc tempest-ProjectReaderTests-1981877916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b402713-186a-4888-8935-4944daabc0e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:46:18 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-27aca492-dc6d-487d-a9f7-90b8e2c3d5dc tempest-ProjectReaderTests-1981877916 None] Volume f519cba4-2575-4c7a-9c19-63cd42f638f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f519cba4-2575-4c7a-9c19-63cd42f638f4', 'volume_size': 1} Sep 23 14:46:18 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-27aca492-dc6d-487d-a9f7-90b8e2c3d5dc tempest-ProjectReaderTests-1981877916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:46:18 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-27aca492-dc6d-487d-a9f7-90b8e2c3d5dc tempest-ProjectReaderTests-1981877916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:46:18 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-27aca492-dc6d-487d-a9f7-90b8e2c3d5dc tempest-ProjectReaderTests-1981877916 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:46:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1065848353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f519cba4-2575-4c7a-9c19-63cd42f638f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a04cd61a1194d70b76a941cf38d538d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:46:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:46:18Z,use_quota=True,user_id='e21d082db06a4975be83d644c824ab63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:46:18 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-27aca492-dc6d-487d-a9f7-90b8e2c3d5dc tempest-ProjectReaderTests-1981877916 None] Creating volume f519cba4-2575-4c7a-9c19-63cd42f638f4 {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:46:18 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-27aca492-dc6d-487d-a9f7-90b8e2c3d5dc tempest-ProjectReaderTests-1981877916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:46:18 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-27aca492-dc6d-487d-a9f7-90b8e2c3d5dc tempest-ProjectReaderTests-1981877916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:46:18 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-27aca492-dc6d-487d-a9f7-90b8e2c3d5dc tempest-ProjectReaderTests-1981877916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:46:18 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-27aca492-dc6d-487d-a9f7-90b8e2c3d5dc tempest-ProjectReaderTests-1981877916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:46:18 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-27aca492-dc6d-487d-a9f7-90b8e2c3d5dc tempest-ProjectReaderTests-1981877916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:46:18 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-27aca492-dc6d-487d-a9f7-90b8e2c3d5dc tempest-ProjectReaderTests-1981877916 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:46:18 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-27aca492-dc6d-487d-a9f7-90b8e2c3d5dc tempest-ProjectReaderTests-1981877916 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:46:18 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-27aca492-dc6d-487d-a9f7-90b8e2c3d5dc tempest-ProjectReaderTests-1981877916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-f519cba4-2575-4c7a-9c19-63cd42f638f4 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:46:18 devstack sudo[100982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-f519cba4-2575-4c7a-9c19-63cd42f638f4 1073741824 Sep 23 14:46:18 devstack sudo[100982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:46:18 devstack sudo[100982]: pam_unix(sudo:session): session closed for user root Sep 23 14:46:18 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-27aca492-dc6d-487d-a9f7-90b8e2c3d5dc tempest-ProjectReaderTests-1981877916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-f519cba4-2575-4c7a-9c19-63cd42f638f4 1073741824" returned: 0 in 0.801s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:46:18 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-27aca492-dc6d-487d-a9f7-90b8e2c3d5dc tempest-ProjectReaderTests-1981877916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-f519cba4-2575-4c7a-9c19-63cd42f638f4 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:46:18 devstack sudo[101000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-f519cba4-2575-4c7a-9c19-63cd42f638f4 Sep 23 14:46:18 devstack sudo[101000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:46:19 devstack sudo[101000]: pam_unix(sudo:session): session closed for user root Sep 23 14:46:19 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-27aca492-dc6d-487d-a9f7-90b8e2c3d5dc tempest-ProjectReaderTests-1981877916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-f519cba4-2575-4c7a-9c19-63cd42f638f4" returned: 0 in 0.296s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:46:19 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-27aca492-dc6d-487d-a9f7-90b8e2c3d5dc tempest-ProjectReaderTests-1981877916 None] <== create_volume: return (1160ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:46:19 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-27aca492-dc6d-487d-a9f7-90b8e2c3d5dc tempest-ProjectReaderTests-1981877916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.163s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:46:19 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-27aca492-dc6d-487d-a9f7-90b8e2c3d5dc tempest-ProjectReaderTests-1981877916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b402713-186a-4888-8935-4944daabc0e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f519cba4-2575-4c7a-9c19-63cd42f638f4', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:46:19 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-27aca492-dc6d-487d-a9f7-90b8e2c3d5dc tempest-ProjectReaderTests-1981877916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbf73510-1895-4829-8892-1151af81701e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:46:19 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-27aca492-dc6d-487d-a9f7-90b8e2c3d5dc tempest-ProjectReaderTests-1981877916 None] Volume volume-f519cba4-2575-4c7a-9c19-63cd42f638f4 (f519cba4-2575-4c7a-9c19-63cd42f638f4): created successfully Sep 23 14:46:19 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-27aca492-dc6d-487d-a9f7-90b8e2c3d5dc tempest-ProjectReaderTests-1981877916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbf73510-1895-4829-8892-1151af81701e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:46:19 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-27aca492-dc6d-487d-a9f7-90b8e2c3d5dc tempest-ProjectReaderTests-1981877916 None] Flow 'volume_create_manager' (212bc0c5-eb27-4b55-b0e4-392cd755b8cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:46:19 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-27aca492-dc6d-487d-a9f7-90b8e2c3d5dc tempest-ProjectReaderTests-1981877916 None] Created volume successfully. Sep 23 14:46:19 devstack cinder-volume[86310]: INFO cinder.volume.manager [req-7b9d68c4-1a8b-4bd3-9134-fac103495c37 req-28d570e2-fd68-45f3-8dd3-282178cbca45 tempest-TestInstancesWithCinderVolumes-584005076 None] Terminate volume connection completed successfully. Sep 23 14:46:19 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [req-7b9d68c4-1a8b-4bd3-9134-fac103495c37 req-28d570e2-fd68-45f3-8dd3-282178cbca45 tempest-TestInstancesWithCinderVolumes-584005076 None] Deleting attachment 9c1b2591-bffc-4657-a408-49f378af1dc6. {{(pid=86310) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 14:46:20 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-39ab1b65-e446-4aff-9f9d-e78046e7593d tempest-ProjectReaderTests-1981877916 None] Acquiring lock "cinder-f519cba4-2575-4c7a-9c19-63cd42f638f4-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:46:20 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-39ab1b65-e446-4aff-9f9d-e78046e7593d tempest-ProjectReaderTests-1981877916 None] Lock "cinder-f519cba4-2575-4c7a-9c19-63cd42f638f4-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:46:20 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-39ab1b65-e446-4aff-9f9d-e78046e7593d tempest-ProjectReaderTests-1981877916 None] Acquiring lock "cinder-quobyte-f519cba4-2575-4c7a-9c19-63cd42f638f4" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:46:20 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-39ab1b65-e446-4aff-9f9d-e78046e7593d tempest-ProjectReaderTests-1981877916 None] Lock "cinder-quobyte-f519cba4-2575-4c7a-9c19-63cd42f638f4" acquired by "delete_volume" :: waited 0.016s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:46:20 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e31bc31-bcb3-4535-95ba-75baed18bb3f]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:46:20 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-39ab1b65-e446-4aff-9f9d-e78046e7593d tempest-ProjectReaderTests-1981877916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-f519cba4-2575-4c7a-9c19-63cd42f638f4 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:46:20 devstack sudo[101005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-f519cba4-2575-4c7a-9c19-63cd42f638f4 Sep 23 14:46:20 devstack sudo[101005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:46:20 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-cd3bc57f-3381-4009-95e2-de94f3fbf563 tempest-TestInstancesWithCinderVolumes-584005076 None] Acquiring lock "cinder-9a36fcb4-8339-49f1-8cbc-ae270f617ddf-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:46:20 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-cd3bc57f-3381-4009-95e2-de94f3fbf563 tempest-TestInstancesWithCinderVolumes-584005076 None] Lock "cinder-9a36fcb4-8339-49f1-8cbc-ae270f617ddf-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:46:20 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-cd3bc57f-3381-4009-95e2-de94f3fbf563 tempest-TestInstancesWithCinderVolumes-584005076 None] Acquiring lock "cinder-quobyte-9a36fcb4-8339-49f1-8cbc-ae270f617ddf" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:46:20 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-cd3bc57f-3381-4009-95e2-de94f3fbf563 tempest-TestInstancesWithCinderVolumes-584005076 None] Lock "cinder-quobyte-9a36fcb4-8339-49f1-8cbc-ae270f617ddf" acquired by "delete_volume" :: waited 0.018s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:46:20 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[19f14477-6be8-49ab-bc2e-b10d22c1d192]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:46:20 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-cd3bc57f-3381-4009-95e2-de94f3fbf563 tempest-TestInstancesWithCinderVolumes-584005076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-9a36fcb4-8339-49f1-8cbc-ae270f617ddf {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:46:20 devstack sudo[101005]: pam_unix(sudo:session): session closed for user root Sep 23 14:46:20 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-39ab1b65-e446-4aff-9f9d-e78046e7593d tempest-ProjectReaderTests-1981877916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-f519cba4-2575-4c7a-9c19-63cd42f638f4" returned: 0 in 0.421s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:46:20 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-39ab1b65-e446-4aff-9f9d-e78046e7593d tempest-ProjectReaderTests-1981877916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-f519cba4-2575-4c7a-9c19-63cd42f638f4 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:46:20 devstack sudo[101015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-f519cba4-2575-4c7a-9c19-63cd42f638f4 Sep 23 14:46:20 devstack sudo[101015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:46:20 devstack sudo[101014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-9a36fcb4-8339-49f1-8cbc-ae270f617ddf Sep 23 14:46:20 devstack sudo[101014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:46:21 devstack sudo[101015]: pam_unix(sudo:session): session closed for user root Sep 23 14:46:21 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-39ab1b65-e446-4aff-9f9d-e78046e7593d tempest-ProjectReaderTests-1981877916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-f519cba4-2575-4c7a-9c19-63cd42f638f4" returned: 0 in 0.358s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:46:21 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-39ab1b65-e446-4aff-9f9d-e78046e7593d tempest-ProjectReaderTests-1981877916 None] Lock "cinder-quobyte-f519cba4-2575-4c7a-9c19-63cd42f638f4" released by "delete_volume" :: held 0.837s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:46:21 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-39ab1b65-e446-4aff-9f9d-e78046e7593d tempest-ProjectReaderTests-1981877916 None] Created reservations ['920c73f0-f416-475d-8b39-e744c97999eb', '0f1b6556-bee1-4562-a5bc-f30821d19c14', '820edac5-e3c3-41ce-9ade-1fe4ae03b226', '3a7a94c7-3abb-4f3e-89ea-ac8bb3ef94d0'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:46:21 devstack sudo[101014]: pam_unix(sudo:session): session closed for user root Sep 23 14:46:21 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-cd3bc57f-3381-4009-95e2-de94f3fbf563 tempest-TestInstancesWithCinderVolumes-584005076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-9a36fcb4-8339-49f1-8cbc-ae270f617ddf" returned: 0 in 0.594s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:46:21 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-cd3bc57f-3381-4009-95e2-de94f3fbf563 tempest-TestInstancesWithCinderVolumes-584005076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-9a36fcb4-8339-49f1-8cbc-ae270f617ddf {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:46:21 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-39ab1b65-e446-4aff-9f9d-e78046e7593d tempest-ProjectReaderTests-1981877916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:46:21 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-39ab1b65-e446-4aff-9f9d-e78046e7593d tempest-ProjectReaderTests-1981877916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:46:21 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-39ab1b65-e446-4aff-9f9d-e78046e7593d tempest-ProjectReaderTests-1981877916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:46:21 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-39ab1b65-e446-4aff-9f9d-e78046e7593d tempest-ProjectReaderTests-1981877916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:46:21 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-39ab1b65-e446-4aff-9f9d-e78046e7593d tempest-ProjectReaderTests-1981877916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:46:21 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-39ab1b65-e446-4aff-9f9d-e78046e7593d tempest-ProjectReaderTests-1981877916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:46:21 devstack sudo[101022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-9a36fcb4-8339-49f1-8cbc-ae270f617ddf Sep 23 14:46:21 devstack sudo[101022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:46:21 devstack sudo[101023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:46:21 devstack sudo[101023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:46:21 devstack sudo[101023]: pam_unix(sudo:session): session closed for user root Sep 23 14:46:21 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-39ab1b65-e446-4aff-9f9d-e78046e7593d tempest-ProjectReaderTests-1981877916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.410s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:46:21 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-39ab1b65-e446-4aff-9f9d-e78046e7593d tempest-ProjectReaderTests-1981877916 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:46:21 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-39ab1b65-e446-4aff-9f9d-e78046e7593d tempest-ProjectReaderTests-1981877916 None] Deleted volume successfully. Sep 23 14:46:21 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-39ab1b65-e446-4aff-9f9d-e78046e7593d tempest-ProjectReaderTests-1981877916 None] Lock "cinder-f519cba4-2575-4c7a-9c19-63cd42f638f4-delete_volume" released by "delete_volume" :: held 1.607s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:46:21 devstack sudo[101022]: pam_unix(sudo:session): session closed for user root Sep 23 14:46:21 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-cd3bc57f-3381-4009-95e2-de94f3fbf563 tempest-TestInstancesWithCinderVolumes-584005076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-9a36fcb4-8339-49f1-8cbc-ae270f617ddf" returned: 0 in 0.560s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:46:21 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-cd3bc57f-3381-4009-95e2-de94f3fbf563 tempest-TestInstancesWithCinderVolumes-584005076 None] Lock "cinder-quobyte-9a36fcb4-8339-49f1-8cbc-ae270f617ddf" released by "delete_volume" :: held 1.220s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:46:21 devstack cinder-volume[86310]: WARNING cinder.quota [None req-cd3bc57f-3381-4009-95e2-de94f3fbf563 tempest-TestInstancesWithCinderVolumes-584005076 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-142548692-686244222 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-142548692-686244222, it is now deprecated. Please use the default quota class for default quota. Sep 23 14:46:21 devstack cinder-volume[86310]: WARNING cinder.quota [None req-cd3bc57f-3381-4009-95e2-de94f3fbf563 tempest-TestInstancesWithCinderVolumes-584005076 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-142548692-686244222 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-142548692-686244222, it is now deprecated. Please use the default quota class for default quota. Sep 23 14:46:21 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-cd3bc57f-3381-4009-95e2-de94f3fbf563 tempest-TestInstancesWithCinderVolumes-584005076 None] Created reservations ['9eb01b6d-6544-441d-9512-9137db852d65', '356bc3fa-eaed-4636-afc8-bc507870daee', 'c525e3ae-5004-44ca-ad3f-56b241dd4e06', '4e092b4a-8c4b-46d3-af56-ee8823660b32'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:46:22 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-42de33c3-693b-4484-81b7-6856b52db29e tempest-ProjectReaderTests-1981877916 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:46:22 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-42de33c3-693b-4484-81b7-6856b52db29e tempest-ProjectReaderTests-1981877916 None] Flow 'volume_create_manager' (bff64caf-6b21-4f04-9a9a-7329fdfac0e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:46:22 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-42de33c3-693b-4484-81b7-6856b52db29e tempest-ProjectReaderTests-1981877916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a94e10e5-154b-43a8-bef1-4313a581b87e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:46:22 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-42de33c3-693b-4484-81b7-6856b52db29e tempest-ProjectReaderTests-1981877916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a94e10e5-154b-43a8-bef1-4313a581b87e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:46:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1581532139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64aa5860-b82b-44e9-9577-987812444006,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a04cd61a1194d70b76a941cf38d538d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:46:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:46:22Z,use_quota=True,user_id='e21d082db06a4975be83d644c824ab63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:46:22 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-42de33c3-693b-4484-81b7-6856b52db29e tempest-ProjectReaderTests-1981877916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2bba893-adbf-41c8-90bb-7f62a49cdfd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:46:22 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-42de33c3-693b-4484-81b7-6856b52db29e tempest-ProjectReaderTests-1981877916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2bba893-adbf-41c8-90bb-7f62a49cdfd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:46:22 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-42de33c3-693b-4484-81b7-6856b52db29e tempest-ProjectReaderTests-1981877916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff63d109-9d54-4e47-b00e-60b3b171595a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:46:22 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-42de33c3-693b-4484-81b7-6856b52db29e tempest-ProjectReaderTests-1981877916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff63d109-9d54-4e47-b00e-60b3b171595a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64aa5860-b82b-44e9-9577-987812444006', 'volume_name': 'volume-64aa5860-b82b-44e9-9577-987812444006', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:46:22 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-42de33c3-693b-4484-81b7-6856b52db29e tempest-ProjectReaderTests-1981877916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (498c12f4-641d-401d-b4a7-6073552c5048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:46:22 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-42de33c3-693b-4484-81b7-6856b52db29e tempest-ProjectReaderTests-1981877916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (498c12f4-641d-401d-b4a7-6073552c5048) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:46:22 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-42de33c3-693b-4484-81b7-6856b52db29e tempest-ProjectReaderTests-1981877916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d958da09-3ea7-42d4-891c-0501e39ff86b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:46:22 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-42de33c3-693b-4484-81b7-6856b52db29e tempest-ProjectReaderTests-1981877916 None] Volume 64aa5860-b82b-44e9-9577-987812444006: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64aa5860-b82b-44e9-9577-987812444006', 'volume_size': 1} Sep 23 14:46:22 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-42de33c3-693b-4484-81b7-6856b52db29e tempest-ProjectReaderTests-1981877916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:46:22 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-42de33c3-693b-4484-81b7-6856b52db29e tempest-ProjectReaderTests-1981877916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:46:22 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-42de33c3-693b-4484-81b7-6856b52db29e tempest-ProjectReaderTests-1981877916 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:46:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1581532139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64aa5860-b82b-44e9-9577-987812444006,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a04cd61a1194d70b76a941cf38d538d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:46:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:46:22Z,use_quota=True,user_id='e21d082db06a4975be83d644c824ab63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:46:22 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-42de33c3-693b-4484-81b7-6856b52db29e tempest-ProjectReaderTests-1981877916 None] Creating volume 64aa5860-b82b-44e9-9577-987812444006 {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:46:22 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-42de33c3-693b-4484-81b7-6856b52db29e tempest-ProjectReaderTests-1981877916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:46:22 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-42de33c3-693b-4484-81b7-6856b52db29e tempest-ProjectReaderTests-1981877916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:46:22 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-42de33c3-693b-4484-81b7-6856b52db29e tempest-ProjectReaderTests-1981877916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:46:22 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-42de33c3-693b-4484-81b7-6856b52db29e tempest-ProjectReaderTests-1981877916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:46:22 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-42de33c3-693b-4484-81b7-6856b52db29e tempest-ProjectReaderTests-1981877916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:46:22 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-42de33c3-693b-4484-81b7-6856b52db29e tempest-ProjectReaderTests-1981877916 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:46:22 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-42de33c3-693b-4484-81b7-6856b52db29e tempest-ProjectReaderTests-1981877916 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:46:22 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-42de33c3-693b-4484-81b7-6856b52db29e tempest-ProjectReaderTests-1981877916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-64aa5860-b82b-44e9-9577-987812444006 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:46:22 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-cd3bc57f-3381-4009-95e2-de94f3fbf563 tempest-TestInstancesWithCinderVolumes-584005076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:46:22 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-cd3bc57f-3381-4009-95e2-de94f3fbf563 tempest-TestInstancesWithCinderVolumes-584005076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:46:22 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-cd3bc57f-3381-4009-95e2-de94f3fbf563 tempest-TestInstancesWithCinderVolumes-584005076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:46:22 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-cd3bc57f-3381-4009-95e2-de94f3fbf563 tempest-TestInstancesWithCinderVolumes-584005076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:46:22 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-cd3bc57f-3381-4009-95e2-de94f3fbf563 tempest-TestInstancesWithCinderVolumes-584005076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:46:22 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-cd3bc57f-3381-4009-95e2-de94f3fbf563 tempest-TestInstancesWithCinderVolumes-584005076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:46:22 devstack sudo[101028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-64aa5860-b82b-44e9-9577-987812444006 1073741824 Sep 23 14:46:22 devstack sudo[101028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:46:22 devstack sudo[101030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:46:22 devstack sudo[101030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:46:22 devstack sudo[101030]: pam_unix(sudo:session): session closed for user root Sep 23 14:46:22 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-cd3bc57f-3381-4009-95e2-de94f3fbf563 tempest-TestInstancesWithCinderVolumes-584005076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.333s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:46:22 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-cd3bc57f-3381-4009-95e2-de94f3fbf563 tempest-TestInstancesWithCinderVolumes-584005076 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:46:22 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-cd3bc57f-3381-4009-95e2-de94f3fbf563 tempest-TestInstancesWithCinderVolumes-584005076 None] Deleted volume successfully. Sep 23 14:46:22 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-cd3bc57f-3381-4009-95e2-de94f3fbf563 tempest-TestInstancesWithCinderVolumes-584005076 None] Lock "cinder-9a36fcb4-8339-49f1-8cbc-ae270f617ddf-delete_volume" released by "delete_volume" :: held 1.968s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:46:22 devstack sudo[101028]: pam_unix(sudo:session): session closed for user root Sep 23 14:46:22 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-42de33c3-693b-4484-81b7-6856b52db29e tempest-ProjectReaderTests-1981877916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-64aa5860-b82b-44e9-9577-987812444006 1073741824" returned: 0 in 0.578s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:46:22 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-42de33c3-693b-4484-81b7-6856b52db29e tempest-ProjectReaderTests-1981877916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-64aa5860-b82b-44e9-9577-987812444006 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:46:22 devstack sudo[101038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-64aa5860-b82b-44e9-9577-987812444006 Sep 23 14:46:22 devstack sudo[101038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:46:23 devstack sudo[101038]: pam_unix(sudo:session): session closed for user root Sep 23 14:46:23 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-42de33c3-693b-4484-81b7-6856b52db29e tempest-ProjectReaderTests-1981877916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-64aa5860-b82b-44e9-9577-987812444006" returned: 0 in 0.332s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:46:23 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-42de33c3-693b-4484-81b7-6856b52db29e tempest-ProjectReaderTests-1981877916 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:46:23 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-42de33c3-693b-4484-81b7-6856b52db29e tempest-ProjectReaderTests-1981877916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:46:23 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-42de33c3-693b-4484-81b7-6856b52db29e tempest-ProjectReaderTests-1981877916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d958da09-3ea7-42d4-891c-0501e39ff86b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64aa5860-b82b-44e9-9577-987812444006', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:46:23 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-42de33c3-693b-4484-81b7-6856b52db29e tempest-ProjectReaderTests-1981877916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c53749e-a024-4068-83ff-b3835ccf2579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:46:23 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-42de33c3-693b-4484-81b7-6856b52db29e tempest-ProjectReaderTests-1981877916 None] Volume volume-64aa5860-b82b-44e9-9577-987812444006 (64aa5860-b82b-44e9-9577-987812444006): created successfully Sep 23 14:46:23 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-42de33c3-693b-4484-81b7-6856b52db29e tempest-ProjectReaderTests-1981877916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c53749e-a024-4068-83ff-b3835ccf2579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:46:23 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-42de33c3-693b-4484-81b7-6856b52db29e tempest-ProjectReaderTests-1981877916 None] Flow 'volume_create_manager' (bff64caf-6b21-4f04-9a9a-7329fdfac0e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:46:23 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-42de33c3-693b-4484-81b7-6856b52db29e tempest-ProjectReaderTests-1981877916 None] Created volume successfully. Sep 23 14:46:24 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [req-9154f511-ad07-4f96-9ea4-b98b3908d0a3 req-7c5527fd-4031-49c4-bd60-8402a2db57f4 tempest-TestStampPattern-1114451325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:46:24 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [req-9154f511-ad07-4f96-9ea4-b98b3908d0a3 req-7c5527fd-4031-49c4-bd60-8402a2db57f4 tempest-TestStampPattern-1114451325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:46:24 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [req-9154f511-ad07-4f96-9ea4-b98b3908d0a3 req-7c5527fd-4031-49c4-bd60-8402a2db57f4 tempest-TestStampPattern-1114451325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:46:24 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [req-9154f511-ad07-4f96-9ea4-b98b3908d0a3 req-7c5527fd-4031-49c4-bd60-8402a2db57f4 tempest-TestStampPattern-1114451325 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362', 'name': 'volume-b48b56ce-ca56-4a1f-a71a-0c0613fd3960', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '599fa4dd-20a8-4403-8daf-37bf19075c44', 'enforce_multipath': True} {{(pid=86310) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 14:46:24 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-c529fbd3-c881-45e3-b5e3-6e82af0ecbd0 tempest-ProjectReaderTests-1981877916 None] Acquiring lock "cinder-64aa5860-b82b-44e9-9577-987812444006-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:46:24 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-c529fbd3-c881-45e3-b5e3-6e82af0ecbd0 tempest-ProjectReaderTests-1981877916 None] Lock "cinder-64aa5860-b82b-44e9-9577-987812444006-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:46:24 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-c529fbd3-c881-45e3-b5e3-6e82af0ecbd0 tempest-ProjectReaderTests-1981877916 None] Acquiring lock "cinder-quobyte-64aa5860-b82b-44e9-9577-987812444006" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:46:24 devstack cinder-volume[86310]: INFO cinder.volume.manager [req-9154f511-ad07-4f96-9ea4-b98b3908d0a3 req-7c5527fd-4031-49c4-bd60-8402a2db57f4 tempest-TestStampPattern-1114451325 None] attachment_update completed successfully. Sep 23 14:46:24 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-c529fbd3-c881-45e3-b5e3-6e82af0ecbd0 tempest-ProjectReaderTests-1981877916 None] Lock "cinder-quobyte-64aa5860-b82b-44e9-9577-987812444006" acquired by "delete_volume" :: waited 0.034s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:46:24 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[460530c6-d49c-4664-b9a7-a876b94eb810]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:46:24 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-c529fbd3-c881-45e3-b5e3-6e82af0ecbd0 tempest-ProjectReaderTests-1981877916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-64aa5860-b82b-44e9-9577-987812444006 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:46:24 devstack sudo[101077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-64aa5860-b82b-44e9-9577-987812444006 Sep 23 14:46:24 devstack sudo[101077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:46:25 devstack sudo[101077]: pam_unix(sudo:session): session closed for user root Sep 23 14:46:25 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-c529fbd3-c881-45e3-b5e3-6e82af0ecbd0 tempest-ProjectReaderTests-1981877916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-64aa5860-b82b-44e9-9577-987812444006" returned: 0 in 0.646s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:46:25 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-c529fbd3-c881-45e3-b5e3-6e82af0ecbd0 tempest-ProjectReaderTests-1981877916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-64aa5860-b82b-44e9-9577-987812444006 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:46:25 devstack sudo[101085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-64aa5860-b82b-44e9-9577-987812444006 Sep 23 14:46:25 devstack sudo[101085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:46:25 devstack cinder-volume[86310]: INFO cinder.volume.manager [req-fa79008e-3c7b-4365-8b55-64ee9da2f961 req-d2069b2a-fe09-48b9-9c96-ebec43259001 tempest-TestInstancesWithCinderVolumes-584005076 None] Terminate volume connection completed successfully. Sep 23 14:46:25 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [req-fa79008e-3c7b-4365-8b55-64ee9da2f961 req-d2069b2a-fe09-48b9-9c96-ebec43259001 tempest-TestInstancesWithCinderVolumes-584005076 None] Deleting attachment 78cb8053-c2e1-4388-9082-bd08bb5184e0. {{(pid=86310) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 14:46:25 devstack sudo[101085]: pam_unix(sudo:session): session closed for user root Sep 23 14:46:25 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-c529fbd3-c881-45e3-b5e3-6e82af0ecbd0 tempest-ProjectReaderTests-1981877916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-64aa5860-b82b-44e9-9577-987812444006" returned: 0 in 0.395s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:46:25 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-c529fbd3-c881-45e3-b5e3-6e82af0ecbd0 tempest-ProjectReaderTests-1981877916 None] Lock "cinder-quobyte-64aa5860-b82b-44e9-9577-987812444006" released by "delete_volume" :: held 1.129s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:46:25 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-c529fbd3-c881-45e3-b5e3-6e82af0ecbd0 tempest-ProjectReaderTests-1981877916 None] Created reservations ['ad0ce946-e96d-4bc5-af5f-877856290f8b', '1cbff83d-cfa8-4b53-ab8d-36e0ca14e24c', '7c1cf405-e9ca-4923-996d-5b4048bcd6d1', '2aaeff83-36a6-4510-82c7-eff2368f6e16'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:46:25 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-c529fbd3-c881-45e3-b5e3-6e82af0ecbd0 tempest-ProjectReaderTests-1981877916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:46:25 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-c529fbd3-c881-45e3-b5e3-6e82af0ecbd0 tempest-ProjectReaderTests-1981877916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:46:25 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-c529fbd3-c881-45e3-b5e3-6e82af0ecbd0 tempest-ProjectReaderTests-1981877916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:46:25 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-c529fbd3-c881-45e3-b5e3-6e82af0ecbd0 tempest-ProjectReaderTests-1981877916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:46:25 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-c529fbd3-c881-45e3-b5e3-6e82af0ecbd0 tempest-ProjectReaderTests-1981877916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:46:25 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-c529fbd3-c881-45e3-b5e3-6e82af0ecbd0 tempest-ProjectReaderTests-1981877916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:46:25 devstack sudo[101090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:46:25 devstack sudo[101090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:46:26 devstack sudo[101090]: pam_unix(sudo:session): session closed for user root Sep 23 14:46:26 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-c529fbd3-c881-45e3-b5e3-6e82af0ecbd0 tempest-ProjectReaderTests-1981877916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.318s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:46:26 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-c529fbd3-c881-45e3-b5e3-6e82af0ecbd0 tempest-ProjectReaderTests-1981877916 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:46:26 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-c529fbd3-c881-45e3-b5e3-6e82af0ecbd0 tempest-ProjectReaderTests-1981877916 None] Deleted volume successfully. Sep 23 14:46:26 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-c529fbd3-c881-45e3-b5e3-6e82af0ecbd0 tempest-ProjectReaderTests-1981877916 None] Lock "cinder-64aa5860-b82b-44e9-9577-987812444006-delete_volume" released by "delete_volume" :: held 1.801s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:46:26 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-d10732c2-9a61-4863-91bf-74db0b6b2e0b tempest-TestInstancesWithCinderVolumes-584005076 None] Acquiring lock "cinder-114fc2d4-faab-401b-818b-46d764af0586-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:46:26 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-d10732c2-9a61-4863-91bf-74db0b6b2e0b tempest-TestInstancesWithCinderVolumes-584005076 None] Lock "cinder-114fc2d4-faab-401b-818b-46d764af0586-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:46:26 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-d10732c2-9a61-4863-91bf-74db0b6b2e0b tempest-TestInstancesWithCinderVolumes-584005076 None] Acquiring lock "cinder-quobyte-114fc2d4-faab-401b-818b-46d764af0586" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:46:26 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-d10732c2-9a61-4863-91bf-74db0b6b2e0b tempest-TestInstancesWithCinderVolumes-584005076 None] Lock "cinder-quobyte-114fc2d4-faab-401b-818b-46d764af0586" acquired by "delete_volume" :: waited 0.028s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:46:26 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[e35453da-de5b-490d-87e8-028829d11d8c]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:46:26 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d10732c2-9a61-4863-91bf-74db0b6b2e0b tempest-TestInstancesWithCinderVolumes-584005076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-114fc2d4-faab-401b-818b-46d764af0586 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:46:26 devstack sudo[101135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-114fc2d4-faab-401b-818b-46d764af0586 Sep 23 14:46:26 devstack sudo[101135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:46:26 devstack sudo[101135]: pam_unix(sudo:session): session closed for user root Sep 23 14:46:26 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d10732c2-9a61-4863-91bf-74db0b6b2e0b tempest-TestInstancesWithCinderVolumes-584005076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-114fc2d4-faab-401b-818b-46d764af0586" returned: 0 in 0.535s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:46:26 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d10732c2-9a61-4863-91bf-74db0b6b2e0b tempest-TestInstancesWithCinderVolumes-584005076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-114fc2d4-faab-401b-818b-46d764af0586 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:46:26 devstack sudo[101144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-114fc2d4-faab-401b-818b-46d764af0586 Sep 23 14:46:26 devstack sudo[101144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:46:27 devstack sudo[101144]: pam_unix(sudo:session): session closed for user root Sep 23 14:46:27 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d10732c2-9a61-4863-91bf-74db0b6b2e0b tempest-TestInstancesWithCinderVolumes-584005076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-114fc2d4-faab-401b-818b-46d764af0586" returned: 0 in 0.431s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:46:27 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-d10732c2-9a61-4863-91bf-74db0b6b2e0b tempest-TestInstancesWithCinderVolumes-584005076 None] Lock "cinder-quobyte-114fc2d4-faab-401b-818b-46d764af0586" released by "delete_volume" :: held 1.056s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:46:27 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ffea4f6-9adb-49bb-a9b6-ce377809c820 tempest-ProjectReaderTests-1981877916 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:46:27 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-8ffea4f6-9adb-49bb-a9b6-ce377809c820 tempest-ProjectReaderTests-1981877916 None] Flow 'volume_create_manager' (803f4dfc-a46a-4907-9b87-ea157fbf20e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:46:27 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-8ffea4f6-9adb-49bb-a9b6-ce377809c820 tempest-ProjectReaderTests-1981877916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e6592f5-d313-440b-b963-a1b9087e07a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:46:27 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-8ffea4f6-9adb-49bb-a9b6-ce377809c820 tempest-ProjectReaderTests-1981877916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e6592f5-d313-440b-b963-a1b9087e07a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:46:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-302651792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=544c9329-a5c8-444a-9e83-9e624b2d6b20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a04cd61a1194d70b76a941cf38d538d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:46:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:46:27Z,use_quota=True,user_id='e21d082db06a4975be83d644c824ab63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:46:27 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-8ffea4f6-9adb-49bb-a9b6-ce377809c820 tempest-ProjectReaderTests-1981877916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19585948-67d8-4950-822a-62b2c936114c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:46:27 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-8ffea4f6-9adb-49bb-a9b6-ce377809c820 tempest-ProjectReaderTests-1981877916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19585948-67d8-4950-822a-62b2c936114c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:46:27 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-8ffea4f6-9adb-49bb-a9b6-ce377809c820 tempest-ProjectReaderTests-1981877916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (791be3ca-f0c8-4529-bedc-78faf3d7c74e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:46:27 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-8ffea4f6-9adb-49bb-a9b6-ce377809c820 tempest-ProjectReaderTests-1981877916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (791be3ca-f0c8-4529-bedc-78faf3d7c74e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '544c9329-a5c8-444a-9e83-9e624b2d6b20', 'volume_name': 'volume-544c9329-a5c8-444a-9e83-9e624b2d6b20', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:46:27 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-8ffea4f6-9adb-49bb-a9b6-ce377809c820 tempest-ProjectReaderTests-1981877916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (373cde33-8ce7-4534-8213-2bd9b0d380e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:46:27 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-8ffea4f6-9adb-49bb-a9b6-ce377809c820 tempest-ProjectReaderTests-1981877916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (373cde33-8ce7-4534-8213-2bd9b0d380e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:46:27 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-8ffea4f6-9adb-49bb-a9b6-ce377809c820 tempest-ProjectReaderTests-1981877916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bc5d475-6991-43be-8dfa-19b7d2c8ceef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:46:27 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-8ffea4f6-9adb-49bb-a9b6-ce377809c820 tempest-ProjectReaderTests-1981877916 None] Volume 544c9329-a5c8-444a-9e83-9e624b2d6b20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-544c9329-a5c8-444a-9e83-9e624b2d6b20', 'volume_size': 1} Sep 23 14:46:27 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-8ffea4f6-9adb-49bb-a9b6-ce377809c820 tempest-ProjectReaderTests-1981877916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:46:27 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-8ffea4f6-9adb-49bb-a9b6-ce377809c820 tempest-ProjectReaderTests-1981877916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:46:27 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-8ffea4f6-9adb-49bb-a9b6-ce377809c820 tempest-ProjectReaderTests-1981877916 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:46:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-302651792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=544c9329-a5c8-444a-9e83-9e624b2d6b20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a04cd61a1194d70b76a941cf38d538d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:46:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:46:27Z,use_quota=True,user_id='e21d082db06a4975be83d644c824ab63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:46:27 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-8ffea4f6-9adb-49bb-a9b6-ce377809c820 tempest-ProjectReaderTests-1981877916 None] Creating volume 544c9329-a5c8-444a-9e83-9e624b2d6b20 {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:46:27 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-8ffea4f6-9adb-49bb-a9b6-ce377809c820 tempest-ProjectReaderTests-1981877916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:46:27 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-8ffea4f6-9adb-49bb-a9b6-ce377809c820 tempest-ProjectReaderTests-1981877916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:46:27 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-8ffea4f6-9adb-49bb-a9b6-ce377809c820 tempest-ProjectReaderTests-1981877916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:46:27 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-8ffea4f6-9adb-49bb-a9b6-ce377809c820 tempest-ProjectReaderTests-1981877916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:46:27 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-8ffea4f6-9adb-49bb-a9b6-ce377809c820 tempest-ProjectReaderTests-1981877916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:46:27 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-8ffea4f6-9adb-49bb-a9b6-ce377809c820 tempest-ProjectReaderTests-1981877916 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:46:27 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-8ffea4f6-9adb-49bb-a9b6-ce377809c820 tempest-ProjectReaderTests-1981877916 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:46:27 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8ffea4f6-9adb-49bb-a9b6-ce377809c820 tempest-ProjectReaderTests-1981877916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-544c9329-a5c8-444a-9e83-9e624b2d6b20 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:46:27 devstack sudo[101147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-544c9329-a5c8-444a-9e83-9e624b2d6b20 1073741824 Sep 23 14:46:27 devstack sudo[101147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:46:27 devstack cinder-volume[86310]: WARNING cinder.quota [None req-d10732c2-9a61-4863-91bf-74db0b6b2e0b tempest-TestInstancesWithCinderVolumes-584005076 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-995040078-1313166051 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-995040078-1313166051, it is now deprecated. Please use the default quota class for default quota. Sep 23 14:46:27 devstack cinder-volume[86310]: WARNING cinder.quota [None req-d10732c2-9a61-4863-91bf-74db0b6b2e0b tempest-TestInstancesWithCinderVolumes-584005076 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-995040078-1313166051 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-995040078-1313166051, it is now deprecated. Please use the default quota class for default quota. Sep 23 14:46:27 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-d10732c2-9a61-4863-91bf-74db0b6b2e0b tempest-TestInstancesWithCinderVolumes-584005076 None] Created reservations ['ebc6511a-2e3d-4ce3-8880-3c79a2679881', '06b60e44-6713-4254-9594-d214aa706ca2', '8c6f137f-9c74-447f-a33c-38c615f26753', 'ab8312b0-7e3f-4f65-bd87-44b04cdb0797'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:46:27 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-d10732c2-9a61-4863-91bf-74db0b6b2e0b tempest-TestInstancesWithCinderVolumes-584005076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:46:27 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-d10732c2-9a61-4863-91bf-74db0b6b2e0b tempest-TestInstancesWithCinderVolumes-584005076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:46:27 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-d10732c2-9a61-4863-91bf-74db0b6b2e0b tempest-TestInstancesWithCinderVolumes-584005076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:46:27 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-d10732c2-9a61-4863-91bf-74db0b6b2e0b tempest-TestInstancesWithCinderVolumes-584005076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:46:27 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-d10732c2-9a61-4863-91bf-74db0b6b2e0b tempest-TestInstancesWithCinderVolumes-584005076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:46:27 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d10732c2-9a61-4863-91bf-74db0b6b2e0b tempest-TestInstancesWithCinderVolumes-584005076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:46:27 devstack sudo[101149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:46:27 devstack sudo[101149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:46:28 devstack sudo[101147]: pam_unix(sudo:session): session closed for user root Sep 23 14:46:28 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8ffea4f6-9adb-49bb-a9b6-ce377809c820 tempest-ProjectReaderTests-1981877916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-544c9329-a5c8-444a-9e83-9e624b2d6b20 1073741824" returned: 0 in 0.600s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:46:28 devstack sudo[101149]: pam_unix(sudo:session): session closed for user root Sep 23 14:46:28 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d10732c2-9a61-4863-91bf-74db0b6b2e0b tempest-TestInstancesWithCinderVolumes-584005076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.416s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:46:28 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-d10732c2-9a61-4863-91bf-74db0b6b2e0b tempest-TestInstancesWithCinderVolumes-584005076 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:46:28 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-d10732c2-9a61-4863-91bf-74db0b6b2e0b tempest-TestInstancesWithCinderVolumes-584005076 None] Deleted volume successfully. Sep 23 14:46:28 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-d10732c2-9a61-4863-91bf-74db0b6b2e0b tempest-TestInstancesWithCinderVolumes-584005076 None] Lock "cinder-114fc2d4-faab-401b-818b-46d764af0586-delete_volume" released by "delete_volume" :: held 2.017s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:46:28 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8ffea4f6-9adb-49bb-a9b6-ce377809c820 tempest-ProjectReaderTests-1981877916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-544c9329-a5c8-444a-9e83-9e624b2d6b20 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:46:28 devstack sudo[101157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-544c9329-a5c8-444a-9e83-9e624b2d6b20 Sep 23 14:46:28 devstack sudo[101157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:46:28 devstack sudo[101157]: pam_unix(sudo:session): session closed for user root Sep 23 14:46:28 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8ffea4f6-9adb-49bb-a9b6-ce377809c820 tempest-ProjectReaderTests-1981877916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-544c9329-a5c8-444a-9e83-9e624b2d6b20" returned: 0 in 0.315s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:46:28 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-8ffea4f6-9adb-49bb-a9b6-ce377809c820 tempest-ProjectReaderTests-1981877916 None] <== create_volume: return (1068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:46:28 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-8ffea4f6-9adb-49bb-a9b6-ce377809c820 tempest-ProjectReaderTests-1981877916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:46:28 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-8ffea4f6-9adb-49bb-a9b6-ce377809c820 tempest-ProjectReaderTests-1981877916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bc5d475-6991-43be-8dfa-19b7d2c8ceef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-544c9329-a5c8-444a-9e83-9e624b2d6b20', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:46:28 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-8ffea4f6-9adb-49bb-a9b6-ce377809c820 tempest-ProjectReaderTests-1981877916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa7d9334-a6bf-4552-9159-0bfb9f003572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:46:28 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-8ffea4f6-9adb-49bb-a9b6-ce377809c820 tempest-ProjectReaderTests-1981877916 None] Volume volume-544c9329-a5c8-444a-9e83-9e624b2d6b20 (544c9329-a5c8-444a-9e83-9e624b2d6b20): created successfully Sep 23 14:46:28 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-8ffea4f6-9adb-49bb-a9b6-ce377809c820 tempest-ProjectReaderTests-1981877916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa7d9334-a6bf-4552-9159-0bfb9f003572) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:46:28 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-8ffea4f6-9adb-49bb-a9b6-ce377809c820 tempest-ProjectReaderTests-1981877916 None] Flow 'volume_create_manager' (803f4dfc-a46a-4907-9b87-ea157fbf20e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:46:28 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-8ffea4f6-9adb-49bb-a9b6-ce377809c820 tempest-ProjectReaderTests-1981877916 None] Created volume successfully. Sep 23 14:46:29 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-c3fc2811-bf6c-4855-9aa5-65e51912fa2d tempest-ProjectReaderTests-1981877916 None] Acquiring lock "cinder-544c9329-a5c8-444a-9e83-9e624b2d6b20-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:46:29 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-c3fc2811-bf6c-4855-9aa5-65e51912fa2d tempest-ProjectReaderTests-1981877916 None] Lock "cinder-544c9329-a5c8-444a-9e83-9e624b2d6b20-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:46:29 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-c3fc2811-bf6c-4855-9aa5-65e51912fa2d tempest-ProjectReaderTests-1981877916 None] Acquiring lock "cinder-quobyte-544c9329-a5c8-444a-9e83-9e624b2d6b20" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:46:29 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-c3fc2811-bf6c-4855-9aa5-65e51912fa2d tempest-ProjectReaderTests-1981877916 None] Lock "cinder-quobyte-544c9329-a5c8-444a-9e83-9e624b2d6b20" acquired by "delete_volume" :: waited 0.022s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:46:29 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[8303d56e-b5b1-429c-9556-7413f1509163]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:46:29 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-c3fc2811-bf6c-4855-9aa5-65e51912fa2d tempest-ProjectReaderTests-1981877916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-544c9329-a5c8-444a-9e83-9e624b2d6b20 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:46:29 devstack sudo[101172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-544c9329-a5c8-444a-9e83-9e624b2d6b20 Sep 23 14:46:29 devstack sudo[101172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:46:30 devstack sudo[101172]: pam_unix(sudo:session): session closed for user root Sep 23 14:46:30 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-c3fc2811-bf6c-4855-9aa5-65e51912fa2d tempest-ProjectReaderTests-1981877916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-544c9329-a5c8-444a-9e83-9e624b2d6b20" returned: 0 in 0.591s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:46:30 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-c3fc2811-bf6c-4855-9aa5-65e51912fa2d tempest-ProjectReaderTests-1981877916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-544c9329-a5c8-444a-9e83-9e624b2d6b20 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:46:30 devstack sudo[101179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-544c9329-a5c8-444a-9e83-9e624b2d6b20 Sep 23 14:46:30 devstack sudo[101179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:46:30 devstack sudo[101179]: pam_unix(sudo:session): session closed for user root Sep 23 14:46:30 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-c3fc2811-bf6c-4855-9aa5-65e51912fa2d tempest-ProjectReaderTests-1981877916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-544c9329-a5c8-444a-9e83-9e624b2d6b20" returned: 0 in 0.580s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:46:31 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-c3fc2811-bf6c-4855-9aa5-65e51912fa2d tempest-ProjectReaderTests-1981877916 None] Lock "cinder-quobyte-544c9329-a5c8-444a-9e83-9e624b2d6b20" released by "delete_volume" :: held 1.272s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:46:31 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-c3fc2811-bf6c-4855-9aa5-65e51912fa2d tempest-ProjectReaderTests-1981877916 None] Created reservations ['60e7fe15-2574-4377-ab48-220f5831e023', 'ff25a0a7-7206-4aa7-aea1-2a856f25c736', 'c7168621-037a-4b53-9a34-d9ec03478926', 'e9ac979e-61fb-46ef-87e5-5e40f8b3e0aa'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:46:31 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-c3fc2811-bf6c-4855-9aa5-65e51912fa2d tempest-ProjectReaderTests-1981877916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:46:31 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-c3fc2811-bf6c-4855-9aa5-65e51912fa2d tempest-ProjectReaderTests-1981877916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:46:31 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-c3fc2811-bf6c-4855-9aa5-65e51912fa2d tempest-ProjectReaderTests-1981877916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:46:31 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-c3fc2811-bf6c-4855-9aa5-65e51912fa2d tempest-ProjectReaderTests-1981877916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:46:31 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-c3fc2811-bf6c-4855-9aa5-65e51912fa2d tempest-ProjectReaderTests-1981877916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:46:31 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-c3fc2811-bf6c-4855-9aa5-65e51912fa2d tempest-ProjectReaderTests-1981877916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:46:31 devstack sudo[101201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:46:31 devstack sudo[101201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:46:31 devstack cinder-volume[86310]: INFO cinder.volume.manager [req-a7e3e90b-0d37-4a53-931d-68a12de005fa req-0dded6e5-1027-4cb6-b4a7-235c2e11d7c4 tempest-TestStampPattern-1114451325 None] Terminate volume connection completed successfully. Sep 23 14:46:31 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [req-a7e3e90b-0d37-4a53-931d-68a12de005fa req-0dded6e5-1027-4cb6-b4a7-235c2e11d7c4 tempest-TestStampPattern-1114451325 None] Deleting attachment 599fa4dd-20a8-4403-8daf-37bf19075c44. {{(pid=86310) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 14:46:31 devstack sudo[101201]: pam_unix(sudo:session): session closed for user root Sep 23 14:46:31 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-c3fc2811-bf6c-4855-9aa5-65e51912fa2d tempest-ProjectReaderTests-1981877916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.346s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:46:31 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-c3fc2811-bf6c-4855-9aa5-65e51912fa2d tempest-ProjectReaderTests-1981877916 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:46:31 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-c3fc2811-bf6c-4855-9aa5-65e51912fa2d tempest-ProjectReaderTests-1981877916 None] Deleted volume successfully. Sep 23 14:46:31 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-c3fc2811-bf6c-4855-9aa5-65e51912fa2d tempest-ProjectReaderTests-1981877916 None] Lock "cinder-544c9329-a5c8-444a-9e83-9e624b2d6b20-delete_volume" released by "delete_volume" :: held 1.943s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:46:32 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-92b64ab9-4158-452c-a968-f0f96e03a6e2 tempest-TestStampPattern-1114451325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:46:32 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-92b64ab9-4158-452c-a968-f0f96e03a6e2 tempest-TestStampPattern-1114451325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:46:32 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-92b64ab9-4158-452c-a968-f0f96e03a6e2 tempest-TestStampPattern-1114451325 None] Creating offline snapshot 421cf3f0-0ede-4125-a838-d138ea04ac58 of volume b48b56ce-ca56-4a1f-a71a-0c0613fd3960 {{(pid=86310) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 14:46:32 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f8433d2-1df8-4840-a5f8-21a5cb9c1ea0]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:46:32 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-92b64ab9-4158-452c-a968-f0f96e03a6e2 tempest-TestStampPattern-1114451325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b48b56ce-ca56-4a1f-a71a-0c0613fd3960 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:46:32 devstack sudo[101208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b48b56ce-ca56-4a1f-a71a-0c0613fd3960 Sep 23 14:46:32 devstack sudo[101208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:46:32 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d1e59a2-f94e-4530-ac90-b2577fef1534 tempest-ProjectReaderTests-1981877916 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:46:32 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-9d1e59a2-f94e-4530-ac90-b2577fef1534 tempest-ProjectReaderTests-1981877916 None] Flow 'volume_create_manager' (d6c4ee5e-f213-4c4f-b9c8-96ca46d0f182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:46:32 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-9d1e59a2-f94e-4530-ac90-b2577fef1534 tempest-ProjectReaderTests-1981877916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcae293d-d62d-44bd-980c-7c4a4b8d3a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:46:32 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-9d1e59a2-f94e-4530-ac90-b2577fef1534 tempest-ProjectReaderTests-1981877916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcae293d-d62d-44bd-980c-7c4a4b8d3a2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:46:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2021216917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbccb7da-3910-41d8-bd4f-478bc648882f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a04cd61a1194d70b76a941cf38d538d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:46:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:46:33Z,use_quota=True,user_id='e21d082db06a4975be83d644c824ab63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:46:32 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-9d1e59a2-f94e-4530-ac90-b2577fef1534 tempest-ProjectReaderTests-1981877916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57bbfcef-9ea5-4bda-845a-2725fb301a72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:46:32 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-9d1e59a2-f94e-4530-ac90-b2577fef1534 tempest-ProjectReaderTests-1981877916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57bbfcef-9ea5-4bda-845a-2725fb301a72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:46:32 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-9d1e59a2-f94e-4530-ac90-b2577fef1534 tempest-ProjectReaderTests-1981877916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3cb698c-6e55-4935-b43a-4f29d36da795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:46:32 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-9d1e59a2-f94e-4530-ac90-b2577fef1534 tempest-ProjectReaderTests-1981877916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3cb698c-6e55-4935-b43a-4f29d36da795) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bbccb7da-3910-41d8-bd4f-478bc648882f', 'volume_name': 'volume-bbccb7da-3910-41d8-bd4f-478bc648882f', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:46:32 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-9d1e59a2-f94e-4530-ac90-b2577fef1534 tempest-ProjectReaderTests-1981877916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7411bbd2-5c77-4b2c-aeda-c2a1fe8eeca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:46:32 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-9d1e59a2-f94e-4530-ac90-b2577fef1534 tempest-ProjectReaderTests-1981877916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7411bbd2-5c77-4b2c-aeda-c2a1fe8eeca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:46:32 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-9d1e59a2-f94e-4530-ac90-b2577fef1534 tempest-ProjectReaderTests-1981877916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c6f2c04-2cf6-4ec3-ad09-09c6f3b88e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:46:32 devstack sudo[101208]: pam_unix(sudo:session): session closed for user root Sep 23 14:46:32 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-9d1e59a2-f94e-4530-ac90-b2577fef1534 tempest-ProjectReaderTests-1981877916 None] Volume bbccb7da-3910-41d8-bd4f-478bc648882f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bbccb7da-3910-41d8-bd4f-478bc648882f', 'volume_size': 1} Sep 23 14:46:32 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-9d1e59a2-f94e-4530-ac90-b2577fef1534 tempest-ProjectReaderTests-1981877916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:46:32 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-92b64ab9-4158-452c-a968-f0f96e03a6e2 tempest-TestStampPattern-1114451325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b48b56ce-ca56-4a1f-a71a-0c0613fd3960" returned: 0 in 0.578s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:46:32 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-92b64ab9-4158-452c-a968-f0f96e03a6e2 tempest-TestStampPattern-1114451325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b48b56ce-ca56-4a1f-a71a-0c0613fd3960,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b48b56ce-ca56-4a1f-a71a-0c0613fd3960.421cf3f0-0ede-4125-a838-d138ea04ac58 1G {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:46:32 devstack cinder-volume[86310]: INFO cinder.volume.manager [req-5093febb-e78a-46ad-bc4e-eb4760ba9c3e req-d3ee6c6d-1167-4ca7-816b-9aad2025120c tempest-TestInstancesWithCinderVolumes-584005076 None] Terminate volume connection completed successfully. Sep 23 14:46:32 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [req-5093febb-e78a-46ad-bc4e-eb4760ba9c3e req-d3ee6c6d-1167-4ca7-816b-9aad2025120c tempest-TestInstancesWithCinderVolumes-584005076 None] Deleting attachment c6fd3255-366f-4211-9f47-0f388c64a406. {{(pid=86310) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 14:46:32 devstack sudo[101215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b48b56ce-ca56-4a1f-a71a-0c0613fd3960,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b48b56ce-ca56-4a1f-a71a-0c0613fd3960.421cf3f0-0ede-4125-a838-d138ea04ac58 1G Sep 23 14:46:32 devstack sudo[101215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:46:33 devstack sudo[101215]: pam_unix(sudo:session): session closed for user root Sep 23 14:46:33 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-92b64ab9-4158-452c-a968-f0f96e03a6e2 tempest-TestStampPattern-1114451325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b48b56ce-ca56-4a1f-a71a-0c0613fd3960,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b48b56ce-ca56-4a1f-a71a-0c0613fd3960.421cf3f0-0ede-4125-a838-d138ea04ac58 1G" returned: 0 in 0.608s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:46:33 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-92b64ab9-4158-452c-a968-f0f96e03a6e2 tempest-TestStampPattern-1114451325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b48b56ce-ca56-4a1f-a71a-0c0613fd3960 -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b48b56ce-ca56-4a1f-a71a-0c0613fd3960.421cf3f0-0ede-4125-a838-d138ea04ac58 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:46:33 devstack sudo[101220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b48b56ce-ca56-4a1f-a71a-0c0613fd3960 -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b48b56ce-ca56-4a1f-a71a-0c0613fd3960.421cf3f0-0ede-4125-a838-d138ea04ac58 Sep 23 14:46:33 devstack sudo[101220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:46:33 devstack sudo[101220]: pam_unix(sudo:session): session closed for user root Sep 23 14:46:34 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-92b64ab9-4158-452c-a968-f0f96e03a6e2 tempest-TestStampPattern-1114451325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b48b56ce-ca56-4a1f-a71a-0c0613fd3960 -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b48b56ce-ca56-4a1f-a71a-0c0613fd3960.421cf3f0-0ede-4125-a838-d138ea04ac58" returned: 0 in 0.492s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:46:34 devstack cinder-volume[86310]: WARNING cinder.volume.drivers.remotefs [None req-92b64ab9-4158-452c-a968-f0f96e03a6e2 tempest-TestStampPattern-1114451325 None] /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b48b56ce-ca56-4a1f-a71a-0c0613fd3960.421cf3f0-0ede-4125-a838-d138ea04ac58 is being set with open permissions: ugo+rw Sep 23 14:46:34 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-92b64ab9-4158-452c-a968-f0f96e03a6e2 tempest-TestStampPattern-1114451325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b48b56ce-ca56-4a1f-a71a-0c0613fd3960.421cf3f0-0ede-4125-a838-d138ea04ac58 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:46:34 devstack sudo[101232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b48b56ce-ca56-4a1f-a71a-0c0613fd3960.421cf3f0-0ede-4125-a838-d138ea04ac58 Sep 23 14:46:34 devstack sudo[101232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:46:34 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-11dee5d1-633d-4f68-ba8f-11214be99861 tempest-TestInstancesWithCinderVolumes-584005076 None] Acquiring lock "cinder-b7229c51-b135-4bf7-b03a-c85b483bbab5-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:46:34 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-11dee5d1-633d-4f68-ba8f-11214be99861 tempest-TestInstancesWithCinderVolumes-584005076 None] Lock "cinder-b7229c51-b135-4bf7-b03a-c85b483bbab5-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:46:34 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-11dee5d1-633d-4f68-ba8f-11214be99861 tempest-TestInstancesWithCinderVolumes-584005076 None] Acquiring lock "cinder-quobyte-b7229c51-b135-4bf7-b03a-c85b483bbab5" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:46:34 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-11dee5d1-633d-4f68-ba8f-11214be99861 tempest-TestInstancesWithCinderVolumes-584005076 None] Lock "cinder-quobyte-b7229c51-b135-4bf7-b03a-c85b483bbab5" acquired by "delete_volume" :: waited 0.023s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:46:34 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c570e1f-16a3-4aea-a396-2cb30de342d4]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:46:34 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-11dee5d1-633d-4f68-ba8f-11214be99861 tempest-TestInstancesWithCinderVolumes-584005076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b7229c51-b135-4bf7-b03a-c85b483bbab5 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:46:34 devstack sudo[101232]: pam_unix(sudo:session): session closed for user root Sep 23 14:46:34 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-92b64ab9-4158-452c-a968-f0f96e03a6e2 tempest-TestStampPattern-1114451325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b48b56ce-ca56-4a1f-a71a-0c0613fd3960.421cf3f0-0ede-4125-a838-d138ea04ac58" returned: 0 in 0.315s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:46:34 devstack sudo[101234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b7229c51-b135-4bf7-b03a-c85b483bbab5 Sep 23 14:46:34 devstack sudo[101234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:46:34 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-92b64ab9-4158-452c-a968-f0f96e03a6e2 tempest-TestStampPattern-1114451325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b48b56ce-ca56-4a1f-a71a-0c0613fd3960.info {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:46:34 devstack sudo[101237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b48b56ce-ca56-4a1f-a71a-0c0613fd3960.info Sep 23 14:46:34 devstack sudo[101237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:46:34 devstack sudo[101237]: pam_unix(sudo:session): session closed for user root Sep 23 14:46:34 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-92b64ab9-4158-452c-a968-f0f96e03a6e2 tempest-TestStampPattern-1114451325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b48b56ce-ca56-4a1f-a71a-0c0613fd3960.info" returned: 0 in 0.297s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:46:34 devstack cinder-volume[86310]: WARNING cinder.volume.drivers.remotefs [None req-92b64ab9-4158-452c-a968-f0f96e03a6e2 tempest-TestStampPattern-1114451325 None] /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b48b56ce-ca56-4a1f-a71a-0c0613fd3960.info is being set with open permissions: ugo+rw Sep 23 14:46:34 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-92b64ab9-4158-452c-a968-f0f96e03a6e2 tempest-TestStampPattern-1114451325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b48b56ce-ca56-4a1f-a71a-0c0613fd3960.info {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:46:34 devstack sudo[101234]: pam_unix(sudo:session): session closed for user root Sep 23 14:46:34 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-11dee5d1-633d-4f68-ba8f-11214be99861 tempest-TestInstancesWithCinderVolumes-584005076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b7229c51-b135-4bf7-b03a-c85b483bbab5" returned: 0 in 0.477s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:46:34 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-11dee5d1-633d-4f68-ba8f-11214be99861 tempest-TestInstancesWithCinderVolumes-584005076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b7229c51-b135-4bf7-b03a-c85b483bbab5 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:46:34 devstack sudo[101243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b48b56ce-ca56-4a1f-a71a-0c0613fd3960.info Sep 23 14:46:34 devstack sudo[101243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:46:34 devstack sudo[101244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b7229c51-b135-4bf7-b03a-c85b483bbab5 Sep 23 14:46:34 devstack sudo[101244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:46:34 devstack sudo[101243]: pam_unix(sudo:session): session closed for user root Sep 23 14:46:34 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-92b64ab9-4158-452c-a968-f0f96e03a6e2 tempest-TestStampPattern-1114451325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b48b56ce-ca56-4a1f-a71a-0c0613fd3960.info" returned: 0 in 0.319s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:46:35 devstack sudo[101244]: pam_unix(sudo:session): session closed for user root Sep 23 14:46:35 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-92b64ab9-4158-452c-a968-f0f96e03a6e2 tempest-TestStampPattern-1114451325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.742s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:46:35 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-9d1e59a2-f94e-4530-ac90-b2577fef1534 tempest-ProjectReaderTests-1981877916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.132s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:46:35 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-9d1e59a2-f94e-4530-ac90-b2577fef1534 tempest-ProjectReaderTests-1981877916 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:46:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2021216917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbccb7da-3910-41d8-bd4f-478bc648882f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a04cd61a1194d70b76a941cf38d538d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:46:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:46:33Z,use_quota=True,user_id='e21d082db06a4975be83d644c824ab63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:46:35 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-9d1e59a2-f94e-4530-ac90-b2577fef1534 tempest-ProjectReaderTests-1981877916 None] Creating volume bbccb7da-3910-41d8-bd4f-478bc648882f {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:46:35 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-9d1e59a2-f94e-4530-ac90-b2577fef1534 tempest-ProjectReaderTests-1981877916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:46:35 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-9d1e59a2-f94e-4530-ac90-b2577fef1534 tempest-ProjectReaderTests-1981877916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:46:35 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-9d1e59a2-f94e-4530-ac90-b2577fef1534 tempest-ProjectReaderTests-1981877916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:46:35 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-9d1e59a2-f94e-4530-ac90-b2577fef1534 tempest-ProjectReaderTests-1981877916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:46:35 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-9d1e59a2-f94e-4530-ac90-b2577fef1534 tempest-ProjectReaderTests-1981877916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:46:35 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-9d1e59a2-f94e-4530-ac90-b2577fef1534 tempest-ProjectReaderTests-1981877916 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:46:35 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-9d1e59a2-f94e-4530-ac90-b2577fef1534 tempest-ProjectReaderTests-1981877916 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:46:35 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-9d1e59a2-f94e-4530-ac90-b2577fef1534 tempest-ProjectReaderTests-1981877916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bbccb7da-3910-41d8-bd4f-478bc648882f 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:46:35 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-11dee5d1-633d-4f68-ba8f-11214be99861 tempest-TestInstancesWithCinderVolumes-584005076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b7229c51-b135-4bf7-b03a-c85b483bbab5" returned: 0 in 0.374s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:46:35 devstack sudo[101249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bbccb7da-3910-41d8-bd4f-478bc648882f 1073741824 Sep 23 14:46:35 devstack sudo[101249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:46:35 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-11dee5d1-633d-4f68-ba8f-11214be99861 tempest-TestInstancesWithCinderVolumes-584005076 None] Lock "cinder-quobyte-b7229c51-b135-4bf7-b03a-c85b483bbab5" released by "delete_volume" :: held 0.940s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:46:35 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-92b64ab9-4158-452c-a968-f0f96e03a6e2 tempest-TestStampPattern-1114451325 None] Create snapshot completed successfully Sep 23 14:46:35 devstack cinder-volume[86310]: WARNING cinder.quota [None req-11dee5d1-633d-4f68-ba8f-11214be99861 tempest-TestInstancesWithCinderVolumes-584005076 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-368773431-646643818 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-368773431-646643818, it is now deprecated. Please use the default quota class for default quota. Sep 23 14:46:35 devstack cinder-volume[86310]: WARNING cinder.quota [None req-11dee5d1-633d-4f68-ba8f-11214be99861 tempest-TestInstancesWithCinderVolumes-584005076 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-368773431-646643818 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-368773431-646643818, it is now deprecated. Please use the default quota class for default quota. Sep 23 14:46:35 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-11dee5d1-633d-4f68-ba8f-11214be99861 tempest-TestInstancesWithCinderVolumes-584005076 None] Created reservations ['77f28b29-7287-4052-aa95-b6906ec475df', '5f82e035-5972-45ba-9f32-cc1096dc0cc8', 'ee71abf8-d1e7-4cf4-a385-5f820e7b63b2', '3de74fb2-2758-45b0-8f8f-1171552913b7'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:46:35 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-11dee5d1-633d-4f68-ba8f-11214be99861 tempest-TestInstancesWithCinderVolumes-584005076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:46:35 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-11dee5d1-633d-4f68-ba8f-11214be99861 tempest-TestInstancesWithCinderVolumes-584005076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:46:35 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-11dee5d1-633d-4f68-ba8f-11214be99861 tempest-TestInstancesWithCinderVolumes-584005076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:46:35 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-11dee5d1-633d-4f68-ba8f-11214be99861 tempest-TestInstancesWithCinderVolumes-584005076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:46:35 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-11dee5d1-633d-4f68-ba8f-11214be99861 tempest-TestInstancesWithCinderVolumes-584005076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:46:35 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-11dee5d1-633d-4f68-ba8f-11214be99861 tempest-TestInstancesWithCinderVolumes-584005076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:46:35 devstack sudo[101254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:46:35 devstack sudo[101254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:46:35 devstack sudo[101249]: pam_unix(sudo:session): session closed for user root Sep 23 14:46:35 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-9d1e59a2-f94e-4530-ac90-b2577fef1534 tempest-ProjectReaderTests-1981877916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bbccb7da-3910-41d8-bd4f-478bc648882f 1073741824" returned: 0 in 0.755s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:46:35 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-9d1e59a2-f94e-4530-ac90-b2577fef1534 tempest-ProjectReaderTests-1981877916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bbccb7da-3910-41d8-bd4f-478bc648882f {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:46:35 devstack sudo[101267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bbccb7da-3910-41d8-bd4f-478bc648882f Sep 23 14:46:35 devstack sudo[101267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:46:35 devstack sudo[101254]: pam_unix(sudo:session): session closed for user root Sep 23 14:46:35 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-11dee5d1-633d-4f68-ba8f-11214be99861 tempest-TestInstancesWithCinderVolumes-584005076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.567s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:46:35 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-11dee5d1-633d-4f68-ba8f-11214be99861 tempest-TestInstancesWithCinderVolumes-584005076 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:46:35 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-11dee5d1-633d-4f68-ba8f-11214be99861 tempest-TestInstancesWithCinderVolumes-584005076 None] Deleted volume successfully. Sep 23 14:46:36 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-11dee5d1-633d-4f68-ba8f-11214be99861 tempest-TestInstancesWithCinderVolumes-584005076 None] Lock "cinder-b7229c51-b135-4bf7-b03a-c85b483bbab5-delete_volume" released by "delete_volume" :: held 1.921s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:46:36 devstack sudo[101267]: pam_unix(sudo:session): session closed for user root Sep 23 14:46:36 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-9d1e59a2-f94e-4530-ac90-b2577fef1534 tempest-ProjectReaderTests-1981877916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bbccb7da-3910-41d8-bd4f-478bc648882f" returned: 0 in 0.371s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:46:36 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-9d1e59a2-f94e-4530-ac90-b2577fef1534 tempest-ProjectReaderTests-1981877916 None] <== create_volume: return (1225ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:46:36 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-9d1e59a2-f94e-4530-ac90-b2577fef1534 tempest-ProjectReaderTests-1981877916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.229s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:46:36 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-9d1e59a2-f94e-4530-ac90-b2577fef1534 tempest-ProjectReaderTests-1981877916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c6f2c04-2cf6-4ec3-ad09-09c6f3b88e7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbccb7da-3910-41d8-bd4f-478bc648882f', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:46:36 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-9d1e59a2-f94e-4530-ac90-b2577fef1534 tempest-ProjectReaderTests-1981877916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78b7f266-d99e-4098-97c8-bbf0c6eda42e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:46:36 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-9d1e59a2-f94e-4530-ac90-b2577fef1534 tempest-ProjectReaderTests-1981877916 None] Volume volume-bbccb7da-3910-41d8-bd4f-478bc648882f (bbccb7da-3910-41d8-bd4f-478bc648882f): created successfully Sep 23 14:46:36 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-9d1e59a2-f94e-4530-ac90-b2577fef1534 tempest-ProjectReaderTests-1981877916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78b7f266-d99e-4098-97c8-bbf0c6eda42e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:46:36 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-9d1e59a2-f94e-4530-ac90-b2577fef1534 tempest-ProjectReaderTests-1981877916 None] Flow 'volume_create_manager' (d6c4ee5e-f213-4c4f-b9c8-96ca46d0f182) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:46:36 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-9d1e59a2-f94e-4530-ac90-b2577fef1534 tempest-ProjectReaderTests-1981877916 None] Created volume successfully. Sep 23 14:46:37 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-95bdbee6-1ddc-422a-af3c-28eb7134f291 tempest-ProjectReaderTests-1981877916 None] Acquiring lock "cinder-bbccb7da-3910-41d8-bd4f-478bc648882f-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:46:37 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-95bdbee6-1ddc-422a-af3c-28eb7134f291 tempest-ProjectReaderTests-1981877916 None] Lock "cinder-bbccb7da-3910-41d8-bd4f-478bc648882f-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:46:37 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-95bdbee6-1ddc-422a-af3c-28eb7134f291 tempest-ProjectReaderTests-1981877916 None] Acquiring lock "cinder-quobyte-bbccb7da-3910-41d8-bd4f-478bc648882f" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:46:37 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-95bdbee6-1ddc-422a-af3c-28eb7134f291 tempest-ProjectReaderTests-1981877916 None] Lock "cinder-quobyte-bbccb7da-3910-41d8-bd4f-478bc648882f" acquired by "delete_volume" :: waited 0.062s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:46:37 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f0a420e-6f17-45f6-bf77-de245e0d715b]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:46:37 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-95bdbee6-1ddc-422a-af3c-28eb7134f291 tempest-ProjectReaderTests-1981877916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bbccb7da-3910-41d8-bd4f-478bc648882f {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:46:37 devstack sudo[101270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bbccb7da-3910-41d8-bd4f-478bc648882f Sep 23 14:46:37 devstack sudo[101270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:46:37 devstack sudo[101270]: pam_unix(sudo:session): session closed for user root Sep 23 14:46:37 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-95bdbee6-1ddc-422a-af3c-28eb7134f291 tempest-ProjectReaderTests-1981877916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bbccb7da-3910-41d8-bd4f-478bc648882f" returned: 0 in 0.506s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:46:37 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-95bdbee6-1ddc-422a-af3c-28eb7134f291 tempest-ProjectReaderTests-1981877916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bbccb7da-3910-41d8-bd4f-478bc648882f {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:46:38 devstack sudo[101277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bbccb7da-3910-41d8-bd4f-478bc648882f Sep 23 14:46:38 devstack sudo[101277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:46:38 devstack sudo[101277]: pam_unix(sudo:session): session closed for user root Sep 23 14:46:38 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-95bdbee6-1ddc-422a-af3c-28eb7134f291 tempest-ProjectReaderTests-1981877916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bbccb7da-3910-41d8-bd4f-478bc648882f" returned: 0 in 0.299s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:46:38 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-95bdbee6-1ddc-422a-af3c-28eb7134f291 tempest-ProjectReaderTests-1981877916 None] Lock "cinder-quobyte-bbccb7da-3910-41d8-bd4f-478bc648882f" released by "delete_volume" :: held 0.869s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:46:38 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-95bdbee6-1ddc-422a-af3c-28eb7134f291 tempest-ProjectReaderTests-1981877916 None] Created reservations ['a080c427-c709-4ef2-bd40-b47163c646ac', 'ca0510db-42e3-4280-97bd-dccb7d875a0f', '3774c956-0a5d-4d0c-a012-fc0c64790431', '04e2a87a-507a-4fbf-8465-797172d70cf9'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:46:38 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-95bdbee6-1ddc-422a-af3c-28eb7134f291 tempest-ProjectReaderTests-1981877916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:46:38 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-95bdbee6-1ddc-422a-af3c-28eb7134f291 tempest-ProjectReaderTests-1981877916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:46:38 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-95bdbee6-1ddc-422a-af3c-28eb7134f291 tempest-ProjectReaderTests-1981877916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:46:38 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-95bdbee6-1ddc-422a-af3c-28eb7134f291 tempest-ProjectReaderTests-1981877916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:46:38 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-95bdbee6-1ddc-422a-af3c-28eb7134f291 tempest-ProjectReaderTests-1981877916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:46:38 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-95bdbee6-1ddc-422a-af3c-28eb7134f291 tempest-ProjectReaderTests-1981877916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:46:38 devstack sudo[101298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:46:38 devstack sudo[101298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:46:38 devstack sudo[101298]: pam_unix(sudo:session): session closed for user root Sep 23 14:46:38 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-95bdbee6-1ddc-422a-af3c-28eb7134f291 tempest-ProjectReaderTests-1981877916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.412s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:46:38 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-95bdbee6-1ddc-422a-af3c-28eb7134f291 tempest-ProjectReaderTests-1981877916 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:46:38 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-95bdbee6-1ddc-422a-af3c-28eb7134f291 tempest-ProjectReaderTests-1981877916 None] Deleted volume successfully. Sep 23 14:46:38 devstack cinder-volume[86310]: DEBUG dbcounter [-] [86310] Writing DB stats cinder:SELECT=114,cinder:UPDATE=147,cinder:INSERT=35,cinder:DELETE=12 {{(pid=86310) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 14:46:39 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-95bdbee6-1ddc-422a-af3c-28eb7134f291 tempest-ProjectReaderTests-1981877916 None] Lock "cinder-bbccb7da-3910-41d8-bd4f-478bc648882f-delete_volume" released by "delete_volume" :: held 1.744s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:46:44 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb22f80a-b78b-4b62-abab-2307e3bad4a5 tempest-TestStampPattern-1114451325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:46:44 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-fb22f80a-b78b-4b62-abab-2307e3bad4a5 tempest-TestStampPattern-1114451325 None] Flow 'volume_create_manager' (2f3eba9c-2900-47aa-9f44-89eb0451929f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:46:44 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-fb22f80a-b78b-4b62-abab-2307e3bad4a5 tempest-TestStampPattern-1114451325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75575fda-f265-4be6-a194-4542a24e77da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:46:44 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-fb22f80a-b78b-4b62-abab-2307e3bad4a5 tempest-TestStampPattern-1114451325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75575fda-f265-4be6-a194-4542a24e77da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:46:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1953080672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08d52c32-414d-4c62-abd9-4f6b1ac3119f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ded8fdf474e4fb08781afe95d47c048',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:46:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=421cf3f0-0ede-4125-a838-d138ea04ac58,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:46:44Z,use_quota=True,user_id='17f408cc27fa415a95492cad829abe52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:46:44 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-fb22f80a-b78b-4b62-abab-2307e3bad4a5 tempest-TestStampPattern-1114451325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0370cca0-eb7a-4354-8ad4-1273a4d03f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:46:44 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-fb22f80a-b78b-4b62-abab-2307e3bad4a5 tempest-TestStampPattern-1114451325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0370cca0-eb7a-4354-8ad4-1273a4d03f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:46:44 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-fb22f80a-b78b-4b62-abab-2307e3bad4a5 tempest-TestStampPattern-1114451325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c64c5d4-6a0e-4843-a338-8fa39104d398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:46:44 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-fb22f80a-b78b-4b62-abab-2307e3bad4a5 tempest-TestStampPattern-1114451325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c64c5d4-6a0e-4843-a338-8fa39104d398) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '08d52c32-414d-4c62-abd9-4f6b1ac3119f', 'volume_name': 'volume-08d52c32-414d-4c62-abd9-4f6b1ac3119f', 'volume_size': 1, 'snapshot_id': '421cf3f0-0ede-4125-a838-d138ea04ac58'}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:46:44 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-fb22f80a-b78b-4b62-abab-2307e3bad4a5 tempest-TestStampPattern-1114451325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b91b169-d7dc-4be6-88e8-2307054be8d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:46:44 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-fb22f80a-b78b-4b62-abab-2307e3bad4a5 tempest-TestStampPattern-1114451325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b91b169-d7dc-4be6-88e8-2307054be8d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:46:44 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-fb22f80a-b78b-4b62-abab-2307e3bad4a5 tempest-TestStampPattern-1114451325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d304fca5-f505-4fc6-a46d-ef1a118ab19f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:46:44 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-fb22f80a-b78b-4b62-abab-2307e3bad4a5 tempest-TestStampPattern-1114451325 None] Volume 08d52c32-414d-4c62-abd9-4f6b1ac3119f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-08d52c32-414d-4c62-abd9-4f6b1ac3119f', 'volume_size': 1, 'snapshot_id': '421cf3f0-0ede-4125-a838-d138ea04ac58'} Sep 23 14:46:44 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-fb22f80a-b78b-4b62-abab-2307e3bad4a5 tempest-TestStampPattern-1114451325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:46:44 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-fb22f80a-b78b-4b62-abab-2307e3bad4a5 tempest-TestStampPattern-1114451325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:46:44 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-fb22f80a-b78b-4b62-abab-2307e3bad4a5 tempest-TestStampPattern-1114451325 None] Acquiring lock "cinder-quobyte-421cf3f0-0ede-4125-a838-d138ea04ac58-08d52c32-414d-4c62-abd9-4f6b1ac3119f" by "_create_volume_from_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:46:44 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-fb22f80a-b78b-4b62-abab-2307e3bad4a5 tempest-TestStampPattern-1114451325 None] Lock "cinder-quobyte-421cf3f0-0ede-4125-a838-d138ea04ac58-08d52c32-414d-4c62-abd9-4f6b1ac3119f" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:46:44 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-fb22f80a-b78b-4b62-abab-2307e3bad4a5 tempest-TestStampPattern-1114451325 None] Creating volume 08d52c32-414d-4c62-abd9-4f6b1ac3119f from snapshot 421cf3f0-0ede-4125-a838-d138ea04ac58 {{(pid=86310) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 23 14:46:44 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-fb22f80a-b78b-4b62-abab-2307e3bad4a5 tempest-TestStampPattern-1114451325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:46:44 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-fb22f80a-b78b-4b62-abab-2307e3bad4a5 tempest-TestStampPattern-1114451325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:46:44 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-fb22f80a-b78b-4b62-abab-2307e3bad4a5 tempest-TestStampPattern-1114451325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:46:44 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-fb22f80a-b78b-4b62-abab-2307e3bad4a5 tempest-TestStampPattern-1114451325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:46:44 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-fb22f80a-b78b-4b62-abab-2307e3bad4a5 tempest-TestStampPattern-1114451325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:46:44 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-fb22f80a-b78b-4b62-abab-2307e3bad4a5 tempest-TestStampPattern-1114451325 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:46:44 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-fb22f80a-b78b-4b62-abab-2307e3bad4a5 tempest-TestStampPattern-1114451325 None] Acquiring lock "cinder-quobyte-08d52c32-414d-4c62-abd9-4f6b1ac3119f" by "_copy_volume_from_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:46:44 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-fb22f80a-b78b-4b62-abab-2307e3bad4a5 tempest-TestStampPattern-1114451325 None] Lock "cinder-quobyte-08d52c32-414d-4c62-abd9-4f6b1ac3119f" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:46:44 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-fb22f80a-b78b-4b62-abab-2307e3bad4a5 tempest-TestStampPattern-1114451325 None] snapshot: 421cf3f0-0ede-4125-a838-d138ea04ac58, volume: 08d52c32-414d-4c62-abd9-4f6b1ac3119f, {{(pid=86310) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 23 14:46:44 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-fb22f80a-b78b-4b62-abab-2307e3bad4a5 tempest-TestStampPattern-1114451325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:46:44 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-fb22f80a-b78b-4b62-abab-2307e3bad4a5 tempest-TestStampPattern-1114451325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:46:44 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-fb22f80a-b78b-4b62-abab-2307e3bad4a5 tempest-TestStampPattern-1114451325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:46:44 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-fb22f80a-b78b-4b62-abab-2307e3bad4a5 tempest-TestStampPattern-1114451325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:46:44 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-fb22f80a-b78b-4b62-abab-2307e3bad4a5 tempest-TestStampPattern-1114451325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:46:44 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e16fa3f-6ba9-4a10-8b25-0ce21338aa07]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:46:44 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-fb22f80a-b78b-4b62-abab-2307e3bad4a5 tempest-TestStampPattern-1114451325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b48b56ce-ca56-4a1f-a71a-0c0613fd3960.421cf3f0-0ede-4125-a838-d138ea04ac58 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:46:44 devstack sudo[101311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b48b56ce-ca56-4a1f-a71a-0c0613fd3960.421cf3f0-0ede-4125-a838-d138ea04ac58 Sep 23 14:46:44 devstack sudo[101311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:46:45 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-208aa95c-2a1c-4c30-a2bb-0111a21ed45f tempest-TestShelveInstance-1881221595 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:46:45 devstack sudo[101311]: pam_unix(sudo:session): session closed for user root Sep 23 14:46:45 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-208aa95c-2a1c-4c30-a2bb-0111a21ed45f tempest-TestShelveInstance-1881221595 None] Flow 'volume_create_manager' (0d40b609-f3b9-42eb-91e7-1c031a91aa6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:46:45 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-208aa95c-2a1c-4c30-a2bb-0111a21ed45f tempest-TestShelveInstance-1881221595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8597bb1b-e9fa-4ef1-90bc-6a0b69a64b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:46:45 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-fb22f80a-b78b-4b62-abab-2307e3bad4a5 tempest-TestStampPattern-1114451325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b48b56ce-ca56-4a1f-a71a-0c0613fd3960.421cf3f0-0ede-4125-a838-d138ea04ac58" returned: 0 in 0.583s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:46:45 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-fb22f80a-b78b-4b62-abab-2307e3bad4a5 tempest-TestStampPattern-1114451325 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b48b56ce-ca56-4a1f-a71a-0c0613fd3960(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 14:46:45 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[26a3613c-790b-49c5-b10a-15307fdbc84e]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:46:45 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-fb22f80a-b78b-4b62-abab-2307e3bad4a5 tempest-TestStampPattern-1114451325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b48b56ce-ca56-4a1f-a71a-0c0613fd3960 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:46:45 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-208aa95c-2a1c-4c30-a2bb-0111a21ed45f tempest-TestShelveInstance-1881221595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8597bb1b-e9fa-4ef1-90bc-6a0b69a64b20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:46:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1475972253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7484332-4caa-49ff-90d7-cc3a08c2d230,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a17b590a95c4b009eee0255b92d134f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:46:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:46:45Z,use_quota=True,user_id='3a5b81fed6df4a2592113991a30dec8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:46:45 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-208aa95c-2a1c-4c30-a2bb-0111a21ed45f tempest-TestShelveInstance-1881221595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93f3a024-0d8b-4c87-b642-aaeeb32ff040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:46:45 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-208aa95c-2a1c-4c30-a2bb-0111a21ed45f tempest-TestShelveInstance-1881221595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93f3a024-0d8b-4c87-b642-aaeeb32ff040) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:46:45 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-208aa95c-2a1c-4c30-a2bb-0111a21ed45f tempest-TestShelveInstance-1881221595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4364f0c-691a-49bb-b251-7e2804f73275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:46:45 devstack cinder-volume[86310]: DEBUG cinder.image.glance [None req-208aa95c-2a1c-4c30-a2bb-0111a21ed45f tempest-TestShelveInstance-1881221595 None] Creating Keystone auth plugin from conf {{(pid=86310) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 23 14:46:45 devstack sudo[101317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b48b56ce-ca56-4a1f-a71a-0c0613fd3960 Sep 23 14:46:45 devstack sudo[101317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:46:45 devstack sudo[101317]: pam_unix(sudo:session): session closed for user root Sep 23 14:46:45 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-208aa95c-2a1c-4c30-a2bb-0111a21ed45f tempest-TestShelveInstance-1881221595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4364f0c-691a-49bb-b251-7e2804f73275) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b7484332-4caa-49ff-90d7-cc3a08c2d230', 'volume_name': 'volume-b7484332-4caa-49ff-90d7-cc3a08c2d230', 'volume_size': 1, 'image_id': '0cd395f9-e766-4e32-94b1-775454bf3449', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0cd395f9-e766-4e32-94b1-775454bf3449', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7fa20aad952548c880b3288dd7d64dbc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0cd395f9-e766-4e32-94b1-775454bf3449', 'created_at': datetime.datetime(2026, 9, 23, 12, 25, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 23, 12, 25, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0cd395f9-e766-4e32-94b1-775454bf3449/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:46:45 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-208aa95c-2a1c-4c30-a2bb-0111a21ed45f tempest-TestShelveInstance-1881221595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb73dbb7-2df9-410d-9f89-ba40f53f48c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:46:45 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-208aa95c-2a1c-4c30-a2bb-0111a21ed45f tempest-TestShelveInstance-1881221595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb73dbb7-2df9-410d-9f89-ba40f53f48c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:46:45 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-208aa95c-2a1c-4c30-a2bb-0111a21ed45f tempest-TestShelveInstance-1881221595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (999c2b99-8e3e-43ad-adc2-44de1a3752a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:46:45 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-208aa95c-2a1c-4c30-a2bb-0111a21ed45f tempest-TestShelveInstance-1881221595 None] Volume b7484332-4caa-49ff-90d7-cc3a08c2d230: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b7484332-4caa-49ff-90d7-cc3a08c2d230', 'volume_size': 1, 'image_id': '0cd395f9-e766-4e32-94b1-775454bf3449', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0cd395f9-e766-4e32-94b1-775454bf3449', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7fa20aad952548c880b3288dd7d64dbc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0cd395f9-e766-4e32-94b1-775454bf3449', 'created_at': datetime.datetime(2026, 9, 23, 12, 25, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 23, 12, 25, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0cd395f9-e766-4e32-94b1-775454bf3449/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 23 14:46:45 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-208aa95c-2a1c-4c30-a2bb-0111a21ed45f tempest-TestShelveInstance-1881221595 None] Trying to clone b7484332-4caa-49ff-90d7-cc3a08c2d230 from image 0cd395f9-e766-4e32-94b1-775454bf3449 at location (None, [{'url': 'file:///opt/stack/data/glance/images/0cd395f9-e766-4e32-94b1-775454bf3449', 'metadata': {}}]). {{(pid=86310) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 23 14:46:45 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-fb22f80a-b78b-4b62-abab-2307e3bad4a5 tempest-TestStampPattern-1114451325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b48b56ce-ca56-4a1f-a71a-0c0613fd3960" returned: 0 in 0.512s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:46:45 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-fb22f80a-b78b-4b62-abab-2307e3bad4a5 tempest-TestStampPattern-1114451325 None] will copy from snapshot at /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b48b56ce-ca56-4a1f-a71a-0c0613fd3960 {{(pid=86310) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 23 14:46:45 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-fb22f80a-b78b-4b62-abab-2307e3bad4a5 tempest-TestStampPattern-1114451325 None] Creating direct copy from snapshot {{(pid=86310) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 23 14:46:45 devstack cinder-volume[86310]: DEBUG cinder.utils [None req-fb22f80a-b78b-4b62-abab-2307e3bad4a5 tempest-TestStampPattern-1114451325 None] Path /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-08d52c32-414d-4c62-abd9-4f6b1ac3119f not found in is_blk_device check {{(pid=86310) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 23 14:46:45 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-fb22f80a-b78b-4b62-abab-2307e3bad4a5 tempest-TestStampPattern-1114451325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b48b56ce-ca56-4a1f-a71a-0c0613fd3960 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-08d52c32-414d-4c62-abd9-4f6b1ac3119f {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:46:45 devstack sudo[101325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b48b56ce-ca56-4a1f-a71a-0c0613fd3960 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-08d52c32-414d-4c62-abd9-4f6b1ac3119f Sep 23 14:46:45 devstack sudo[101325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:46:46 devstack cinder-volume[86310]: DEBUG cinder.image.image_utils [None req-208aa95c-2a1c-4c30-a2bb-0111a21ed45f tempest-TestShelveInstance-1881221595 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0cd395f9-e766-4e32-94b1-775454bf3449_unrm5j82devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86310) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 23 14:46:46 devstack cinder-volume[86310]: INFO cinder.image.image_utils [None req-208aa95c-2a1c-4c30-a2bb-0111a21ed45f tempest-TestShelveInstance-1881221595 None] Image download 20.69 MB at 20.69 MB/s Sep 23 14:46:46 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc6138f0-5f7e-47c6-a874-80ae9b051a2b]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:46:46 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-208aa95c-2a1c-4c30-a2bb-0111a21ed45f tempest-TestShelveInstance-1881221595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0cd395f9-e766-4e32-94b1-775454bf3449_unrm5j82devstack@QuobyteHD {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:46:46 devstack sudo[101331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0cd395f9-e766-4e32-94b1-775454bf3449_unrm5j82devstack@QuobyteHD Sep 23 14:46:46 devstack sudo[101331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:46:46 devstack sudo[101331]: pam_unix(sudo:session): session closed for user root Sep 23 14:46:46 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-208aa95c-2a1c-4c30-a2bb-0111a21ed45f tempest-TestShelveInstance-1881221595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0cd395f9-e766-4e32-94b1-775454bf3449_unrm5j82devstack@QuobyteHD" returned: 0 in 0.556s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:46:46 devstack cinder-volume[86310]: DEBUG cinder.image.image_utils [None req-208aa95c-2a1c-4c30-a2bb-0111a21ed45f tempest-TestShelveInstance-1881221595 None] Temporary image 0cd395f9-e766-4e32-94b1-775454bf3449 is fetched for user 3a5b81fed6df4a2592113991a30dec8f. {{(pid=86310) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 23 14:46:47 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[d55352c9-2a18-4603-81df-14ade53c12a9]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:46:47 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-208aa95c-2a1c-4c30-a2bb-0111a21ed45f tempest-TestShelveInstance-1881221595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0cd395f9-e766-4e32-94b1-775454bf3449_unrm5j82devstack@QuobyteHD {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:46:47 devstack sudo[101343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0cd395f9-e766-4e32-94b1-775454bf3449_unrm5j82devstack@QuobyteHD Sep 23 14:46:47 devstack sudo[101343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:46:47 devstack sudo[101343]: pam_unix(sudo:session): session closed for user root Sep 23 14:46:47 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-208aa95c-2a1c-4c30-a2bb-0111a21ed45f tempest-TestShelveInstance-1881221595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0cd395f9-e766-4e32-94b1-775454bf3449_unrm5j82devstack@QuobyteHD" returned: 0 in 0.786s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:46:47 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-208aa95c-2a1c-4c30-a2bb-0111a21ed45f tempest-TestShelveInstance-1881221595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:46:51 devstack cinder-volume[86310]: DEBUG oslo_service.periodic_task [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86310) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 14:46:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:46:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:46:51 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:46:51 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:46:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:46:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:46:51 devstack sudo[101360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:46:51 devstack sudo[101360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:46:52 devstack sudo[101360]: pam_unix(sudo:session): session closed for user root Sep 23 14:46:52 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.695s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:46:52 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:46:52 devstack cinder-volume[86310]: DEBUG oslo_service.periodic_task [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Running periodic task VolumeManager._thread_info {{(pid=86310) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 14:46:52 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] thread count: 28 {{(pid=86310) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 14:46:52 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] thread info: [<_MainThread(MainThread, started 128854208852096)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86310) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 14:46:56 devstack sudo[101325]: pam_unix(sudo:session): session closed for user root Sep 23 14:46:56 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-fb22f80a-b78b-4b62-abab-2307e3bad4a5 tempest-TestStampPattern-1114451325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b48b56ce-ca56-4a1f-a71a-0c0613fd3960 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-08d52c32-414d-4c62-abd9-4f6b1ac3119f" returned: 0 in 10.482s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:46:56 devstack cinder-volume[86310]: DEBUG cinder.image.image_utils [None req-fb22f80a-b78b-4b62-abab-2307e3bad4a5 tempest-TestStampPattern-1114451325 None] Image conversion details: src /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b48b56ce-ca56-4a1f-a71a-0c0613fd3960, size 1024.00 MB, duration 10.48 sec, destination /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-08d52c32-414d-4c62-abd9-4f6b1ac3119f {{(pid=86310) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 14:46:56 devstack cinder-volume[86310]: INFO cinder.image.image_utils [None req-fb22f80a-b78b-4b62-abab-2307e3bad4a5 tempest-TestStampPattern-1114451325 None] Converted 1024.00 MB image at 97.66 MB/s Sep 23 14:46:56 devstack cinder-volume[86310]: WARNING cinder.volume.drivers.remotefs [None req-fb22f80a-b78b-4b62-abab-2307e3bad4a5 tempest-TestStampPattern-1114451325 None] /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-08d52c32-414d-4c62-abd9-4f6b1ac3119f is being set with open permissions: ugo+rw Sep 23 14:46:56 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-fb22f80a-b78b-4b62-abab-2307e3bad4a5 tempest-TestStampPattern-1114451325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-08d52c32-414d-4c62-abd9-4f6b1ac3119f {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:46:56 devstack sudo[101421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-08d52c32-414d-4c62-abd9-4f6b1ac3119f Sep 23 14:46:56 devstack sudo[101421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:46:56 devstack sudo[101421]: pam_unix(sudo:session): session closed for user root Sep 23 14:46:56 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-fb22f80a-b78b-4b62-abab-2307e3bad4a5 tempest-TestStampPattern-1114451325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-08d52c32-414d-4c62-abd9-4f6b1ac3119f" returned: 0 in 0.492s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:46:56 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-fb22f80a-b78b-4b62-abab-2307e3bad4a5 tempest-TestStampPattern-1114451325 None] Lock "cinder-quobyte-08d52c32-414d-4c62-abd9-4f6b1ac3119f" released by "_copy_volume_from_snapshot" :: held 12.192s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:46:56 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-fb22f80a-b78b-4b62-abab-2307e3bad4a5 tempest-TestStampPattern-1114451325 None] Lock "cinder-quobyte-421cf3f0-0ede-4125-a838-d138ea04ac58-08d52c32-414d-4c62-abd9-4f6b1ac3119f" released by "_create_volume_from_snapshot" :: held 12.290s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:46:56 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-fb22f80a-b78b-4b62-abab-2307e3bad4a5 tempest-TestStampPattern-1114451325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.316s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:46:56 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-208aa95c-2a1c-4c30-a2bb-0111a21ed45f tempest-TestShelveInstance-1881221595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.897s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:46:56 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-208aa95c-2a1c-4c30-a2bb-0111a21ed45f tempest-TestShelveInstance-1881221595 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:46:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1475972253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7484332-4caa-49ff-90d7-cc3a08c2d230,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a17b590a95c4b009eee0255b92d134f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:46:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:46:45Z,use_quota=True,user_id='3a5b81fed6df4a2592113991a30dec8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:46:56 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-208aa95c-2a1c-4c30-a2bb-0111a21ed45f tempest-TestShelveInstance-1881221595 None] Creating volume b7484332-4caa-49ff-90d7-cc3a08c2d230 {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:46:56 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-208aa95c-2a1c-4c30-a2bb-0111a21ed45f tempest-TestShelveInstance-1881221595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:46:56 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-208aa95c-2a1c-4c30-a2bb-0111a21ed45f tempest-TestShelveInstance-1881221595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:46:56 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-208aa95c-2a1c-4c30-a2bb-0111a21ed45f tempest-TestShelveInstance-1881221595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:46:56 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-208aa95c-2a1c-4c30-a2bb-0111a21ed45f tempest-TestShelveInstance-1881221595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:46:56 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-208aa95c-2a1c-4c30-a2bb-0111a21ed45f tempest-TestShelveInstance-1881221595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:46:56 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-208aa95c-2a1c-4c30-a2bb-0111a21ed45f tempest-TestShelveInstance-1881221595 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:46:56 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-208aa95c-2a1c-4c30-a2bb-0111a21ed45f tempest-TestShelveInstance-1881221595 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:46:56 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-208aa95c-2a1c-4c30-a2bb-0111a21ed45f tempest-TestShelveInstance-1881221595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b7484332-4caa-49ff-90d7-cc3a08c2d230 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:46:56 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-fb22f80a-b78b-4b62-abab-2307e3bad4a5 tempest-TestStampPattern-1114451325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d304fca5-f505-4fc6-a46d-ef1a118ab19f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08d52c32-414d-4c62-abd9-4f6b1ac3119f', 'volume_size': 1, 'snapshot_id': '421cf3f0-0ede-4125-a838-d138ea04ac58'}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:46:56 devstack sudo[101427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b7484332-4caa-49ff-90d7-cc3a08c2d230 1073741824 Sep 23 14:46:56 devstack sudo[101427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:46:56 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-fb22f80a-b78b-4b62-abab-2307e3bad4a5 tempest-TestStampPattern-1114451325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9529b467-ddad-4c85-a6a9-001f3c51d462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:46:56 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-fb22f80a-b78b-4b62-abab-2307e3bad4a5 tempest-TestStampPattern-1114451325 None] Volume volume-08d52c32-414d-4c62-abd9-4f6b1ac3119f (08d52c32-414d-4c62-abd9-4f6b1ac3119f): created successfully Sep 23 14:46:56 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-fb22f80a-b78b-4b62-abab-2307e3bad4a5 tempest-TestStampPattern-1114451325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9529b467-ddad-4c85-a6a9-001f3c51d462) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:46:56 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-fb22f80a-b78b-4b62-abab-2307e3bad4a5 tempest-TestStampPattern-1114451325 None] Flow 'volume_create_manager' (2f3eba9c-2900-47aa-9f44-89eb0451929f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:46:56 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-fb22f80a-b78b-4b62-abab-2307e3bad4a5 tempest-TestStampPattern-1114451325 None] Created volume successfully. Sep 23 14:46:57 devstack sudo[101427]: pam_unix(sudo:session): session closed for user root Sep 23 14:46:57 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-208aa95c-2a1c-4c30-a2bb-0111a21ed45f tempest-TestShelveInstance-1881221595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b7484332-4caa-49ff-90d7-cc3a08c2d230 1073741824" returned: 0 in 0.602s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:46:57 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-208aa95c-2a1c-4c30-a2bb-0111a21ed45f tempest-TestShelveInstance-1881221595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b7484332-4caa-49ff-90d7-cc3a08c2d230 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:46:57 devstack sudo[101433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b7484332-4caa-49ff-90d7-cc3a08c2d230 Sep 23 14:46:57 devstack sudo[101433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:46:57 devstack sudo[101433]: pam_unix(sudo:session): session closed for user root Sep 23 14:46:57 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-208aa95c-2a1c-4c30-a2bb-0111a21ed45f tempest-TestShelveInstance-1881221595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b7484332-4caa-49ff-90d7-cc3a08c2d230" returned: 0 in 0.265s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:46:57 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-208aa95c-2a1c-4c30-a2bb-0111a21ed45f tempest-TestShelveInstance-1881221595 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:46:57 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-208aa95c-2a1c-4c30-a2bb-0111a21ed45f tempest-TestShelveInstance-1881221595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:46:57 devstack cinder-volume[86310]: DEBUG cinder.volume.volume_utils [None req-208aa95c-2a1c-4c30-a2bb-0111a21ed45f tempest-TestShelveInstance-1881221595 None] Attempting download of 0cd395f9-e766-4e32-94b1-775454bf3449 ((None, [{'url': 'file:///opt/stack/data/glance/images/0cd395f9-e766-4e32-94b1-775454bf3449', 'metadata': {}}])) to volume b7484332-4caa-49ff-90d7-cc3a08c2d230. {{(pid=86310) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 23 14:46:57 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dc33813-8240-424d-9a10-52e69c72d03f]: (4, 'raw') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:46:57 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-208aa95c-2a1c-4c30-a2bb-0111a21ed45f tempest-TestShelveInstance-1881221595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0cd395f9-e766-4e32-94b1-775454bf3449_8uxylwda {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:46:57 devstack sudo[101436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0cd395f9-e766-4e32-94b1-775454bf3449_8uxylwda Sep 23 14:46:57 devstack sudo[101436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:46:58 devstack sudo[101436]: pam_unix(sudo:session): session closed for user root Sep 23 14:46:58 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-208aa95c-2a1c-4c30-a2bb-0111a21ed45f tempest-TestShelveInstance-1881221595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0cd395f9-e766-4e32-94b1-775454bf3449_8uxylwda" returned: 0 in 0.430s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:46:58 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-208aa95c-2a1c-4c30-a2bb-0111a21ed45f tempest-TestShelveInstance-1881221595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0cd395f9-e766-4e32-94b1-775454bf3449_8uxylwda {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:46:58 devstack sudo[101440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0cd395f9-e766-4e32-94b1-775454bf3449_8uxylwda Sep 23 14:46:58 devstack sudo[101440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:46:58 devstack sudo[101440]: pam_unix(sudo:session): session closed for user root Sep 23 14:46:58 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-208aa95c-2a1c-4c30-a2bb-0111a21ed45f tempest-TestShelveInstance-1881221595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0cd395f9-e766-4e32-94b1-775454bf3449_8uxylwda" returned: 1 in 0.487s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:46:58 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-208aa95c-2a1c-4c30-a2bb-0111a21ed45f tempest-TestShelveInstance-1881221595 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0cd395f9-e766-4e32-94b1-775454bf3449_8uxylwda' failed. Not Retrying. {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 14:46:58 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fa02edd-a7c5-43c6-b862-c8d5f65b0c77]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:46:58 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-208aa95c-2a1c-4c30-a2bb-0111a21ed45f tempest-TestShelveInstance-1881221595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0cd395f9-e766-4e32-94b1-775454bf3449_unrm5j82devstack@QuobyteHD {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:46:58 devstack sudo[101444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0cd395f9-e766-4e32-94b1-775454bf3449_unrm5j82devstack@QuobyteHD Sep 23 14:46:58 devstack sudo[101444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:46:59 devstack sudo[101444]: pam_unix(sudo:session): session closed for user root Sep 23 14:46:59 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-208aa95c-2a1c-4c30-a2bb-0111a21ed45f tempest-TestShelveInstance-1881221595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0cd395f9-e766-4e32-94b1-775454bf3449_unrm5j82devstack@QuobyteHD" returned: 0 in 0.478s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:46:59 devstack cinder-volume[86310]: DEBUG cinder.image.image_utils [None req-208aa95c-2a1c-4c30-a2bb-0111a21ed45f tempest-TestShelveInstance-1881221595 None] 0cd395f9-e766-4e32-94b1-775454bf3449 was qcow2, converting to qcow2 {{(pid=86310) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 23 14:46:59 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-208aa95c-2a1c-4c30-a2bb-0111a21ed45f tempest-TestShelveInstance-1881221595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0cd395f9-e766-4e32-94b1-775454bf3449_unrm5j82devstack@QuobyteHD /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b7484332-4caa-49ff-90d7-cc3a08c2d230 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:46:59 devstack sudo[101449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0cd395f9-e766-4e32-94b1-775454bf3449_unrm5j82devstack@QuobyteHD /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b7484332-4caa-49ff-90d7-cc3a08c2d230 Sep 23 14:46:59 devstack sudo[101449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:46:59 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbef548f-c5b4-4f41-bbc8-56ed0a1d2a44 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:46:59 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-bbef548f-c5b4-4f41-bbc8-56ed0a1d2a44 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Flow 'volume_create_manager' (72a25776-592e-4998-9a71-e663d7cd5cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:46:59 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-bbef548f-c5b4-4f41-bbc8-56ed0a1d2a44 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (625fd8e0-b943-4e1f-9dc8-959895c1a86d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:47:00 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-bbef548f-c5b4-4f41-bbc8-56ed0a1d2a44 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (625fd8e0-b943-4e1f-9dc8-959895c1a86d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:47:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-644495969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1d2e3fe-1e86-4004-b989-b0a535deb50b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cc3e5afbb784cc98646f15e4af39fc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:47:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:47:00Z,use_quota=True,user_id='773a01872fd34e31a7411ff49d1593a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:47:00 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-bbef548f-c5b4-4f41-bbc8-56ed0a1d2a44 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f908c3c2-9738-4668-bd88-943a7ac53148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:47:00 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-bbef548f-c5b4-4f41-bbc8-56ed0a1d2a44 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f908c3c2-9738-4668-bd88-943a7ac53148) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:47:00 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-bbef548f-c5b4-4f41-bbc8-56ed0a1d2a44 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34a58a0d-fb16-432e-a59a-325a959722e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:47:00 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-bbef548f-c5b4-4f41-bbc8-56ed0a1d2a44 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34a58a0d-fb16-432e-a59a-325a959722e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1d2e3fe-1e86-4004-b989-b0a535deb50b', 'volume_name': 'volume-c1d2e3fe-1e86-4004-b989-b0a535deb50b', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:47:00 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-bbef548f-c5b4-4f41-bbc8-56ed0a1d2a44 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27f05b5f-c7ff-41d9-b278-31684108e5ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:47:00 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-bbef548f-c5b4-4f41-bbc8-56ed0a1d2a44 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27f05b5f-c7ff-41d9-b278-31684108e5ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:47:00 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-bbef548f-c5b4-4f41-bbc8-56ed0a1d2a44 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72bcb924-70c0-4336-b15a-c4e6e464e925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:47:00 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-bbef548f-c5b4-4f41-bbc8-56ed0a1d2a44 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Volume c1d2e3fe-1e86-4004-b989-b0a535deb50b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1d2e3fe-1e86-4004-b989-b0a535deb50b', 'volume_size': 1} Sep 23 14:47:00 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-bbef548f-c5b4-4f41-bbc8-56ed0a1d2a44 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:47:00 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-bbef548f-c5b4-4f41-bbc8-56ed0a1d2a44 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:47:00 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-bbef548f-c5b4-4f41-bbc8-56ed0a1d2a44 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:47:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-644495969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1d2e3fe-1e86-4004-b989-b0a535deb50b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cc3e5afbb784cc98646f15e4af39fc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:47:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:47:00Z,use_quota=True,user_id='773a01872fd34e31a7411ff49d1593a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:47:00 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-bbef548f-c5b4-4f41-bbc8-56ed0a1d2a44 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Creating volume c1d2e3fe-1e86-4004-b989-b0a535deb50b {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:47:00 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-bbef548f-c5b4-4f41-bbc8-56ed0a1d2a44 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:47:00 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-bbef548f-c5b4-4f41-bbc8-56ed0a1d2a44 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:47:00 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-bbef548f-c5b4-4f41-bbc8-56ed0a1d2a44 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:47:00 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-bbef548f-c5b4-4f41-bbc8-56ed0a1d2a44 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:47:00 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-bbef548f-c5b4-4f41-bbc8-56ed0a1d2a44 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:47:00 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-bbef548f-c5b4-4f41-bbc8-56ed0a1d2a44 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:47:00 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-bbef548f-c5b4-4f41-bbc8-56ed0a1d2a44 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:47:00 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-bbef548f-c5b4-4f41-bbc8-56ed0a1d2a44 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-c1d2e3fe-1e86-4004-b989-b0a535deb50b 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:47:00 devstack sudo[101456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-c1d2e3fe-1e86-4004-b989-b0a535deb50b 1073741824 Sep 23 14:47:00 devstack sudo[101456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:47:00 devstack sudo[101456]: pam_unix(sudo:session): session closed for user root Sep 23 14:47:00 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-bbef548f-c5b4-4f41-bbc8-56ed0a1d2a44 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-c1d2e3fe-1e86-4004-b989-b0a535deb50b 1073741824" returned: 0 in 0.585s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:47:00 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-bbef548f-c5b4-4f41-bbc8-56ed0a1d2a44 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-c1d2e3fe-1e86-4004-b989-b0a535deb50b {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:47:00 devstack sudo[101463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-c1d2e3fe-1e86-4004-b989-b0a535deb50b Sep 23 14:47:00 devstack sudo[101463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:47:01 devstack sudo[101463]: pam_unix(sudo:session): session closed for user root Sep 23 14:47:01 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-bbef548f-c5b4-4f41-bbc8-56ed0a1d2a44 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-c1d2e3fe-1e86-4004-b989-b0a535deb50b" returned: 0 in 0.409s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:47:01 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-bbef548f-c5b4-4f41-bbc8-56ed0a1d2a44 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] <== create_volume: return (1055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:47:01 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-bbef548f-c5b4-4f41-bbc8-56ed0a1d2a44 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.059s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:47:01 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-bbef548f-c5b4-4f41-bbc8-56ed0a1d2a44 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72bcb924-70c0-4336-b15a-c4e6e464e925) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1d2e3fe-1e86-4004-b989-b0a535deb50b', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:47:01 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-bbef548f-c5b4-4f41-bbc8-56ed0a1d2a44 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ba11e97-8822-4c99-9a47-eee97b372ab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:47:01 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-bbef548f-c5b4-4f41-bbc8-56ed0a1d2a44 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Volume volume-c1d2e3fe-1e86-4004-b989-b0a535deb50b (c1d2e3fe-1e86-4004-b989-b0a535deb50b): created successfully Sep 23 14:47:01 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-bbef548f-c5b4-4f41-bbc8-56ed0a1d2a44 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ba11e97-8822-4c99-9a47-eee97b372ab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:47:01 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-bbef548f-c5b4-4f41-bbc8-56ed0a1d2a44 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Flow 'volume_create_manager' (72a25776-592e-4998-9a71-e663d7cd5cf0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:47:01 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-bbef548f-c5b4-4f41-bbc8-56ed0a1d2a44 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Created volume successfully. Sep 23 14:47:01 devstack sudo[101449]: pam_unix(sudo:session): session closed for user root Sep 23 14:47:01 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-208aa95c-2a1c-4c30-a2bb-0111a21ed45f tempest-TestShelveInstance-1881221595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0cd395f9-e766-4e32-94b1-775454bf3449_unrm5j82devstack@QuobyteHD /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b7484332-4caa-49ff-90d7-cc3a08c2d230" returned: 0 in 2.457s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:47:01 devstack cinder-volume[86310]: DEBUG cinder.image.image_utils [None req-208aa95c-2a1c-4c30-a2bb-0111a21ed45f tempest-TestShelveInstance-1881221595 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0cd395f9-e766-4e32-94b1-775454bf3449_unrm5j82devstack@QuobyteHD, size 112.00 MB, duration 2.46 sec, destination /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b7484332-4caa-49ff-90d7-cc3a08c2d230 {{(pid=86310) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 14:47:01 devstack cinder-volume[86310]: INFO cinder.image.image_utils [None req-208aa95c-2a1c-4c30-a2bb-0111a21ed45f tempest-TestShelveInstance-1881221595 None] Converted 112.00 MB image at 45.53 MB/s Sep 23 14:47:01 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-208aa95c-2a1c-4c30-a2bb-0111a21ed45f tempest-TestShelveInstance-1881221595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b7484332-4caa-49ff-90d7-cc3a08c2d230 1G {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:47:01 devstack sudo[101468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b7484332-4caa-49ff-90d7-cc3a08c2d230 1G Sep 23 14:47:01 devstack sudo[101468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:47:02 devstack sudo[101468]: pam_unix(sudo:session): session closed for user root Sep 23 14:47:02 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-208aa95c-2a1c-4c30-a2bb-0111a21ed45f tempest-TestShelveInstance-1881221595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b7484332-4caa-49ff-90d7-cc3a08c2d230 1G" returned: 0 in 0.396s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:47:02 devstack cinder-volume[86310]: DEBUG cinder.volume.volume_utils [None req-208aa95c-2a1c-4c30-a2bb-0111a21ed45f tempest-TestShelveInstance-1881221595 None] Downloaded image 0cd395f9-e766-4e32-94b1-775454bf3449 ((None, [{'url': 'file:///opt/stack/data/glance/images/0cd395f9-e766-4e32-94b1-775454bf3449', 'metadata': {}}])) to volume b7484332-4caa-49ff-90d7-cc3a08c2d230 successfully. {{(pid=86310) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 23 14:47:02 devstack cinder-volume[86310]: DEBUG cinder.image.image_utils [None req-208aa95c-2a1c-4c30-a2bb-0111a21ed45f tempest-TestShelveInstance-1881221595 None] Temporary image 0cd395f9-e766-4e32-94b1-775454bf3449 for user 3a5b81fed6df4a2592113991a30dec8f is deleted. {{(pid=86310) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 23 14:47:02 devstack cinder-volume[86310]: DEBUG cinder.volume.volume_utils [None req-208aa95c-2a1c-4c30-a2bb-0111a21ed45f tempest-TestShelveInstance-1881221595 None] Marking volume b7484332-4caa-49ff-90d7-cc3a08c2d230 as bootable. {{(pid=86310) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 23 14:47:02 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-208aa95c-2a1c-4c30-a2bb-0111a21ed45f tempest-TestShelveInstance-1881221595 None] Copying metadata from image 0cd395f9-e766-4e32-94b1-775454bf3449 to b7484332-4caa-49ff-90d7-cc3a08c2d230. {{(pid=86310) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 23 14:47:02 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-208aa95c-2a1c-4c30-a2bb-0111a21ed45f tempest-TestShelveInstance-1881221595 None] Creating volume glance metadata for volume b7484332-4caa-49ff-90d7-cc3a08c2d230 backed by image 0cd395f9-e766-4e32-94b1-775454bf3449 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0cd395f9-e766-4e32-94b1-775454bf3449', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86310) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 23 14:47:02 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-208aa95c-2a1c-4c30-a2bb-0111a21ed45f tempest-TestShelveInstance-1881221595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (999c2b99-8e3e-43ad-adc2-44de1a3752a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7484332-4caa-49ff-90d7-cc3a08c2d230', 'volume_size': 1, 'image_id': '0cd395f9-e766-4e32-94b1-775454bf3449', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0cd395f9-e766-4e32-94b1-775454bf3449', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7fa20aad952548c880b3288dd7d64dbc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0cd395f9-e766-4e32-94b1-775454bf3449', 'created_at': datetime.datetime(2026, 9, 23, 12, 25, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 23, 12, 25, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0cd395f9-e766-4e32-94b1-775454bf3449/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:47:02 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-208aa95c-2a1c-4c30-a2bb-0111a21ed45f tempest-TestShelveInstance-1881221595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (818e84be-37c2-4544-86ac-56d928f8f3b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:47:02 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-208aa95c-2a1c-4c30-a2bb-0111a21ed45f tempest-TestShelveInstance-1881221595 None] Volume volume-b7484332-4caa-49ff-90d7-cc3a08c2d230 (b7484332-4caa-49ff-90d7-cc3a08c2d230): created successfully Sep 23 14:47:02 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-208aa95c-2a1c-4c30-a2bb-0111a21ed45f tempest-TestShelveInstance-1881221595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (818e84be-37c2-4544-86ac-56d928f8f3b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:47:02 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-208aa95c-2a1c-4c30-a2bb-0111a21ed45f tempest-TestShelveInstance-1881221595 None] Flow 'volume_create_manager' (0d40b609-f3b9-42eb-91e7-1c031a91aa6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:47:02 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-208aa95c-2a1c-4c30-a2bb-0111a21ed45f tempest-TestShelveInstance-1881221595 None] Created volume successfully. Sep 23 14:47:02 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7d9add5-2cb8-4b08-91b9-eace9914d688 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:47:02 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-c7d9add5-2cb8-4b08-91b9-eace9914d688 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Flow 'volume_create_manager' (69667a74-c845-4352-8b3c-6ab427f836f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:47:02 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-c7d9add5-2cb8-4b08-91b9-eace9914d688 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7981c87-0ab0-4598-b509-675668c5152a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:47:02 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-c7d9add5-2cb8-4b08-91b9-eace9914d688 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7981c87-0ab0-4598-b509-675668c5152a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:47:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1401837334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6e1a44b-21be-4c9b-9d9c-1732a3946df3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cc3e5afbb784cc98646f15e4af39fc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:47:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:47:03Z,use_quota=True,user_id='773a01872fd34e31a7411ff49d1593a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:47:02 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-c7d9add5-2cb8-4b08-91b9-eace9914d688 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38bf52b1-6da2-44cf-b8f2-6a3a464e094a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:47:02 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-c7d9add5-2cb8-4b08-91b9-eace9914d688 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38bf52b1-6da2-44cf-b8f2-6a3a464e094a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:47:02 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-c7d9add5-2cb8-4b08-91b9-eace9914d688 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77a412f0-2a7c-45bc-be86-cdd5d972b18b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:47:02 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-c7d9add5-2cb8-4b08-91b9-eace9914d688 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77a412f0-2a7c-45bc-be86-cdd5d972b18b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6e1a44b-21be-4c9b-9d9c-1732a3946df3', 'volume_name': 'volume-d6e1a44b-21be-4c9b-9d9c-1732a3946df3', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:47:02 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-c7d9add5-2cb8-4b08-91b9-eace9914d688 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (319dc58c-3c94-4ea6-98a7-1a0afa3a9e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:47:02 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-c7d9add5-2cb8-4b08-91b9-eace9914d688 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (319dc58c-3c94-4ea6-98a7-1a0afa3a9e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:47:02 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-c7d9add5-2cb8-4b08-91b9-eace9914d688 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8821fbeb-c03c-4e66-aa7c-9b9084f7d4cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:47:02 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-c7d9add5-2cb8-4b08-91b9-eace9914d688 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Volume d6e1a44b-21be-4c9b-9d9c-1732a3946df3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6e1a44b-21be-4c9b-9d9c-1732a3946df3', 'volume_size': 1} Sep 23 14:47:02 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-c7d9add5-2cb8-4b08-91b9-eace9914d688 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:47:02 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-c7d9add5-2cb8-4b08-91b9-eace9914d688 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:47:02 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-c7d9add5-2cb8-4b08-91b9-eace9914d688 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:47:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1401837334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6e1a44b-21be-4c9b-9d9c-1732a3946df3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cc3e5afbb784cc98646f15e4af39fc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:47:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:47:03Z,use_quota=True,user_id='773a01872fd34e31a7411ff49d1593a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:47:02 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-c7d9add5-2cb8-4b08-91b9-eace9914d688 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Creating volume d6e1a44b-21be-4c9b-9d9c-1732a3946df3 {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:47:02 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-c7d9add5-2cb8-4b08-91b9-eace9914d688 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:47:02 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-c7d9add5-2cb8-4b08-91b9-eace9914d688 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:47:02 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-c7d9add5-2cb8-4b08-91b9-eace9914d688 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:47:02 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-c7d9add5-2cb8-4b08-91b9-eace9914d688 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:47:02 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-c7d9add5-2cb8-4b08-91b9-eace9914d688 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:47:02 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-c7d9add5-2cb8-4b08-91b9-eace9914d688 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:47:02 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-c7d9add5-2cb8-4b08-91b9-eace9914d688 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:47:02 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-c7d9add5-2cb8-4b08-91b9-eace9914d688 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d6e1a44b-21be-4c9b-9d9c-1732a3946df3 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:47:02 devstack sudo[101475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d6e1a44b-21be-4c9b-9d9c-1732a3946df3 1073741824 Sep 23 14:47:02 devstack sudo[101475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:47:03 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ce9d821-ae90-4848-a21b-e42e5a5bbdd6 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:47:03 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-3ce9d821-ae90-4848-a21b-e42e5a5bbdd6 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Flow 'volume_create_manager' (1e93e8ff-a278-4a89-9719-29f040502855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:47:03 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-3ce9d821-ae90-4848-a21b-e42e5a5bbdd6 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06bdb3bf-d3ea-4420-8fd2-45c9f9260105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:47:03 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-3ce9d821-ae90-4848-a21b-e42e5a5bbdd6 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06bdb3bf-d3ea-4420-8fd2-45c9f9260105) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:47:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-117993517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b9c3aa4-8a78-46be-ad5a-ed5f3e55ffb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cc3e5afbb784cc98646f15e4af39fc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:47:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:47:03Z,use_quota=True,user_id='773a01872fd34e31a7411ff49d1593a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:47:03 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-3ce9d821-ae90-4848-a21b-e42e5a5bbdd6 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d420ca0a-ea70-44cf-ab84-306a1fff1324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:47:03 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-3ce9d821-ae90-4848-a21b-e42e5a5bbdd6 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d420ca0a-ea70-44cf-ab84-306a1fff1324) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:47:03 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-3ce9d821-ae90-4848-a21b-e42e5a5bbdd6 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8b02c05-0998-4bff-afa1-e1225429092f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:47:03 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-3ce9d821-ae90-4848-a21b-e42e5a5bbdd6 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8b02c05-0998-4bff-afa1-e1225429092f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b9c3aa4-8a78-46be-ad5a-ed5f3e55ffb0', 'volume_name': 'volume-5b9c3aa4-8a78-46be-ad5a-ed5f3e55ffb0', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:47:03 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-3ce9d821-ae90-4848-a21b-e42e5a5bbdd6 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a08a91d-529e-4dd8-960f-f0f92995967d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:47:03 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-3ce9d821-ae90-4848-a21b-e42e5a5bbdd6 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a08a91d-529e-4dd8-960f-f0f92995967d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:47:03 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-3ce9d821-ae90-4848-a21b-e42e5a5bbdd6 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c41ba35-d480-4354-9650-71bccc4013a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:47:03 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-3ce9d821-ae90-4848-a21b-e42e5a5bbdd6 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Volume 5b9c3aa4-8a78-46be-ad5a-ed5f3e55ffb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b9c3aa4-8a78-46be-ad5a-ed5f3e55ffb0', 'volume_size': 1} Sep 23 14:47:03 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-3ce9d821-ae90-4848-a21b-e42e5a5bbdd6 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:47:03 devstack sudo[101475]: pam_unix(sudo:session): session closed for user root Sep 23 14:47:03 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-c7d9add5-2cb8-4b08-91b9-eace9914d688 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d6e1a44b-21be-4c9b-9d9c-1732a3946df3 1073741824" returned: 0 in 0.698s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:47:03 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-c7d9add5-2cb8-4b08-91b9-eace9914d688 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d6e1a44b-21be-4c9b-9d9c-1732a3946df3 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:47:03 devstack sudo[101480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d6e1a44b-21be-4c9b-9d9c-1732a3946df3 Sep 23 14:47:03 devstack sudo[101480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:47:03 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-849a3b10-d374-4679-b31c-291313dc2d64 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:47:03 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-849a3b10-d374-4679-b31c-291313dc2d64 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Flow 'volume_create_manager' (1e82808b-a1d7-429c-969e-5fad2275087f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:47:03 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-849a3b10-d374-4679-b31c-291313dc2d64 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79725bb6-c7df-4a18-8449-962893f71d0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:47:03 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-849a3b10-d374-4679-b31c-291313dc2d64 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79725bb6-c7df-4a18-8449-962893f71d0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:47:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-277423758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59ce158e-8985-49bb-9f20-a3e86ded9a06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cc3e5afbb784cc98646f15e4af39fc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:47:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:47:04Z,use_quota=True,user_id='773a01872fd34e31a7411ff49d1593a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:47:03 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-849a3b10-d374-4679-b31c-291313dc2d64 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (409513e0-f036-4260-8815-0915fc9762b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:47:03 devstack sudo[101480]: pam_unix(sudo:session): session closed for user root Sep 23 14:47:03 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-849a3b10-d374-4679-b31c-291313dc2d64 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (409513e0-f036-4260-8815-0915fc9762b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:47:03 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-849a3b10-d374-4679-b31c-291313dc2d64 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d1f6258-a974-4979-b867-77742b932c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:47:03 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-849a3b10-d374-4679-b31c-291313dc2d64 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d1f6258-a974-4979-b867-77742b932c14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59ce158e-8985-49bb-9f20-a3e86ded9a06', 'volume_name': 'volume-59ce158e-8985-49bb-9f20-a3e86ded9a06', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:47:03 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-849a3b10-d374-4679-b31c-291313dc2d64 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eef6372f-4f10-43f8-a909-2924cc63bf5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:47:03 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-849a3b10-d374-4679-b31c-291313dc2d64 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eef6372f-4f10-43f8-a909-2924cc63bf5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:47:03 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-849a3b10-d374-4679-b31c-291313dc2d64 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b04b7c21-fdaa-489c-a853-fa7e47bffd39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:47:03 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-849a3b10-d374-4679-b31c-291313dc2d64 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Volume 59ce158e-8985-49bb-9f20-a3e86ded9a06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59ce158e-8985-49bb-9f20-a3e86ded9a06', 'volume_size': 1} Sep 23 14:47:03 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-849a3b10-d374-4679-b31c-291313dc2d64 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:47:03 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-c7d9add5-2cb8-4b08-91b9-eace9914d688 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d6e1a44b-21be-4c9b-9d9c-1732a3946df3" returned: 0 in 0.535s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:47:03 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-c7d9add5-2cb8-4b08-91b9-eace9914d688 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] <== create_volume: return (1318ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:47:03 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-c7d9add5-2cb8-4b08-91b9-eace9914d688 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.321s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:47:04 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-3ce9d821-ae90-4848-a21b-e42e5a5bbdd6 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.660s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:47:04 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-3ce9d821-ae90-4848-a21b-e42e5a5bbdd6 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:47:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-117993517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b9c3aa4-8a78-46be-ad5a-ed5f3e55ffb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cc3e5afbb784cc98646f15e4af39fc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:47:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:47:03Z,use_quota=True,user_id='773a01872fd34e31a7411ff49d1593a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:47:04 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-3ce9d821-ae90-4848-a21b-e42e5a5bbdd6 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Creating volume 5b9c3aa4-8a78-46be-ad5a-ed5f3e55ffb0 {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:47:04 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-3ce9d821-ae90-4848-a21b-e42e5a5bbdd6 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:47:04 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-3ce9d821-ae90-4848-a21b-e42e5a5bbdd6 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:47:04 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-3ce9d821-ae90-4848-a21b-e42e5a5bbdd6 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:47:04 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-3ce9d821-ae90-4848-a21b-e42e5a5bbdd6 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:47:04 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-3ce9d821-ae90-4848-a21b-e42e5a5bbdd6 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:47:04 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-3ce9d821-ae90-4848-a21b-e42e5a5bbdd6 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:47:04 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-3ce9d821-ae90-4848-a21b-e42e5a5bbdd6 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:47:04 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-3ce9d821-ae90-4848-a21b-e42e5a5bbdd6 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-5b9c3aa4-8a78-46be-ad5a-ed5f3e55ffb0 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:47:04 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-c7d9add5-2cb8-4b08-91b9-eace9914d688 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8821fbeb-c03c-4e66-aa7c-9b9084f7d4cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6e1a44b-21be-4c9b-9d9c-1732a3946df3', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:47:04 devstack sudo[101483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-5b9c3aa4-8a78-46be-ad5a-ed5f3e55ffb0 1073741824 Sep 23 14:47:04 devstack sudo[101483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:47:04 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-c7d9add5-2cb8-4b08-91b9-eace9914d688 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57f905e4-a1e9-41ed-87fc-f75fd8438bc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:47:04 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-c7d9add5-2cb8-4b08-91b9-eace9914d688 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Volume volume-d6e1a44b-21be-4c9b-9d9c-1732a3946df3 (d6e1a44b-21be-4c9b-9d9c-1732a3946df3): created successfully Sep 23 14:47:04 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-c7d9add5-2cb8-4b08-91b9-eace9914d688 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57f905e4-a1e9-41ed-87fc-f75fd8438bc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:47:04 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-c7d9add5-2cb8-4b08-91b9-eace9914d688 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Flow 'volume_create_manager' (69667a74-c845-4352-8b3c-6ab427f836f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:47:04 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-c7d9add5-2cb8-4b08-91b9-eace9914d688 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Created volume successfully. Sep 23 14:47:04 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7b59930-6fed-4d82-ac6a-bd34325df6a3 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:47:04 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-c7b59930-6fed-4d82-ac6a-bd34325df6a3 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Flow 'volume_create_manager' (e57217ed-6e16-4215-be2e-0988e95caa90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:47:04 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-c7b59930-6fed-4d82-ac6a-bd34325df6a3 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9faef9e0-83c0-4578-af7e-d565415d7ab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:47:04 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-c7b59930-6fed-4d82-ac6a-bd34325df6a3 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9faef9e0-83c0-4578-af7e-d565415d7ab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:47:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-751867874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f909172-0e98-4340-966c-dec19684b194,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cc3e5afbb784cc98646f15e4af39fc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:47:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:47:04Z,use_quota=True,user_id='773a01872fd34e31a7411ff49d1593a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:47:04 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-c7b59930-6fed-4d82-ac6a-bd34325df6a3 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e8854f1-bae2-4863-b342-af62edf67a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:47:04 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-c7b59930-6fed-4d82-ac6a-bd34325df6a3 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e8854f1-bae2-4863-b342-af62edf67a6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:47:04 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-c7b59930-6fed-4d82-ac6a-bd34325df6a3 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62308fb3-5cbd-45d9-910f-3d43deefcd95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:47:04 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-c7b59930-6fed-4d82-ac6a-bd34325df6a3 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62308fb3-5cbd-45d9-910f-3d43deefcd95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f909172-0e98-4340-966c-dec19684b194', 'volume_name': 'volume-2f909172-0e98-4340-966c-dec19684b194', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:47:04 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-c7b59930-6fed-4d82-ac6a-bd34325df6a3 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (999f5ffd-6605-49b5-b01d-eeb0cf67c47a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:47:04 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-c7b59930-6fed-4d82-ac6a-bd34325df6a3 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (999f5ffd-6605-49b5-b01d-eeb0cf67c47a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:47:04 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-c7b59930-6fed-4d82-ac6a-bd34325df6a3 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7e2aecc-b231-4c10-b1c1-fb645aa9f4e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:47:04 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-c7b59930-6fed-4d82-ac6a-bd34325df6a3 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Volume 2f909172-0e98-4340-966c-dec19684b194: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f909172-0e98-4340-966c-dec19684b194', 'volume_size': 1} Sep 23 14:47:04 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-c7b59930-6fed-4d82-ac6a-bd34325df6a3 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:47:04 devstack sudo[101483]: pam_unix(sudo:session): session closed for user root Sep 23 14:47:04 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-3ce9d821-ae90-4848-a21b-e42e5a5bbdd6 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-5b9c3aa4-8a78-46be-ad5a-ed5f3e55ffb0 1073741824" returned: 0 in 0.858s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:47:04 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-3ce9d821-ae90-4848-a21b-e42e5a5bbdd6 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-5b9c3aa4-8a78-46be-ad5a-ed5f3e55ffb0 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:47:05 devstack sudo[101492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-5b9c3aa4-8a78-46be-ad5a-ed5f3e55ffb0 Sep 23 14:47:05 devstack sudo[101492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:47:05 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-565f9daf-7333-421c-9e72-f9b221c00aa5 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:47:05 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-565f9daf-7333-421c-9e72-f9b221c00aa5 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Flow 'volume_create_manager' (074ac512-bee6-49fd-9646-5281ce54a78d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:47:05 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-565f9daf-7333-421c-9e72-f9b221c00aa5 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e3a7bf6-2e7a-4b66-b8cc-005d18a8e23d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:47:05 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-565f9daf-7333-421c-9e72-f9b221c00aa5 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e3a7bf6-2e7a-4b66-b8cc-005d18a8e23d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:47:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1386146100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ebad820-b3b7-447b-882a-520e9a505789,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cc3e5afbb784cc98646f15e4af39fc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:47:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:47:05Z,use_quota=True,user_id='773a01872fd34e31a7411ff49d1593a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:47:05 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-565f9daf-7333-421c-9e72-f9b221c00aa5 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1f3b531-edd3-43b5-8d0a-d4ae7542cbd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:47:05 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-565f9daf-7333-421c-9e72-f9b221c00aa5 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1f3b531-edd3-43b5-8d0a-d4ae7542cbd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:47:05 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-565f9daf-7333-421c-9e72-f9b221c00aa5 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f756e1f-ebb1-4f13-98c1-4965bfc9bcf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:47:05 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-565f9daf-7333-421c-9e72-f9b221c00aa5 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f756e1f-ebb1-4f13-98c1-4965bfc9bcf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ebad820-b3b7-447b-882a-520e9a505789', 'volume_name': 'volume-6ebad820-b3b7-447b-882a-520e9a505789', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:47:05 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-565f9daf-7333-421c-9e72-f9b221c00aa5 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec6b2e79-7108-4c8b-9214-a0e375e6cdab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:47:05 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-565f9daf-7333-421c-9e72-f9b221c00aa5 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec6b2e79-7108-4c8b-9214-a0e375e6cdab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:47:05 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-565f9daf-7333-421c-9e72-f9b221c00aa5 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1561939-9e8f-4f8e-8a1c-223e1e6a5b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:47:05 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-565f9daf-7333-421c-9e72-f9b221c00aa5 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Volume 6ebad820-b3b7-447b-882a-520e9a505789: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ebad820-b3b7-447b-882a-520e9a505789', 'volume_size': 1} Sep 23 14:47:05 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-565f9daf-7333-421c-9e72-f9b221c00aa5 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:47:05 devstack sudo[101492]: pam_unix(sudo:session): session closed for user root Sep 23 14:47:05 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-3ce9d821-ae90-4848-a21b-e42e5a5bbdd6 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-5b9c3aa4-8a78-46be-ad5a-ed5f3e55ffb0" returned: 0 in 0.439s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:47:05 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-3ce9d821-ae90-4848-a21b-e42e5a5bbdd6 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] <== create_volume: return (1369ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:47:05 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-3ce9d821-ae90-4848-a21b-e42e5a5bbdd6 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.375s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:47:05 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-849a3b10-d374-4679-b31c-291313dc2d64 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.392s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:47:05 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-849a3b10-d374-4679-b31c-291313dc2d64 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:47:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-277423758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59ce158e-8985-49bb-9f20-a3e86ded9a06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cc3e5afbb784cc98646f15e4af39fc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:47:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:47:04Z,use_quota=True,user_id='773a01872fd34e31a7411ff49d1593a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:47:05 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-849a3b10-d374-4679-b31c-291313dc2d64 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Creating volume 59ce158e-8985-49bb-9f20-a3e86ded9a06 {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:47:05 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-849a3b10-d374-4679-b31c-291313dc2d64 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:47:05 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-849a3b10-d374-4679-b31c-291313dc2d64 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:47:05 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-849a3b10-d374-4679-b31c-291313dc2d64 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:47:05 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-849a3b10-d374-4679-b31c-291313dc2d64 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:47:05 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-849a3b10-d374-4679-b31c-291313dc2d64 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:47:05 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-849a3b10-d374-4679-b31c-291313dc2d64 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:47:05 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-849a3b10-d374-4679-b31c-291313dc2d64 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:47:05 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-849a3b10-d374-4679-b31c-291313dc2d64 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-59ce158e-8985-49bb-9f20-a3e86ded9a06 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:47:05 devstack sudo[101495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-59ce158e-8985-49bb-9f20-a3e86ded9a06 1073741824 Sep 23 14:47:05 devstack sudo[101495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:47:05 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-3ce9d821-ae90-4848-a21b-e42e5a5bbdd6 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c41ba35-d480-4354-9650-71bccc4013a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b9c3aa4-8a78-46be-ad5a-ed5f3e55ffb0', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:47:05 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-3ce9d821-ae90-4848-a21b-e42e5a5bbdd6 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6acf425-2e26-4998-b423-1cc8a6383910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:47:05 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-3ce9d821-ae90-4848-a21b-e42e5a5bbdd6 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Volume volume-5b9c3aa4-8a78-46be-ad5a-ed5f3e55ffb0 (5b9c3aa4-8a78-46be-ad5a-ed5f3e55ffb0): created successfully Sep 23 14:47:05 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-3ce9d821-ae90-4848-a21b-e42e5a5bbdd6 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6acf425-2e26-4998-b423-1cc8a6383910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:47:05 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-3ce9d821-ae90-4848-a21b-e42e5a5bbdd6 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Flow 'volume_create_manager' (1e93e8ff-a278-4a89-9719-29f040502855) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:47:05 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-3ce9d821-ae90-4848-a21b-e42e5a5bbdd6 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Created volume successfully. Sep 23 14:47:05 devstack sudo[101495]: pam_unix(sudo:session): session closed for user root Sep 23 14:47:05 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-849a3b10-d374-4679-b31c-291313dc2d64 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-59ce158e-8985-49bb-9f20-a3e86ded9a06 1073741824" returned: 0 in 0.495s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:47:05 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-849a3b10-d374-4679-b31c-291313dc2d64 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-59ce158e-8985-49bb-9f20-a3e86ded9a06 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:47:05 devstack sudo[101500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-59ce158e-8985-49bb-9f20-a3e86ded9a06 Sep 23 14:47:05 devstack sudo[101500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:47:06 devstack sudo[101500]: pam_unix(sudo:session): session closed for user root Sep 23 14:47:06 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-849a3b10-d374-4679-b31c-291313dc2d64 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-59ce158e-8985-49bb-9f20-a3e86ded9a06" returned: 0 in 0.359s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:47:06 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-849a3b10-d374-4679-b31c-291313dc2d64 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:47:06 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-849a3b10-d374-4679-b31c-291313dc2d64 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:47:06 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-c7b59930-6fed-4d82-ac6a-bd34325df6a3 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.626s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:47:06 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-c7b59930-6fed-4d82-ac6a-bd34325df6a3 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:47:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-751867874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f909172-0e98-4340-966c-dec19684b194,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cc3e5afbb784cc98646f15e4af39fc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:47:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:47:04Z,use_quota=True,user_id='773a01872fd34e31a7411ff49d1593a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:47:06 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-c7b59930-6fed-4d82-ac6a-bd34325df6a3 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Creating volume 2f909172-0e98-4340-966c-dec19684b194 {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:47:06 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-c7b59930-6fed-4d82-ac6a-bd34325df6a3 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:47:06 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-c7b59930-6fed-4d82-ac6a-bd34325df6a3 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:47:06 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-c7b59930-6fed-4d82-ac6a-bd34325df6a3 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:47:06 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-c7b59930-6fed-4d82-ac6a-bd34325df6a3 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:47:06 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-c7b59930-6fed-4d82-ac6a-bd34325df6a3 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:47:06 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-c7b59930-6fed-4d82-ac6a-bd34325df6a3 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:47:06 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-c7b59930-6fed-4d82-ac6a-bd34325df6a3 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:47:06 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-c7b59930-6fed-4d82-ac6a-bd34325df6a3 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2f909172-0e98-4340-966c-dec19684b194 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:47:06 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-849a3b10-d374-4679-b31c-291313dc2d64 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b04b7c21-fdaa-489c-a853-fa7e47bffd39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59ce158e-8985-49bb-9f20-a3e86ded9a06', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:47:06 devstack sudo[101503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2f909172-0e98-4340-966c-dec19684b194 1073741824 Sep 23 14:47:06 devstack sudo[101503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:47:06 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-849a3b10-d374-4679-b31c-291313dc2d64 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1b9b22c-b9f9-4e46-96d4-91642bfa11a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:47:06 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-849a3b10-d374-4679-b31c-291313dc2d64 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Volume volume-59ce158e-8985-49bb-9f20-a3e86ded9a06 (59ce158e-8985-49bb-9f20-a3e86ded9a06): created successfully Sep 23 14:47:06 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-849a3b10-d374-4679-b31c-291313dc2d64 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1b9b22c-b9f9-4e46-96d4-91642bfa11a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:47:06 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-849a3b10-d374-4679-b31c-291313dc2d64 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Flow 'volume_create_manager' (1e82808b-a1d7-429c-969e-5fad2275087f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:47:06 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-849a3b10-d374-4679-b31c-291313dc2d64 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Created volume successfully. Sep 23 14:47:06 devstack sudo[101503]: pam_unix(sudo:session): session closed for user root Sep 23 14:47:06 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-c7b59930-6fed-4d82-ac6a-bd34325df6a3 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2f909172-0e98-4340-966c-dec19684b194 1073741824" returned: 0 in 0.563s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:47:06 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-c7b59930-6fed-4d82-ac6a-bd34325df6a3 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2f909172-0e98-4340-966c-dec19684b194 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:47:07 devstack sudo[101511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2f909172-0e98-4340-966c-dec19684b194 Sep 23 14:47:07 devstack sudo[101511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:47:07 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [req-818bc2b1-1b12-416c-803b-c79fe3547f4f req-c76a1422-3299-4743-a9f4-0105caaac185 tempest-TestShelveInstance-1881221595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:47:07 devstack sudo[101511]: pam_unix(sudo:session): session closed for user root Sep 23 14:47:07 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-c7b59930-6fed-4d82-ac6a-bd34325df6a3 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2f909172-0e98-4340-966c-dec19684b194" returned: 0 in 0.375s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:47:07 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-c7b59930-6fed-4d82-ac6a-bd34325df6a3 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:47:07 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-c7b59930-6fed-4d82-ac6a-bd34325df6a3 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:47:07 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-565f9daf-7333-421c-9e72-f9b221c00aa5 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.138s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:47:07 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-565f9daf-7333-421c-9e72-f9b221c00aa5 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:47:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1386146100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ebad820-b3b7-447b-882a-520e9a505789,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cc3e5afbb784cc98646f15e4af39fc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:47:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:47:05Z,use_quota=True,user_id='773a01872fd34e31a7411ff49d1593a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:47:07 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-565f9daf-7333-421c-9e72-f9b221c00aa5 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Creating volume 6ebad820-b3b7-447b-882a-520e9a505789 {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:47:07 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-565f9daf-7333-421c-9e72-f9b221c00aa5 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:47:07 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-565f9daf-7333-421c-9e72-f9b221c00aa5 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:47:07 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-565f9daf-7333-421c-9e72-f9b221c00aa5 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:47:07 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-565f9daf-7333-421c-9e72-f9b221c00aa5 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:47:07 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-565f9daf-7333-421c-9e72-f9b221c00aa5 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:47:07 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-565f9daf-7333-421c-9e72-f9b221c00aa5 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:47:07 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-565f9daf-7333-421c-9e72-f9b221c00aa5 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:47:07 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-565f9daf-7333-421c-9e72-f9b221c00aa5 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6ebad820-b3b7-447b-882a-520e9a505789 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:47:07 devstack sudo[101520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6ebad820-b3b7-447b-882a-520e9a505789 1073741824 Sep 23 14:47:07 devstack sudo[101520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:47:07 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-c7b59930-6fed-4d82-ac6a-bd34325df6a3 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7e2aecc-b231-4c10-b1c1-fb645aa9f4e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f909172-0e98-4340-966c-dec19684b194', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:47:07 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-c7b59930-6fed-4d82-ac6a-bd34325df6a3 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b47d7b20-9bb9-4352-9d42-13936a2355b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:47:07 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-c7b59930-6fed-4d82-ac6a-bd34325df6a3 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Volume volume-2f909172-0e98-4340-966c-dec19684b194 (2f909172-0e98-4340-966c-dec19684b194): created successfully Sep 23 14:47:07 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-c7b59930-6fed-4d82-ac6a-bd34325df6a3 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b47d7b20-9bb9-4352-9d42-13936a2355b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:47:07 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-c7b59930-6fed-4d82-ac6a-bd34325df6a3 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Flow 'volume_create_manager' (e57217ed-6e16-4215-be2e-0988e95caa90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:47:07 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-c7b59930-6fed-4d82-ac6a-bd34325df6a3 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Created volume successfully. Sep 23 14:47:08 devstack sudo[101520]: pam_unix(sudo:session): session closed for user root Sep 23 14:47:08 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-565f9daf-7333-421c-9e72-f9b221c00aa5 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6ebad820-b3b7-447b-882a-520e9a505789 1073741824" returned: 0 in 0.630s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:47:08 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-565f9daf-7333-421c-9e72-f9b221c00aa5 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6ebad820-b3b7-447b-882a-520e9a505789 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:47:08 devstack sudo[101526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6ebad820-b3b7-447b-882a-520e9a505789 Sep 23 14:47:08 devstack sudo[101526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:47:08 devstack sudo[101526]: pam_unix(sudo:session): session closed for user root Sep 23 14:47:08 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-565f9daf-7333-421c-9e72-f9b221c00aa5 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6ebad820-b3b7-447b-882a-520e9a505789" returned: 0 in 0.288s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:47:08 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-565f9daf-7333-421c-9e72-f9b221c00aa5 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:47:08 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-565f9daf-7333-421c-9e72-f9b221c00aa5 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:47:08 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [req-818bc2b1-1b12-416c-803b-c79fe3547f4f req-c76a1422-3299-4743-a9f4-0105caaac185 tempest-TestShelveInstance-1881221595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.040s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:47:08 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-565f9daf-7333-421c-9e72-f9b221c00aa5 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1561939-9e8f-4f8e-8a1c-223e1e6a5b27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ebad820-b3b7-447b-882a-520e9a505789', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:47:08 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-565f9daf-7333-421c-9e72-f9b221c00aa5 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18dff4db-a8d4-4d23-9e20-b0840d1322e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:47:08 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [req-818bc2b1-1b12-416c-803b-c79fe3547f4f req-c76a1422-3299-4743-a9f4-0105caaac185 tempest-TestShelveInstance-1881221595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.036s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:47:08 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-565f9daf-7333-421c-9e72-f9b221c00aa5 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Volume volume-6ebad820-b3b7-447b-882a-520e9a505789 (6ebad820-b3b7-447b-882a-520e9a505789): created successfully Sep 23 14:47:08 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-565f9daf-7333-421c-9e72-f9b221c00aa5 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18dff4db-a8d4-4d23-9e20-b0840d1322e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:47:08 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-565f9daf-7333-421c-9e72-f9b221c00aa5 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Flow 'volume_create_manager' (074ac512-bee6-49fd-9646-5281ce54a78d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:47:08 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-565f9daf-7333-421c-9e72-f9b221c00aa5 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Created volume successfully. Sep 23 14:47:08 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [req-818bc2b1-1b12-416c-803b-c79fe3547f4f req-c76a1422-3299-4743-a9f4-0105caaac185 tempest-TestShelveInstance-1881221595 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362', 'name': 'volume-b7484332-4caa-49ff-90d7-cc3a08c2d230', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ccedc602-37a9-4829-8c1d-1d70753ec5f0', 'enforce_multipath': True} {{(pid=86310) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 14:47:08 devstack cinder-volume[86310]: INFO cinder.volume.manager [req-818bc2b1-1b12-416c-803b-c79fe3547f4f req-c76a1422-3299-4743-a9f4-0105caaac185 tempest-TestShelveInstance-1881221595 None] attachment_update completed successfully. Sep 23 14:47:08 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-e711b639-27a7-49c9-8964-7a92a273b023 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Acquiring lock "cinder-6ebad820-b3b7-447b-882a-520e9a505789-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:47:08 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-e711b639-27a7-49c9-8964-7a92a273b023 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Lock "cinder-6ebad820-b3b7-447b-882a-520e9a505789-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:47:08 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-e711b639-27a7-49c9-8964-7a92a273b023 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Acquiring lock "cinder-quobyte-6ebad820-b3b7-447b-882a-520e9a505789" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:47:08 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-e711b639-27a7-49c9-8964-7a92a273b023 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Lock "cinder-quobyte-6ebad820-b3b7-447b-882a-520e9a505789" acquired by "delete_volume" :: waited 0.030s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:47:09 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9937cf9-a9c3-4ad0-ba1e-9a8638927bb1]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:47:09 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-e711b639-27a7-49c9-8964-7a92a273b023 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6ebad820-b3b7-447b-882a-520e9a505789 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:47:09 devstack sudo[101544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6ebad820-b3b7-447b-882a-520e9a505789 Sep 23 14:47:09 devstack sudo[101544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:47:09 devstack sudo[101544]: pam_unix(sudo:session): session closed for user root Sep 23 14:47:09 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-e711b639-27a7-49c9-8964-7a92a273b023 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6ebad820-b3b7-447b-882a-520e9a505789" returned: 0 in 0.470s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:47:09 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-e711b639-27a7-49c9-8964-7a92a273b023 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6ebad820-b3b7-447b-882a-520e9a505789 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:47:09 devstack sudo[101549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6ebad820-b3b7-447b-882a-520e9a505789 Sep 23 14:47:09 devstack sudo[101549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:47:09 devstack sudo[101549]: pam_unix(sudo:session): session closed for user root Sep 23 14:47:09 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-e711b639-27a7-49c9-8964-7a92a273b023 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6ebad820-b3b7-447b-882a-520e9a505789" returned: 0 in 0.271s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:47:09 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-e711b639-27a7-49c9-8964-7a92a273b023 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Lock "cinder-quobyte-6ebad820-b3b7-447b-882a-520e9a505789" released by "delete_volume" :: held 0.882s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:47:09 devstack cinder-volume[86310]: DEBUG dbcounter [-] [86310] Writing DB stats cinder:SELECT=105,cinder:UPDATE=107,cinder:INSERT=23,cinder:DELETE=10 {{(pid=86310) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 14:47:09 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-e711b639-27a7-49c9-8964-7a92a273b023 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Created reservations ['9426a7c4-5928-4fe1-bc0a-31b36e4b0765', '443ed560-4c3e-4568-8d8b-b67981165aea', '8bf9acf8-94bc-485c-a7c8-63186edb825e', '4b77af96-46bb-453c-8be2-b775a6e84b7c'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:47:09 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-e711b639-27a7-49c9-8964-7a92a273b023 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:47:09 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-e711b639-27a7-49c9-8964-7a92a273b023 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:47:09 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-e711b639-27a7-49c9-8964-7a92a273b023 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:47:09 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-e711b639-27a7-49c9-8964-7a92a273b023 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:47:09 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-e711b639-27a7-49c9-8964-7a92a273b023 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:47:09 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-e711b639-27a7-49c9-8964-7a92a273b023 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:47:10 devstack sudo[101553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:47:10 devstack sudo[101553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:47:10 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-9d55ae35-471b-4402-b9d8-7e0fa1e85115 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Acquiring lock "cinder-2f909172-0e98-4340-966c-dec19684b194-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:47:10 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-9d55ae35-471b-4402-b9d8-7e0fa1e85115 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Lock "cinder-2f909172-0e98-4340-966c-dec19684b194-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:47:10 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-9d55ae35-471b-4402-b9d8-7e0fa1e85115 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Acquiring lock "cinder-quobyte-2f909172-0e98-4340-966c-dec19684b194" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:47:10 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-9d55ae35-471b-4402-b9d8-7e0fa1e85115 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Lock "cinder-quobyte-2f909172-0e98-4340-966c-dec19684b194" acquired by "delete_volume" :: waited 0.036s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:47:10 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d336a00-ba2d-40dd-be9d-ad4be25bd3c7]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:47:10 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-9d55ae35-471b-4402-b9d8-7e0fa1e85115 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2f909172-0e98-4340-966c-dec19684b194 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:47:10 devstack sudo[101553]: pam_unix(sudo:session): session closed for user root Sep 23 14:47:10 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-e711b639-27a7-49c9-8964-7a92a273b023 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.421s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:47:10 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-e711b639-27a7-49c9-8964-7a92a273b023 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:47:10 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-e711b639-27a7-49c9-8964-7a92a273b023 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Deleted volume successfully. Sep 23 14:47:10 devstack sudo[101556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2f909172-0e98-4340-966c-dec19684b194 Sep 23 14:47:10 devstack sudo[101556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:47:10 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-e711b639-27a7-49c9-8964-7a92a273b023 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Lock "cinder-6ebad820-b3b7-447b-882a-520e9a505789-delete_volume" released by "delete_volume" :: held 1.623s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:47:10 devstack sudo[101556]: pam_unix(sudo:session): session closed for user root Sep 23 14:47:10 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-9d55ae35-471b-4402-b9d8-7e0fa1e85115 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2f909172-0e98-4340-966c-dec19684b194" returned: 0 in 0.560s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:47:10 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-9d55ae35-471b-4402-b9d8-7e0fa1e85115 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2f909172-0e98-4340-966c-dec19684b194 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:47:10 devstack sudo[101675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2f909172-0e98-4340-966c-dec19684b194 Sep 23 14:47:10 devstack sudo[101675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:47:11 devstack sudo[101675]: pam_unix(sudo:session): session closed for user root Sep 23 14:47:11 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-9d55ae35-471b-4402-b9d8-7e0fa1e85115 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2f909172-0e98-4340-966c-dec19684b194" returned: 0 in 0.378s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:47:11 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-9d55ae35-471b-4402-b9d8-7e0fa1e85115 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Lock "cinder-quobyte-2f909172-0e98-4340-966c-dec19684b194" released by "delete_volume" :: held 1.027s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:47:11 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-9d55ae35-471b-4402-b9d8-7e0fa1e85115 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Created reservations ['273983de-5746-42e8-8aaa-d4adcc8aeb62', 'c1dcc5ca-3816-4765-b96c-b244bad67a16', '72c2a07c-8c2c-4400-a800-b976f26eb64a', 'c864d6cf-1887-42f8-b60e-6680762563b9'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:47:11 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-9d55ae35-471b-4402-b9d8-7e0fa1e85115 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:47:11 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-9d55ae35-471b-4402-b9d8-7e0fa1e85115 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:47:11 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-9d55ae35-471b-4402-b9d8-7e0fa1e85115 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:47:11 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-9d55ae35-471b-4402-b9d8-7e0fa1e85115 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:47:11 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-9d55ae35-471b-4402-b9d8-7e0fa1e85115 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:47:11 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-9d55ae35-471b-4402-b9d8-7e0fa1e85115 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:47:11 devstack sudo[102034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:47:11 devstack sudo[102034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:47:11 devstack sudo[102034]: pam_unix(sudo:session): session closed for user root Sep 23 14:47:11 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-9d55ae35-471b-4402-b9d8-7e0fa1e85115 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.386s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:47:11 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-9d55ae35-471b-4402-b9d8-7e0fa1e85115 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:47:11 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-9d55ae35-471b-4402-b9d8-7e0fa1e85115 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Deleted volume successfully. Sep 23 14:47:11 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-9d55ae35-471b-4402-b9d8-7e0fa1e85115 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Lock "cinder-2f909172-0e98-4340-966c-dec19684b194-delete_volume" released by "delete_volume" :: held 1.747s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:47:12 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-6b3d1e96-381f-43f2-9912-bd46907b0315 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Acquiring lock "cinder-59ce158e-8985-49bb-9f20-a3e86ded9a06-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:47:12 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-6b3d1e96-381f-43f2-9912-bd46907b0315 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Lock "cinder-59ce158e-8985-49bb-9f20-a3e86ded9a06-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:47:12 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-6b3d1e96-381f-43f2-9912-bd46907b0315 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Acquiring lock "cinder-quobyte-59ce158e-8985-49bb-9f20-a3e86ded9a06" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:47:12 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-6b3d1e96-381f-43f2-9912-bd46907b0315 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Lock "cinder-quobyte-59ce158e-8985-49bb-9f20-a3e86ded9a06" acquired by "delete_volume" :: waited 0.024s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:47:12 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[118f2d9c-57d5-4726-88e0-08c67c58daa2]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:47:12 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-6b3d1e96-381f-43f2-9912-bd46907b0315 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-59ce158e-8985-49bb-9f20-a3e86ded9a06 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:47:12 devstack sudo[102046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-59ce158e-8985-49bb-9f20-a3e86ded9a06 Sep 23 14:47:12 devstack sudo[102046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:47:12 devstack sudo[102046]: pam_unix(sudo:session): session closed for user root Sep 23 14:47:12 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-6b3d1e96-381f-43f2-9912-bd46907b0315 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-59ce158e-8985-49bb-9f20-a3e86ded9a06" returned: 0 in 0.426s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:47:12 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-6b3d1e96-381f-43f2-9912-bd46907b0315 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-59ce158e-8985-49bb-9f20-a3e86ded9a06 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:47:13 devstack sudo[102052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-59ce158e-8985-49bb-9f20-a3e86ded9a06 Sep 23 14:47:13 devstack sudo[102052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:47:13 devstack sudo[102052]: pam_unix(sudo:session): session closed for user root Sep 23 14:47:13 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-6b3d1e96-381f-43f2-9912-bd46907b0315 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-59ce158e-8985-49bb-9f20-a3e86ded9a06" returned: 0 in 0.332s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:47:13 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-6b3d1e96-381f-43f2-9912-bd46907b0315 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Lock "cinder-quobyte-59ce158e-8985-49bb-9f20-a3e86ded9a06" released by "delete_volume" :: held 0.844s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:47:13 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-6b3d1e96-381f-43f2-9912-bd46907b0315 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Created reservations ['41f32ad1-bf09-42b3-815d-c7e6c0f94b9b', '403df6ca-193c-4ee3-b9f1-e5288f30bf38', '0a04dcad-c824-4197-b8e0-622d61d0f089', '25edddb2-26a0-4522-9e5c-cb6abc9d75a3'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:47:13 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-6b3d1e96-381f-43f2-9912-bd46907b0315 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:47:13 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-6b3d1e96-381f-43f2-9912-bd46907b0315 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:47:13 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-6b3d1e96-381f-43f2-9912-bd46907b0315 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:47:13 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-6b3d1e96-381f-43f2-9912-bd46907b0315 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:47:13 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-6b3d1e96-381f-43f2-9912-bd46907b0315 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:47:13 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-6b3d1e96-381f-43f2-9912-bd46907b0315 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:47:13 devstack sudo[102055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:47:13 devstack sudo[102055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:47:13 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-469c6cd5-0e38-431f-878b-7e3bb775c1a8 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Acquiring lock "cinder-5b9c3aa4-8a78-46be-ad5a-ed5f3e55ffb0-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:47:13 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-469c6cd5-0e38-431f-878b-7e3bb775c1a8 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Lock "cinder-5b9c3aa4-8a78-46be-ad5a-ed5f3e55ffb0-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:47:13 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-469c6cd5-0e38-431f-878b-7e3bb775c1a8 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Acquiring lock "cinder-quobyte-5b9c3aa4-8a78-46be-ad5a-ed5f3e55ffb0" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:47:13 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-469c6cd5-0e38-431f-878b-7e3bb775c1a8 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Lock "cinder-quobyte-5b9c3aa4-8a78-46be-ad5a-ed5f3e55ffb0" acquired by "delete_volume" :: waited 0.022s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:47:13 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3551499-b00b-4819-b879-a6167bb8d790]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:47:13 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-469c6cd5-0e38-431f-878b-7e3bb775c1a8 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-5b9c3aa4-8a78-46be-ad5a-ed5f3e55ffb0 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:47:13 devstack sudo[102055]: pam_unix(sudo:session): session closed for user root Sep 23 14:47:13 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-6b3d1e96-381f-43f2-9912-bd46907b0315 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.407s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:47:13 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-6b3d1e96-381f-43f2-9912-bd46907b0315 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:47:13 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-6b3d1e96-381f-43f2-9912-bd46907b0315 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Deleted volume successfully. Sep 23 14:47:13 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-6b3d1e96-381f-43f2-9912-bd46907b0315 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Lock "cinder-59ce158e-8985-49bb-9f20-a3e86ded9a06-delete_volume" released by "delete_volume" :: held 1.540s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:47:13 devstack sudo[102058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-5b9c3aa4-8a78-46be-ad5a-ed5f3e55ffb0 Sep 23 14:47:14 devstack sudo[102058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:47:14 devstack sudo[102058]: pam_unix(sudo:session): session closed for user root Sep 23 14:47:14 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-469c6cd5-0e38-431f-878b-7e3bb775c1a8 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-5b9c3aa4-8a78-46be-ad5a-ed5f3e55ffb0" returned: 0 in 0.462s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:47:14 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-469c6cd5-0e38-431f-878b-7e3bb775c1a8 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-5b9c3aa4-8a78-46be-ad5a-ed5f3e55ffb0 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:47:14 devstack sudo[102064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-5b9c3aa4-8a78-46be-ad5a-ed5f3e55ffb0 Sep 23 14:47:14 devstack sudo[102064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:47:14 devstack sudo[102064]: pam_unix(sudo:session): session closed for user root Sep 23 14:47:14 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-469c6cd5-0e38-431f-878b-7e3bb775c1a8 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-5b9c3aa4-8a78-46be-ad5a-ed5f3e55ffb0" returned: 0 in 0.313s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:47:14 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-469c6cd5-0e38-431f-878b-7e3bb775c1a8 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Lock "cinder-quobyte-5b9c3aa4-8a78-46be-ad5a-ed5f3e55ffb0" released by "delete_volume" :: held 0.836s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:47:14 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-469c6cd5-0e38-431f-878b-7e3bb775c1a8 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Created reservations ['6ba14048-015e-4a8c-a7ef-2467266d2783', 'b04af89f-8e5b-4639-b00f-d85359891eb7', '32b7ccd2-61dc-49cc-a1ef-2b3023cba4c9', 'f6f4f492-f906-4840-95c5-831f1eff7aa6'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:47:14 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-469c6cd5-0e38-431f-878b-7e3bb775c1a8 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:47:14 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-469c6cd5-0e38-431f-878b-7e3bb775c1a8 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:47:14 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-469c6cd5-0e38-431f-878b-7e3bb775c1a8 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:47:14 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-469c6cd5-0e38-431f-878b-7e3bb775c1a8 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:47:14 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-469c6cd5-0e38-431f-878b-7e3bb775c1a8 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:47:14 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-469c6cd5-0e38-431f-878b-7e3bb775c1a8 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:47:14 devstack sudo[102067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:47:14 devstack sudo[102067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:47:14 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-2d073d17-4685-468c-86b9-d1301d90d1a7 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Acquiring lock "cinder-d6e1a44b-21be-4c9b-9d9c-1732a3946df3-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:47:14 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-2d073d17-4685-468c-86b9-d1301d90d1a7 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Lock "cinder-d6e1a44b-21be-4c9b-9d9c-1732a3946df3-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:47:15 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-2d073d17-4685-468c-86b9-d1301d90d1a7 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Acquiring lock "cinder-quobyte-d6e1a44b-21be-4c9b-9d9c-1732a3946df3" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:47:15 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-2d073d17-4685-468c-86b9-d1301d90d1a7 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Lock "cinder-quobyte-d6e1a44b-21be-4c9b-9d9c-1732a3946df3" acquired by "delete_volume" :: waited 0.037s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:47:15 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[5da71140-e2cc-46b7-89e2-a347e006339b]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:47:15 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-2d073d17-4685-468c-86b9-d1301d90d1a7 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d6e1a44b-21be-4c9b-9d9c-1732a3946df3 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:47:15 devstack sudo[102067]: pam_unix(sudo:session): session closed for user root Sep 23 14:47:15 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-469c6cd5-0e38-431f-878b-7e3bb775c1a8 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.381s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:47:15 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-469c6cd5-0e38-431f-878b-7e3bb775c1a8 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:47:15 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-469c6cd5-0e38-431f-878b-7e3bb775c1a8 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Deleted volume successfully. Sep 23 14:47:15 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-469c6cd5-0e38-431f-878b-7e3bb775c1a8 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Lock "cinder-5b9c3aa4-8a78-46be-ad5a-ed5f3e55ffb0-delete_volume" released by "delete_volume" :: held 1.545s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:47:15 devstack sudo[102070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d6e1a44b-21be-4c9b-9d9c-1732a3946df3 Sep 23 14:47:15 devstack sudo[102070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:47:15 devstack sudo[102070]: pam_unix(sudo:session): session closed for user root Sep 23 14:47:15 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-2d073d17-4685-468c-86b9-d1301d90d1a7 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d6e1a44b-21be-4c9b-9d9c-1732a3946df3" returned: 0 in 0.480s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:47:15 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-2d073d17-4685-468c-86b9-d1301d90d1a7 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d6e1a44b-21be-4c9b-9d9c-1732a3946df3 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:47:15 devstack sudo[102075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d6e1a44b-21be-4c9b-9d9c-1732a3946df3 Sep 23 14:47:15 devstack sudo[102075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:47:15 devstack sudo[102075]: pam_unix(sudo:session): session closed for user root Sep 23 14:47:15 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-2d073d17-4685-468c-86b9-d1301d90d1a7 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d6e1a44b-21be-4c9b-9d9c-1732a3946df3" returned: 0 in 0.350s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:47:15 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-2d073d17-4685-468c-86b9-d1301d90d1a7 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Lock "cinder-quobyte-d6e1a44b-21be-4c9b-9d9c-1732a3946df3" released by "delete_volume" :: held 0.907s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:47:16 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-2d073d17-4685-468c-86b9-d1301d90d1a7 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Created reservations ['0c45da79-3c41-44e8-965c-668e4c3b4125', '0bc1ebd8-ca57-46f0-b620-83ba03789284', 'c501090f-b3ed-4524-a4df-4f0eb5f716be', '120d4df3-2e4d-4bb2-b629-dead61685170'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:47:16 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-2d073d17-4685-468c-86b9-d1301d90d1a7 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:47:16 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-2d073d17-4685-468c-86b9-d1301d90d1a7 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:47:16 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-2d073d17-4685-468c-86b9-d1301d90d1a7 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:47:16 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-2d073d17-4685-468c-86b9-d1301d90d1a7 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:47:16 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-2d073d17-4685-468c-86b9-d1301d90d1a7 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:47:16 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-2d073d17-4685-468c-86b9-d1301d90d1a7 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:47:16 devstack sudo[102079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:47:16 devstack sudo[102079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:47:16 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-110db08c-98b8-4e95-baff-2edefacd037a tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Acquiring lock "cinder-c1d2e3fe-1e86-4004-b989-b0a535deb50b-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:47:16 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-110db08c-98b8-4e95-baff-2edefacd037a tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Lock "cinder-c1d2e3fe-1e86-4004-b989-b0a535deb50b-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:47:16 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-110db08c-98b8-4e95-baff-2edefacd037a tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Acquiring lock "cinder-quobyte-c1d2e3fe-1e86-4004-b989-b0a535deb50b" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:47:16 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-110db08c-98b8-4e95-baff-2edefacd037a tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Lock "cinder-quobyte-c1d2e3fe-1e86-4004-b989-b0a535deb50b" acquired by "delete_volume" :: waited 0.028s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:47:16 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[6319335c-9605-4000-b0a2-0dead8354a84]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:47:16 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-110db08c-98b8-4e95-baff-2edefacd037a tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-c1d2e3fe-1e86-4004-b989-b0a535deb50b {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:47:16 devstack sudo[102079]: pam_unix(sudo:session): session closed for user root Sep 23 14:47:16 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-2d073d17-4685-468c-86b9-d1301d90d1a7 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.422s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:47:16 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-2d073d17-4685-468c-86b9-d1301d90d1a7 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:47:16 devstack sudo[102082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-c1d2e3fe-1e86-4004-b989-b0a535deb50b Sep 23 14:47:16 devstack sudo[102082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:47:16 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-2d073d17-4685-468c-86b9-d1301d90d1a7 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Deleted volume successfully. Sep 23 14:47:16 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-2d073d17-4685-468c-86b9-d1301d90d1a7 tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Lock "cinder-d6e1a44b-21be-4c9b-9d9c-1732a3946df3-delete_volume" released by "delete_volume" :: held 1.721s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:47:16 devstack sudo[102082]: pam_unix(sudo:session): session closed for user root Sep 23 14:47:16 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-110db08c-98b8-4e95-baff-2edefacd037a tempest-CreateVolumesFromSourceVolumeTest-935336848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-c1d2e3fe-1e86-4004-b989-b0a535deb50b" returned: 0 in 0.466s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:47:16 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-110db08c-98b8-4e95-baff-2edefacd037a tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-c1d2e3fe-1e86-4004-b989-b0a535deb50b {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:47:16 devstack sudo[102088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-c1d2e3fe-1e86-4004-b989-b0a535deb50b Sep 23 14:47:16 devstack sudo[102088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:47:17 devstack sudo[102088]: pam_unix(sudo:session): session closed for user root Sep 23 14:47:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-110db08c-98b8-4e95-baff-2edefacd037a tempest-CreateVolumesFromSourceVolumeTest-935336848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-c1d2e3fe-1e86-4004-b989-b0a535deb50b" returned: 0 in 0.292s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:47:17 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-110db08c-98b8-4e95-baff-2edefacd037a tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Lock "cinder-quobyte-c1d2e3fe-1e86-4004-b989-b0a535deb50b" released by "delete_volume" :: held 0.822s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:47:17 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-110db08c-98b8-4e95-baff-2edefacd037a tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Created reservations ['03c11709-df75-4083-9af0-3016a440dfa5', '0b3c8750-26e2-41ce-9caa-a23da7e3854d', '1d7cf384-e7e6-4cc4-aae1-106945440814', 'b4cb527f-f13a-4276-a5d6-3f353abecd66'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:47:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-110db08c-98b8-4e95-baff-2edefacd037a tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:47:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-110db08c-98b8-4e95-baff-2edefacd037a tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:47:17 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-110db08c-98b8-4e95-baff-2edefacd037a tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:47:17 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-110db08c-98b8-4e95-baff-2edefacd037a tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:47:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-110db08c-98b8-4e95-baff-2edefacd037a tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:47:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-110db08c-98b8-4e95-baff-2edefacd037a tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:47:17 devstack sudo[102091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:47:17 devstack sudo[102091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:47:17 devstack sudo[102091]: pam_unix(sudo:session): session closed for user root Sep 23 14:47:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-110db08c-98b8-4e95-baff-2edefacd037a tempest-CreateVolumesFromSourceVolumeTest-935336848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.296s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:47:17 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-110db08c-98b8-4e95-baff-2edefacd037a tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:47:17 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-110db08c-98b8-4e95-baff-2edefacd037a tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Deleted volume successfully. Sep 23 14:47:17 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-110db08c-98b8-4e95-baff-2edefacd037a tempest-CreateVolumesFromSourceVolumeTest-935336848 None] Lock "cinder-c1d2e3fe-1e86-4004-b989-b0a535deb50b-delete_volume" released by "delete_volume" :: held 1.421s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:47:20 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d6b6791-d62a-46c3-b127-6e6da054108f tempest-VolumeDependencyTests-2003615810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:47:20 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-0d6b6791-d62a-46c3-b127-6e6da054108f tempest-VolumeDependencyTests-2003615810 None] Flow 'volume_create_manager' (d2566e7e-3df4-4041-9c60-a125a0d301d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:47:20 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-0d6b6791-d62a-46c3-b127-6e6da054108f tempest-VolumeDependencyTests-2003615810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c627586-9217-4063-8425-1f1689d622b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:47:20 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-0d6b6791-d62a-46c3-b127-6e6da054108f tempest-VolumeDependencyTests-2003615810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c627586-9217-4063-8425-1f1689d622b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:47:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1396235582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06cb67dd-7ad8-46e5-bd16-6b831a5078b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5332a3bd99e24961b4813d545bad7aa4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:47:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:47:21Z,use_quota=True,user_id='e340fef3cefb4e269917e520cad2d48e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:47:20 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-0d6b6791-d62a-46c3-b127-6e6da054108f tempest-VolumeDependencyTests-2003615810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8822871-d57f-40a3-a9e2-7a5fa0f9e24c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:47:20 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-0d6b6791-d62a-46c3-b127-6e6da054108f tempest-VolumeDependencyTests-2003615810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8822871-d57f-40a3-a9e2-7a5fa0f9e24c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:47:20 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-0d6b6791-d62a-46c3-b127-6e6da054108f tempest-VolumeDependencyTests-2003615810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c19a8faa-62f4-4d4e-80ed-92764feb68bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:47:20 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-0d6b6791-d62a-46c3-b127-6e6da054108f tempest-VolumeDependencyTests-2003615810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c19a8faa-62f4-4d4e-80ed-92764feb68bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06cb67dd-7ad8-46e5-bd16-6b831a5078b2', 'volume_name': 'volume-06cb67dd-7ad8-46e5-bd16-6b831a5078b2', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:47:20 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-0d6b6791-d62a-46c3-b127-6e6da054108f tempest-VolumeDependencyTests-2003615810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b231770-0e7d-470a-be51-5baaa9223383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:47:20 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-0d6b6791-d62a-46c3-b127-6e6da054108f tempest-VolumeDependencyTests-2003615810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b231770-0e7d-470a-be51-5baaa9223383) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:47:20 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-0d6b6791-d62a-46c3-b127-6e6da054108f tempest-VolumeDependencyTests-2003615810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b67a5e35-9fc4-47ad-ae08-1b736a7fc458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:47:20 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-0d6b6791-d62a-46c3-b127-6e6da054108f tempest-VolumeDependencyTests-2003615810 None] Volume 06cb67dd-7ad8-46e5-bd16-6b831a5078b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06cb67dd-7ad8-46e5-bd16-6b831a5078b2', 'volume_size': 1} Sep 23 14:47:20 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-0d6b6791-d62a-46c3-b127-6e6da054108f tempest-VolumeDependencyTests-2003615810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:47:20 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-0d6b6791-d62a-46c3-b127-6e6da054108f tempest-VolumeDependencyTests-2003615810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:47:20 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-0d6b6791-d62a-46c3-b127-6e6da054108f tempest-VolumeDependencyTests-2003615810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:47:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1396235582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06cb67dd-7ad8-46e5-bd16-6b831a5078b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5332a3bd99e24961b4813d545bad7aa4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:47:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:47:21Z,use_quota=True,user_id='e340fef3cefb4e269917e520cad2d48e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:47:20 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-0d6b6791-d62a-46c3-b127-6e6da054108f tempest-VolumeDependencyTests-2003615810 None] Creating volume 06cb67dd-7ad8-46e5-bd16-6b831a5078b2 {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:47:20 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-0d6b6791-d62a-46c3-b127-6e6da054108f tempest-VolumeDependencyTests-2003615810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:47:20 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-0d6b6791-d62a-46c3-b127-6e6da054108f tempest-VolumeDependencyTests-2003615810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:47:20 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-0d6b6791-d62a-46c3-b127-6e6da054108f tempest-VolumeDependencyTests-2003615810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:47:20 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-0d6b6791-d62a-46c3-b127-6e6da054108f tempest-VolumeDependencyTests-2003615810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:47:20 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-0d6b6791-d62a-46c3-b127-6e6da054108f tempest-VolumeDependencyTests-2003615810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:47:20 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-0d6b6791-d62a-46c3-b127-6e6da054108f tempest-VolumeDependencyTests-2003615810 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:47:20 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-0d6b6791-d62a-46c3-b127-6e6da054108f tempest-VolumeDependencyTests-2003615810 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:47:20 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-0d6b6791-d62a-46c3-b127-6e6da054108f tempest-VolumeDependencyTests-2003615810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-06cb67dd-7ad8-46e5-bd16-6b831a5078b2 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:47:20 devstack sudo[102095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-06cb67dd-7ad8-46e5-bd16-6b831a5078b2 1073741824 Sep 23 14:47:20 devstack sudo[102095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:47:21 devstack sudo[102095]: pam_unix(sudo:session): session closed for user root Sep 23 14:47:21 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-0d6b6791-d62a-46c3-b127-6e6da054108f tempest-VolumeDependencyTests-2003615810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-06cb67dd-7ad8-46e5-bd16-6b831a5078b2 1073741824" returned: 0 in 0.429s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:47:21 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-0d6b6791-d62a-46c3-b127-6e6da054108f tempest-VolumeDependencyTests-2003615810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-06cb67dd-7ad8-46e5-bd16-6b831a5078b2 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:47:21 devstack sudo[102100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-06cb67dd-7ad8-46e5-bd16-6b831a5078b2 Sep 23 14:47:21 devstack sudo[102100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:47:21 devstack sudo[102100]: pam_unix(sudo:session): session closed for user root Sep 23 14:47:21 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-0d6b6791-d62a-46c3-b127-6e6da054108f tempest-VolumeDependencyTests-2003615810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-06cb67dd-7ad8-46e5-bd16-6b831a5078b2" returned: 0 in 0.261s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:47:21 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-0d6b6791-d62a-46c3-b127-6e6da054108f tempest-VolumeDependencyTests-2003615810 None] <== create_volume: return (752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:47:21 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-0d6b6791-d62a-46c3-b127-6e6da054108f tempest-VolumeDependencyTests-2003615810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.754s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:47:21 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-0d6b6791-d62a-46c3-b127-6e6da054108f tempest-VolumeDependencyTests-2003615810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b67a5e35-9fc4-47ad-ae08-1b736a7fc458) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06cb67dd-7ad8-46e5-bd16-6b831a5078b2', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:47:21 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-0d6b6791-d62a-46c3-b127-6e6da054108f tempest-VolumeDependencyTests-2003615810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0801a910-d618-427e-8515-e6af87a83cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:47:21 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-0d6b6791-d62a-46c3-b127-6e6da054108f tempest-VolumeDependencyTests-2003615810 None] Volume volume-06cb67dd-7ad8-46e5-bd16-6b831a5078b2 (06cb67dd-7ad8-46e5-bd16-6b831a5078b2): created successfully Sep 23 14:47:21 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-0d6b6791-d62a-46c3-b127-6e6da054108f tempest-VolumeDependencyTests-2003615810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0801a910-d618-427e-8515-e6af87a83cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:47:21 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-0d6b6791-d62a-46c3-b127-6e6da054108f tempest-VolumeDependencyTests-2003615810 None] Flow 'volume_create_manager' (d2566e7e-3df4-4041-9c60-a125a0d301d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:47:21 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-0d6b6791-d62a-46c3-b127-6e6da054108f tempest-VolumeDependencyTests-2003615810 None] Created volume successfully. Sep 23 14:47:21 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-38592181-4900-4d98-b6ca-f432035f0209 tempest-VolumeDependencyTests-2003615810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:47:21 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-38592181-4900-4d98-b6ca-f432035f0209 tempest-VolumeDependencyTests-2003615810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:47:21 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-38592181-4900-4d98-b6ca-f432035f0209 tempest-VolumeDependencyTests-2003615810 None] Creating offline snapshot 261eb9a7-ef18-4de2-b1e7-ea0adfbbab48 of volume 06cb67dd-7ad8-46e5-bd16-6b831a5078b2 {{(pid=86310) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 14:47:21 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[73e94ab4-8489-4629-ab2f-114e156a00ad]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:47:21 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-38592181-4900-4d98-b6ca-f432035f0209 tempest-VolumeDependencyTests-2003615810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-06cb67dd-7ad8-46e5-bd16-6b831a5078b2 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:47:22 devstack sudo[102103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-06cb67dd-7ad8-46e5-bd16-6b831a5078b2 Sep 23 14:47:22 devstack sudo[102103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:47:22 devstack sudo[102103]: pam_unix(sudo:session): session closed for user root Sep 23 14:47:22 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-38592181-4900-4d98-b6ca-f432035f0209 tempest-VolumeDependencyTests-2003615810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-06cb67dd-7ad8-46e5-bd16-6b831a5078b2" returned: 0 in 0.422s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:47:22 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-38592181-4900-4d98-b6ca-f432035f0209 tempest-VolumeDependencyTests-2003615810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-06cb67dd-7ad8-46e5-bd16-6b831a5078b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-06cb67dd-7ad8-46e5-bd16-6b831a5078b2.261eb9a7-ef18-4de2-b1e7-ea0adfbbab48 1G {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:47:22 devstack sudo[102108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-06cb67dd-7ad8-46e5-bd16-6b831a5078b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-06cb67dd-7ad8-46e5-bd16-6b831a5078b2.261eb9a7-ef18-4de2-b1e7-ea0adfbbab48 1G Sep 23 14:47:22 devstack sudo[102108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:47:22 devstack sudo[102108]: pam_unix(sudo:session): session closed for user root Sep 23 14:47:22 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-38592181-4900-4d98-b6ca-f432035f0209 tempest-VolumeDependencyTests-2003615810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-06cb67dd-7ad8-46e5-bd16-6b831a5078b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-06cb67dd-7ad8-46e5-bd16-6b831a5078b2.261eb9a7-ef18-4de2-b1e7-ea0adfbbab48 1G" returned: 0 in 0.430s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:47:22 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-38592181-4900-4d98-b6ca-f432035f0209 tempest-VolumeDependencyTests-2003615810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06cb67dd-7ad8-46e5-bd16-6b831a5078b2 -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-06cb67dd-7ad8-46e5-bd16-6b831a5078b2.261eb9a7-ef18-4de2-b1e7-ea0adfbbab48 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:47:22 devstack sudo[102114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06cb67dd-7ad8-46e5-bd16-6b831a5078b2 -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-06cb67dd-7ad8-46e5-bd16-6b831a5078b2.261eb9a7-ef18-4de2-b1e7-ea0adfbbab48 Sep 23 14:47:22 devstack sudo[102114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:47:23 devstack sudo[102114]: pam_unix(sudo:session): session closed for user root Sep 23 14:47:23 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-38592181-4900-4d98-b6ca-f432035f0209 tempest-VolumeDependencyTests-2003615810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06cb67dd-7ad8-46e5-bd16-6b831a5078b2 -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-06cb67dd-7ad8-46e5-bd16-6b831a5078b2.261eb9a7-ef18-4de2-b1e7-ea0adfbbab48" returned: 0 in 0.308s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:47:23 devstack cinder-volume[86310]: WARNING cinder.volume.drivers.remotefs [None req-38592181-4900-4d98-b6ca-f432035f0209 tempest-VolumeDependencyTests-2003615810 None] /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-06cb67dd-7ad8-46e5-bd16-6b831a5078b2.261eb9a7-ef18-4de2-b1e7-ea0adfbbab48 is being set with open permissions: ugo+rw Sep 23 14:47:23 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-38592181-4900-4d98-b6ca-f432035f0209 tempest-VolumeDependencyTests-2003615810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-06cb67dd-7ad8-46e5-bd16-6b831a5078b2.261eb9a7-ef18-4de2-b1e7-ea0adfbbab48 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:47:23 devstack sudo[102119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-06cb67dd-7ad8-46e5-bd16-6b831a5078b2.261eb9a7-ef18-4de2-b1e7-ea0adfbbab48 Sep 23 14:47:23 devstack sudo[102119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:47:23 devstack sudo[102119]: pam_unix(sudo:session): session closed for user root Sep 23 14:47:23 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-38592181-4900-4d98-b6ca-f432035f0209 tempest-VolumeDependencyTests-2003615810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-06cb67dd-7ad8-46e5-bd16-6b831a5078b2.261eb9a7-ef18-4de2-b1e7-ea0adfbbab48" returned: 0 in 0.261s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:47:23 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-38592181-4900-4d98-b6ca-f432035f0209 tempest-VolumeDependencyTests-2003615810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-06cb67dd-7ad8-46e5-bd16-6b831a5078b2.info {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:47:23 devstack sudo[102122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-06cb67dd-7ad8-46e5-bd16-6b831a5078b2.info Sep 23 14:47:23 devstack sudo[102122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:47:23 devstack sudo[102122]: pam_unix(sudo:session): session closed for user root Sep 23 14:47:23 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-38592181-4900-4d98-b6ca-f432035f0209 tempest-VolumeDependencyTests-2003615810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-06cb67dd-7ad8-46e5-bd16-6b831a5078b2.info" returned: 0 in 0.272s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:47:23 devstack cinder-volume[86310]: WARNING cinder.volume.drivers.remotefs [None req-38592181-4900-4d98-b6ca-f432035f0209 tempest-VolumeDependencyTests-2003615810 None] /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-06cb67dd-7ad8-46e5-bd16-6b831a5078b2.info is being set with open permissions: ugo+rw Sep 23 14:47:23 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-38592181-4900-4d98-b6ca-f432035f0209 tempest-VolumeDependencyTests-2003615810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-06cb67dd-7ad8-46e5-bd16-6b831a5078b2.info {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:47:23 devstack sudo[102125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-06cb67dd-7ad8-46e5-bd16-6b831a5078b2.info Sep 23 14:47:23 devstack sudo[102125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:47:23 devstack sudo[102125]: pam_unix(sudo:session): session closed for user root Sep 23 14:47:23 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-38592181-4900-4d98-b6ca-f432035f0209 tempest-VolumeDependencyTests-2003615810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-06cb67dd-7ad8-46e5-bd16-6b831a5078b2.info" returned: 0 in 0.259s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:47:23 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-38592181-4900-4d98-b6ca-f432035f0209 tempest-VolumeDependencyTests-2003615810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.080s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:47:23 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-38592181-4900-4d98-b6ca-f432035f0209 tempest-VolumeDependencyTests-2003615810 None] Create snapshot completed successfully Sep 23 14:47:25 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-439426cd-c99c-450e-9d88-6d9b421955de tempest-VolumeDependencyTests-2003615810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:47:25 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-439426cd-c99c-450e-9d88-6d9b421955de tempest-VolumeDependencyTests-2003615810 None] Flow 'volume_create_manager' (be65238c-854a-4048-8129-434598128d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:47:25 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-439426cd-c99c-450e-9d88-6d9b421955de tempest-VolumeDependencyTests-2003615810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2ff5424-6e3f-451e-a36e-6b006d1bc606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:47:25 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-439426cd-c99c-450e-9d88-6d9b421955de tempest-VolumeDependencyTests-2003615810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2ff5424-6e3f-451e-a36e-6b006d1bc606) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:47:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1341686711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea0e006f-6d94-4f5c-89a9-523a9bb07974,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5332a3bd99e24961b4813d545bad7aa4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:47:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=261eb9a7-ef18-4de2-b1e7-ea0adfbbab48,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:47:26Z,use_quota=True,user_id='e340fef3cefb4e269917e520cad2d48e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:47:25 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-439426cd-c99c-450e-9d88-6d9b421955de tempest-VolumeDependencyTests-2003615810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f8c41ed-1b8f-4c87-86c8-1cb53624691e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:47:25 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-439426cd-c99c-450e-9d88-6d9b421955de tempest-VolumeDependencyTests-2003615810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f8c41ed-1b8f-4c87-86c8-1cb53624691e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:47:25 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-439426cd-c99c-450e-9d88-6d9b421955de tempest-VolumeDependencyTests-2003615810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6db5b70-fe99-4f50-8c56-27fabd2fc499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:47:25 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-439426cd-c99c-450e-9d88-6d9b421955de tempest-VolumeDependencyTests-2003615810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6db5b70-fe99-4f50-8c56-27fabd2fc499) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ea0e006f-6d94-4f5c-89a9-523a9bb07974', 'volume_name': 'volume-ea0e006f-6d94-4f5c-89a9-523a9bb07974', 'volume_size': 1, 'snapshot_id': '261eb9a7-ef18-4de2-b1e7-ea0adfbbab48'}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:47:25 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-439426cd-c99c-450e-9d88-6d9b421955de tempest-VolumeDependencyTests-2003615810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79dc19a8-dbef-4e5b-9410-e80a4779a688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:47:25 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-439426cd-c99c-450e-9d88-6d9b421955de tempest-VolumeDependencyTests-2003615810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79dc19a8-dbef-4e5b-9410-e80a4779a688) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:47:25 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-439426cd-c99c-450e-9d88-6d9b421955de tempest-VolumeDependencyTests-2003615810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bdf6187-61c9-4a87-9dc0-01d9dff9e736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:47:25 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-439426cd-c99c-450e-9d88-6d9b421955de tempest-VolumeDependencyTests-2003615810 None] Volume ea0e006f-6d94-4f5c-89a9-523a9bb07974: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ea0e006f-6d94-4f5c-89a9-523a9bb07974', 'volume_size': 1, 'snapshot_id': '261eb9a7-ef18-4de2-b1e7-ea0adfbbab48'} Sep 23 14:47:25 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-439426cd-c99c-450e-9d88-6d9b421955de tempest-VolumeDependencyTests-2003615810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:47:25 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-439426cd-c99c-450e-9d88-6d9b421955de tempest-VolumeDependencyTests-2003615810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:47:25 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-439426cd-c99c-450e-9d88-6d9b421955de tempest-VolumeDependencyTests-2003615810 None] Acquiring lock "cinder-quobyte-261eb9a7-ef18-4de2-b1e7-ea0adfbbab48-ea0e006f-6d94-4f5c-89a9-523a9bb07974" by "_create_volume_from_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:47:25 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-439426cd-c99c-450e-9d88-6d9b421955de tempest-VolumeDependencyTests-2003615810 None] Lock "cinder-quobyte-261eb9a7-ef18-4de2-b1e7-ea0adfbbab48-ea0e006f-6d94-4f5c-89a9-523a9bb07974" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:47:25 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-439426cd-c99c-450e-9d88-6d9b421955de tempest-VolumeDependencyTests-2003615810 None] Creating volume ea0e006f-6d94-4f5c-89a9-523a9bb07974 from snapshot 261eb9a7-ef18-4de2-b1e7-ea0adfbbab48 {{(pid=86310) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 23 14:47:25 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-439426cd-c99c-450e-9d88-6d9b421955de tempest-VolumeDependencyTests-2003615810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:47:25 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-439426cd-c99c-450e-9d88-6d9b421955de tempest-VolumeDependencyTests-2003615810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:47:25 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-439426cd-c99c-450e-9d88-6d9b421955de tempest-VolumeDependencyTests-2003615810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:47:25 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-439426cd-c99c-450e-9d88-6d9b421955de tempest-VolumeDependencyTests-2003615810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:47:25 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-439426cd-c99c-450e-9d88-6d9b421955de tempest-VolumeDependencyTests-2003615810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:47:25 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-439426cd-c99c-450e-9d88-6d9b421955de tempest-VolumeDependencyTests-2003615810 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:47:25 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-439426cd-c99c-450e-9d88-6d9b421955de tempest-VolumeDependencyTests-2003615810 None] Acquiring lock "cinder-quobyte-ea0e006f-6d94-4f5c-89a9-523a9bb07974" by "_copy_volume_from_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:47:25 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-439426cd-c99c-450e-9d88-6d9b421955de tempest-VolumeDependencyTests-2003615810 None] Lock "cinder-quobyte-ea0e006f-6d94-4f5c-89a9-523a9bb07974" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:47:25 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-439426cd-c99c-450e-9d88-6d9b421955de tempest-VolumeDependencyTests-2003615810 None] snapshot: 261eb9a7-ef18-4de2-b1e7-ea0adfbbab48, volume: ea0e006f-6d94-4f5c-89a9-523a9bb07974, {{(pid=86310) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 23 14:47:25 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-439426cd-c99c-450e-9d88-6d9b421955de tempest-VolumeDependencyTests-2003615810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:47:25 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-439426cd-c99c-450e-9d88-6d9b421955de tempest-VolumeDependencyTests-2003615810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:47:25 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-439426cd-c99c-450e-9d88-6d9b421955de tempest-VolumeDependencyTests-2003615810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:47:25 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-439426cd-c99c-450e-9d88-6d9b421955de tempest-VolumeDependencyTests-2003615810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:47:25 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-439426cd-c99c-450e-9d88-6d9b421955de tempest-VolumeDependencyTests-2003615810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:47:25 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[a809f7c2-7966-4017-808b-81df9d8a7ce3]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:47:25 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-439426cd-c99c-450e-9d88-6d9b421955de tempest-VolumeDependencyTests-2003615810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-06cb67dd-7ad8-46e5-bd16-6b831a5078b2.261eb9a7-ef18-4de2-b1e7-ea0adfbbab48 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:47:25 devstack sudo[102128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-06cb67dd-7ad8-46e5-bd16-6b831a5078b2.261eb9a7-ef18-4de2-b1e7-ea0adfbbab48 Sep 23 14:47:25 devstack sudo[102128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:47:26 devstack sudo[102128]: pam_unix(sudo:session): session closed for user root Sep 23 14:47:26 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-439426cd-c99c-450e-9d88-6d9b421955de tempest-VolumeDependencyTests-2003615810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-06cb67dd-7ad8-46e5-bd16-6b831a5078b2.261eb9a7-ef18-4de2-b1e7-ea0adfbbab48" returned: 0 in 0.368s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:47:26 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-439426cd-c99c-450e-9d88-6d9b421955de tempest-VolumeDependencyTests-2003615810 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-06cb67dd-7ad8-46e5-bd16-6b831a5078b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 14:47:26 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[d531652f-aabf-464b-b2e8-158e79091fed]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:47:26 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-439426cd-c99c-450e-9d88-6d9b421955de tempest-VolumeDependencyTests-2003615810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-06cb67dd-7ad8-46e5-bd16-6b831a5078b2 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:47:26 devstack sudo[102133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-06cb67dd-7ad8-46e5-bd16-6b831a5078b2 Sep 23 14:47:26 devstack sudo[102133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:47:26 devstack sudo[102133]: pam_unix(sudo:session): session closed for user root Sep 23 14:47:26 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-439426cd-c99c-450e-9d88-6d9b421955de tempest-VolumeDependencyTests-2003615810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-06cb67dd-7ad8-46e5-bd16-6b831a5078b2" returned: 0 in 0.433s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:47:26 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-439426cd-c99c-450e-9d88-6d9b421955de tempest-VolumeDependencyTests-2003615810 None] will copy from snapshot at /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-06cb67dd-7ad8-46e5-bd16-6b831a5078b2 {{(pid=86310) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 23 14:47:26 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-439426cd-c99c-450e-9d88-6d9b421955de tempest-VolumeDependencyTests-2003615810 None] Creating direct copy from snapshot {{(pid=86310) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 23 14:47:26 devstack cinder-volume[86310]: DEBUG cinder.utils [None req-439426cd-c99c-450e-9d88-6d9b421955de tempest-VolumeDependencyTests-2003615810 None] Path /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-ea0e006f-6d94-4f5c-89a9-523a9bb07974 not found in is_blk_device check {{(pid=86310) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 23 14:47:26 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-439426cd-c99c-450e-9d88-6d9b421955de tempest-VolumeDependencyTests-2003615810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-06cb67dd-7ad8-46e5-bd16-6b831a5078b2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-ea0e006f-6d94-4f5c-89a9-523a9bb07974 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:47:26 devstack sudo[102172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-06cb67dd-7ad8-46e5-bd16-6b831a5078b2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-ea0e006f-6d94-4f5c-89a9-523a9bb07974 Sep 23 14:47:26 devstack sudo[102172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:47:33 devstack sudo[102172]: pam_unix(sudo:session): session closed for user root Sep 23 14:47:33 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-439426cd-c99c-450e-9d88-6d9b421955de tempest-VolumeDependencyTests-2003615810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-06cb67dd-7ad8-46e5-bd16-6b831a5078b2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-ea0e006f-6d94-4f5c-89a9-523a9bb07974" returned: 0 in 6.718s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:47:33 devstack cinder-volume[86310]: DEBUG cinder.image.image_utils [None req-439426cd-c99c-450e-9d88-6d9b421955de tempest-VolumeDependencyTests-2003615810 None] Image conversion details: src /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-06cb67dd-7ad8-46e5-bd16-6b831a5078b2, size 1024.00 MB, duration 6.72 sec, destination /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-ea0e006f-6d94-4f5c-89a9-523a9bb07974 {{(pid=86310) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 14:47:33 devstack cinder-volume[86310]: INFO cinder.image.image_utils [None req-439426cd-c99c-450e-9d88-6d9b421955de tempest-VolumeDependencyTests-2003615810 None] Converted 1024.00 MB image at 152.40 MB/s Sep 23 14:47:33 devstack cinder-volume[86310]: WARNING cinder.volume.drivers.remotefs [None req-439426cd-c99c-450e-9d88-6d9b421955de tempest-VolumeDependencyTests-2003615810 None] /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-ea0e006f-6d94-4f5c-89a9-523a9bb07974 is being set with open permissions: ugo+rw Sep 23 14:47:33 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-439426cd-c99c-450e-9d88-6d9b421955de tempest-VolumeDependencyTests-2003615810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-ea0e006f-6d94-4f5c-89a9-523a9bb07974 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:47:33 devstack sudo[102227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-ea0e006f-6d94-4f5c-89a9-523a9bb07974 Sep 23 14:47:33 devstack sudo[102227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:47:33 devstack sudo[102227]: pam_unix(sudo:session): session closed for user root Sep 23 14:47:33 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-439426cd-c99c-450e-9d88-6d9b421955de tempest-VolumeDependencyTests-2003615810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-ea0e006f-6d94-4f5c-89a9-523a9bb07974" returned: 0 in 0.292s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:47:33 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-439426cd-c99c-450e-9d88-6d9b421955de tempest-VolumeDependencyTests-2003615810 None] Lock "cinder-quobyte-ea0e006f-6d94-4f5c-89a9-523a9bb07974" released by "_copy_volume_from_snapshot" :: held 7.895s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:47:33 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-439426cd-c99c-450e-9d88-6d9b421955de tempest-VolumeDependencyTests-2003615810 None] Lock "cinder-quobyte-261eb9a7-ef18-4de2-b1e7-ea0adfbbab48-ea0e006f-6d94-4f5c-89a9-523a9bb07974" released by "_create_volume_from_snapshot" :: held 7.960s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:47:33 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-439426cd-c99c-450e-9d88-6d9b421955de tempest-VolumeDependencyTests-2003615810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.978s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:47:33 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-439426cd-c99c-450e-9d88-6d9b421955de tempest-VolumeDependencyTests-2003615810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bdf6187-61c9-4a87-9dc0-01d9dff9e736) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea0e006f-6d94-4f5c-89a9-523a9bb07974', 'volume_size': 1, 'snapshot_id': '261eb9a7-ef18-4de2-b1e7-ea0adfbbab48'}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:47:33 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-439426cd-c99c-450e-9d88-6d9b421955de tempest-VolumeDependencyTests-2003615810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e54140d5-137d-4c9e-83b1-62ad731587db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:47:33 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-439426cd-c99c-450e-9d88-6d9b421955de tempest-VolumeDependencyTests-2003615810 None] Volume volume-ea0e006f-6d94-4f5c-89a9-523a9bb07974 (ea0e006f-6d94-4f5c-89a9-523a9bb07974): created successfully Sep 23 14:47:33 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-439426cd-c99c-450e-9d88-6d9b421955de tempest-VolumeDependencyTests-2003615810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e54140d5-137d-4c9e-83b1-62ad731587db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:47:33 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-439426cd-c99c-450e-9d88-6d9b421955de tempest-VolumeDependencyTests-2003615810 None] Flow 'volume_create_manager' (be65238c-854a-4048-8129-434598128d43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:47:33 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-439426cd-c99c-450e-9d88-6d9b421955de tempest-VolumeDependencyTests-2003615810 None] Created volume successfully. Sep 23 14:47:34 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-b638605a-f8a7-4b8c-bfc1-ab13bdaf3d78 tempest-VolumeDependencyTests-2003615810 None] Acquiring lock "cinder-261eb9a7-ef18-4de2-b1e7-ea0adfbbab48-delete_snapshot" by "delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:47:34 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-b638605a-f8a7-4b8c-bfc1-ab13bdaf3d78 tempest-VolumeDependencyTests-2003615810 None] Lock "cinder-261eb9a7-ef18-4de2-b1e7-ea0adfbbab48-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:47:34 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-b638605a-f8a7-4b8c-bfc1-ab13bdaf3d78 tempest-VolumeDependencyTests-2003615810 None] Acquiring lock "cinder-quobyte-06cb67dd-7ad8-46e5-bd16-6b831a5078b2" by "delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:47:34 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-b638605a-f8a7-4b8c-bfc1-ab13bdaf3d78 tempest-VolumeDependencyTests-2003615810 None] Lock "cinder-quobyte-06cb67dd-7ad8-46e5-bd16-6b831a5078b2" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:47:34 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-b638605a-f8a7-4b8c-bfc1-ab13bdaf3d78 tempest-VolumeDependencyTests-2003615810 None] Acquiring lock "cinder-quobyte-261eb9a7-ef18-4de2-b1e7-ea0adfbbab48" by "_delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:47:34 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-b638605a-f8a7-4b8c-bfc1-ab13bdaf3d78 tempest-VolumeDependencyTests-2003615810 None] Lock "cinder-quobyte-261eb9a7-ef18-4de2-b1e7-ea0adfbbab48" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:47:34 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-b638605a-f8a7-4b8c-bfc1-ab13bdaf3d78 tempest-VolumeDependencyTests-2003615810 None] Deleting offline snapshot 261eb9a7-ef18-4de2-b1e7-ea0adfbbab48 of volume 06cb67dd-7ad8-46e5-bd16-6b831a5078b2 {{(pid=86310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 14:47:34 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-b638605a-f8a7-4b8c-bfc1-ab13bdaf3d78 tempest-VolumeDependencyTests-2003615810 None] snapshot_file for this snap is: volume-06cb67dd-7ad8-46e5-bd16-6b831a5078b2.261eb9a7-ef18-4de2-b1e7-ea0adfbbab48 {{(pid=86310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 14:47:34 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6b131f1-e97b-4a83-8a92-8d8b48e7f6ab]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:47:34 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-b638605a-f8a7-4b8c-bfc1-ab13bdaf3d78 tempest-VolumeDependencyTests-2003615810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-06cb67dd-7ad8-46e5-bd16-6b831a5078b2.261eb9a7-ef18-4de2-b1e7-ea0adfbbab48 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:47:34 devstack sudo[102236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-06cb67dd-7ad8-46e5-bd16-6b831a5078b2.261eb9a7-ef18-4de2-b1e7-ea0adfbbab48 Sep 23 14:47:34 devstack sudo[102236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:47:35 devstack sudo[102236]: pam_unix(sudo:session): session closed for user root Sep 23 14:47:35 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-b638605a-f8a7-4b8c-bfc1-ab13bdaf3d78 tempest-VolumeDependencyTests-2003615810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-06cb67dd-7ad8-46e5-bd16-6b831a5078b2.261eb9a7-ef18-4de2-b1e7-ea0adfbbab48" returned: 0 in 0.378s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:47:35 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-b638605a-f8a7-4b8c-bfc1-ab13bdaf3d78 tempest-VolumeDependencyTests-2003615810 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-06cb67dd-7ad8-46e5-bd16-6b831a5078b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 14:47:35 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[43b0ede6-aee9-4842-87dc-49f43a9b3243]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:47:35 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-b638605a-f8a7-4b8c-bfc1-ab13bdaf3d78 tempest-VolumeDependencyTests-2003615810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-06cb67dd-7ad8-46e5-bd16-6b831a5078b2 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:47:35 devstack sudo[102241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-06cb67dd-7ad8-46e5-bd16-6b831a5078b2 Sep 23 14:47:35 devstack sudo[102241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:47:35 devstack sudo[102241]: pam_unix(sudo:session): session closed for user root Sep 23 14:47:35 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-b638605a-f8a7-4b8c-bfc1-ab13bdaf3d78 tempest-VolumeDependencyTests-2003615810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-06cb67dd-7ad8-46e5-bd16-6b831a5078b2" returned: 0 in 0.571s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:47:35 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-b638605a-f8a7-4b8c-bfc1-ab13bdaf3d78 tempest-VolumeDependencyTests-2003615810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-06cb67dd-7ad8-46e5-bd16-6b831a5078b2.261eb9a7-ef18-4de2-b1e7-ea0adfbbab48 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:47:35 devstack sudo[102246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-06cb67dd-7ad8-46e5-bd16-6b831a5078b2.261eb9a7-ef18-4de2-b1e7-ea0adfbbab48 Sep 23 14:47:35 devstack sudo[102246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:47:35 devstack sudo[102246]: pam_unix(sudo:session): session closed for user root Sep 23 14:47:35 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-b638605a-f8a7-4b8c-bfc1-ab13bdaf3d78 tempest-VolumeDependencyTests-2003615810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-06cb67dd-7ad8-46e5-bd16-6b831a5078b2.261eb9a7-ef18-4de2-b1e7-ea0adfbbab48" returned: 0 in 0.333s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:47:35 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-b638605a-f8a7-4b8c-bfc1-ab13bdaf3d78 tempest-VolumeDependencyTests-2003615810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-06cb67dd-7ad8-46e5-bd16-6b831a5078b2.261eb9a7-ef18-4de2-b1e7-ea0adfbbab48 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:47:35 devstack sudo[102251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-06cb67dd-7ad8-46e5-bd16-6b831a5078b2.261eb9a7-ef18-4de2-b1e7-ea0adfbbab48 Sep 23 14:47:35 devstack sudo[102251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:47:36 devstack sudo[102251]: pam_unix(sudo:session): session closed for user root Sep 23 14:47:36 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-b638605a-f8a7-4b8c-bfc1-ab13bdaf3d78 tempest-VolumeDependencyTests-2003615810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-06cb67dd-7ad8-46e5-bd16-6b831a5078b2.261eb9a7-ef18-4de2-b1e7-ea0adfbbab48" returned: 0 in 0.239s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:47:36 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-b638605a-f8a7-4b8c-bfc1-ab13bdaf3d78 tempest-VolumeDependencyTests-2003615810 None] Lock "cinder-quobyte-261eb9a7-ef18-4de2-b1e7-ea0adfbbab48" released by "_delete_snapshot" :: held 1.636s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:47:36 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-b638605a-f8a7-4b8c-bfc1-ab13bdaf3d78 tempest-VolumeDependencyTests-2003615810 None] Lock "cinder-quobyte-06cb67dd-7ad8-46e5-bd16-6b831a5078b2" released by "delete_snapshot" :: held 1.657s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:47:36 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-b638605a-f8a7-4b8c-bfc1-ab13bdaf3d78 tempest-VolumeDependencyTests-2003615810 None] Created reservations ['d9bf7cd7-d6a2-4972-a856-7cd4edb410aa', '11a1ec5f-8ba4-49dc-b2b6-0047a04e60e6', 'cba3032e-13f8-4966-8b37-d0aa7a5f31d6', '46dc43c5-1264-4d63-bb0c-f9b74dea0546'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:47:36 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-b638605a-f8a7-4b8c-bfc1-ab13bdaf3d78 tempest-VolumeDependencyTests-2003615810 None] Delete snapshot completed successfully. Sep 23 14:47:36 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-b638605a-f8a7-4b8c-bfc1-ab13bdaf3d78 tempest-VolumeDependencyTests-2003615810 None] Lock "cinder-261eb9a7-ef18-4de2-b1e7-ea0adfbbab48-delete_snapshot" released by "delete_snapshot" :: held 1.825s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:47:37 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-d046b41a-8300-432b-8b87-5bc43cbe4c30 tempest-VolumeDependencyTests-2003615810 None] Acquiring lock "cinder-06cb67dd-7ad8-46e5-bd16-6b831a5078b2-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:47:37 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-d046b41a-8300-432b-8b87-5bc43cbe4c30 tempest-VolumeDependencyTests-2003615810 None] Lock "cinder-06cb67dd-7ad8-46e5-bd16-6b831a5078b2-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:47:37 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-d046b41a-8300-432b-8b87-5bc43cbe4c30 tempest-VolumeDependencyTests-2003615810 None] Acquiring lock "cinder-quobyte-06cb67dd-7ad8-46e5-bd16-6b831a5078b2" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:47:37 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-d046b41a-8300-432b-8b87-5bc43cbe4c30 tempest-VolumeDependencyTests-2003615810 None] Lock "cinder-quobyte-06cb67dd-7ad8-46e5-bd16-6b831a5078b2" acquired by "delete_volume" :: waited 0.021s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:47:37 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee2a883-4bfe-4d32-8b3c-9452fb5d3a9b]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:47:37 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d046b41a-8300-432b-8b87-5bc43cbe4c30 tempest-VolumeDependencyTests-2003615810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-06cb67dd-7ad8-46e5-bd16-6b831a5078b2 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:47:37 devstack sudo[102255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-06cb67dd-7ad8-46e5-bd16-6b831a5078b2 Sep 23 14:47:37 devstack sudo[102255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:47:37 devstack sudo[102255]: pam_unix(sudo:session): session closed for user root Sep 23 14:47:37 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d046b41a-8300-432b-8b87-5bc43cbe4c30 tempest-VolumeDependencyTests-2003615810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-06cb67dd-7ad8-46e5-bd16-6b831a5078b2" returned: 0 in 0.411s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:47:37 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d046b41a-8300-432b-8b87-5bc43cbe4c30 tempest-VolumeDependencyTests-2003615810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-06cb67dd-7ad8-46e5-bd16-6b831a5078b2 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:47:37 devstack sudo[102269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-06cb67dd-7ad8-46e5-bd16-6b831a5078b2 Sep 23 14:47:37 devstack sudo[102269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:47:37 devstack sudo[102269]: pam_unix(sudo:session): session closed for user root Sep 23 14:47:37 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d046b41a-8300-432b-8b87-5bc43cbe4c30 tempest-VolumeDependencyTests-2003615810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-06cb67dd-7ad8-46e5-bd16-6b831a5078b2" returned: 0 in 0.276s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:47:37 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-d046b41a-8300-432b-8b87-5bc43cbe4c30 tempest-VolumeDependencyTests-2003615810 None] Lock "cinder-quobyte-06cb67dd-7ad8-46e5-bd16-6b831a5078b2" released by "delete_volume" :: held 0.781s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:47:37 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-d046b41a-8300-432b-8b87-5bc43cbe4c30 tempest-VolumeDependencyTests-2003615810 None] Created reservations ['062129a1-800b-470f-9dda-708035790515', '9071a395-343c-41b9-bef4-78390da12578', 'cd683e59-3db3-480e-b2ac-49eb84d4a19d', '26cb23a6-3e04-4b3d-8abc-3b71aae9b4a6'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:47:38 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-d046b41a-8300-432b-8b87-5bc43cbe4c30 tempest-VolumeDependencyTests-2003615810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:47:38 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-d046b41a-8300-432b-8b87-5bc43cbe4c30 tempest-VolumeDependencyTests-2003615810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:47:38 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-d046b41a-8300-432b-8b87-5bc43cbe4c30 tempest-VolumeDependencyTests-2003615810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:47:38 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-d046b41a-8300-432b-8b87-5bc43cbe4c30 tempest-VolumeDependencyTests-2003615810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:47:38 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-d046b41a-8300-432b-8b87-5bc43cbe4c30 tempest-VolumeDependencyTests-2003615810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:47:38 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d046b41a-8300-432b-8b87-5bc43cbe4c30 tempest-VolumeDependencyTests-2003615810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:47:38 devstack sudo[102286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:47:38 devstack sudo[102286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:47:38 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-f6b2a0a8-dc1e-4052-9139-b992786351bd tempest-VolumeDependencyTests-2003615810 None] Acquiring lock "cinder-ea0e006f-6d94-4f5c-89a9-523a9bb07974-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:47:38 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-f6b2a0a8-dc1e-4052-9139-b992786351bd tempest-VolumeDependencyTests-2003615810 None] Lock "cinder-ea0e006f-6d94-4f5c-89a9-523a9bb07974-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:47:38 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-f6b2a0a8-dc1e-4052-9139-b992786351bd tempest-VolumeDependencyTests-2003615810 None] Acquiring lock "cinder-quobyte-ea0e006f-6d94-4f5c-89a9-523a9bb07974" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:47:38 devstack sudo[102286]: pam_unix(sudo:session): session closed for user root Sep 23 14:47:38 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d046b41a-8300-432b-8b87-5bc43cbe4c30 tempest-VolumeDependencyTests-2003615810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.405s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:47:38 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-d046b41a-8300-432b-8b87-5bc43cbe4c30 tempest-VolumeDependencyTests-2003615810 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:47:38 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-f6b2a0a8-dc1e-4052-9139-b992786351bd tempest-VolumeDependencyTests-2003615810 None] Lock "cinder-quobyte-ea0e006f-6d94-4f5c-89a9-523a9bb07974" acquired by "delete_volume" :: waited 0.033s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:47:38 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-d046b41a-8300-432b-8b87-5bc43cbe4c30 tempest-VolumeDependencyTests-2003615810 None] Deleted volume successfully. Sep 23 14:47:38 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c659f25-739c-4ed6-bda1-41c12f74766b]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:47:38 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-f6b2a0a8-dc1e-4052-9139-b992786351bd tempest-VolumeDependencyTests-2003615810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-ea0e006f-6d94-4f5c-89a9-523a9bb07974 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:47:38 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-d046b41a-8300-432b-8b87-5bc43cbe4c30 tempest-VolumeDependencyTests-2003615810 None] Lock "cinder-06cb67dd-7ad8-46e5-bd16-6b831a5078b2-delete_volume" released by "delete_volume" :: held 1.523s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:47:38 devstack sudo[102292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-ea0e006f-6d94-4f5c-89a9-523a9bb07974 Sep 23 14:47:38 devstack sudo[102292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:47:38 devstack sudo[102292]: pam_unix(sudo:session): session closed for user root Sep 23 14:47:38 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-f6b2a0a8-dc1e-4052-9139-b992786351bd tempest-VolumeDependencyTests-2003615810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-ea0e006f-6d94-4f5c-89a9-523a9bb07974" returned: 0 in 0.448s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:47:38 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-f6b2a0a8-dc1e-4052-9139-b992786351bd tempest-VolumeDependencyTests-2003615810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-ea0e006f-6d94-4f5c-89a9-523a9bb07974 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:47:39 devstack sudo[102305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-ea0e006f-6d94-4f5c-89a9-523a9bb07974 Sep 23 14:47:39 devstack sudo[102305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:47:39 devstack cinder-volume[86310]: DEBUG dbcounter [-] [86310] Writing DB stats cinder:SELECT=87,cinder:INSERT=26,cinder:UPDATE=92,cinder:DELETE=8 {{(pid=86310) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 14:47:39 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [req-19793c18-fc26-4453-8b5f-15c7192986f0 req-469600ba-efc0-429b-9969-3da52504d816 tempest-TestStampPattern-1114451325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:47:39 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [req-19793c18-fc26-4453-8b5f-15c7192986f0 req-469600ba-efc0-429b-9969-3da52504d816 tempest-TestStampPattern-1114451325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:47:39 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [req-19793c18-fc26-4453-8b5f-15c7192986f0 req-469600ba-efc0-429b-9969-3da52504d816 tempest-TestStampPattern-1114451325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:47:39 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [req-19793c18-fc26-4453-8b5f-15c7192986f0 req-469600ba-efc0-429b-9969-3da52504d816 tempest-TestStampPattern-1114451325 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362', 'name': 'volume-08d52c32-414d-4c62-abd9-4f6b1ac3119f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cc19412e-3f60-4cb9-9238-a059d1b549c5', 'enforce_multipath': True} {{(pid=86310) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 14:47:39 devstack cinder-volume[86310]: INFO cinder.volume.manager [req-19793c18-fc26-4453-8b5f-15c7192986f0 req-469600ba-efc0-429b-9969-3da52504d816 tempest-TestStampPattern-1114451325 None] attachment_update completed successfully. Sep 23 14:47:39 devstack sudo[102305]: pam_unix(sudo:session): session closed for user root Sep 23 14:47:39 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-f6b2a0a8-dc1e-4052-9139-b992786351bd tempest-VolumeDependencyTests-2003615810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-ea0e006f-6d94-4f5c-89a9-523a9bb07974" returned: 0 in 0.268s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:47:39 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-f6b2a0a8-dc1e-4052-9139-b992786351bd tempest-VolumeDependencyTests-2003615810 None] Lock "cinder-quobyte-ea0e006f-6d94-4f5c-89a9-523a9bb07974" released by "delete_volume" :: held 0.773s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:47:39 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-f6b2a0a8-dc1e-4052-9139-b992786351bd tempest-VolumeDependencyTests-2003615810 None] Created reservations ['f39a117b-75f1-4030-b226-1cf9def14f43', 'bf74bdfa-1934-4fd8-ae2d-8c1c14d47ab5', '41b73460-1713-4af9-9750-a1185ff529be', '60f0acd6-d712-4e19-95d1-db8ccb5b379d'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:47:39 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-f6b2a0a8-dc1e-4052-9139-b992786351bd tempest-VolumeDependencyTests-2003615810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:47:39 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-f6b2a0a8-dc1e-4052-9139-b992786351bd tempest-VolumeDependencyTests-2003615810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:47:39 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-f6b2a0a8-dc1e-4052-9139-b992786351bd tempest-VolumeDependencyTests-2003615810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:47:39 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-f6b2a0a8-dc1e-4052-9139-b992786351bd tempest-VolumeDependencyTests-2003615810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:47:39 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-f6b2a0a8-dc1e-4052-9139-b992786351bd tempest-VolumeDependencyTests-2003615810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:47:39 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-f6b2a0a8-dc1e-4052-9139-b992786351bd tempest-VolumeDependencyTests-2003615810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:47:39 devstack sudo[102310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:47:39 devstack sudo[102310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:47:39 devstack sudo[102310]: pam_unix(sudo:session): session closed for user root Sep 23 14:47:39 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-f6b2a0a8-dc1e-4052-9139-b992786351bd tempest-VolumeDependencyTests-2003615810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.315s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:47:39 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-f6b2a0a8-dc1e-4052-9139-b992786351bd tempest-VolumeDependencyTests-2003615810 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:47:39 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-f6b2a0a8-dc1e-4052-9139-b992786351bd tempest-VolumeDependencyTests-2003615810 None] Deleted volume successfully. Sep 23 14:47:39 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-f6b2a0a8-dc1e-4052-9139-b992786351bd tempest-VolumeDependencyTests-2003615810 None] Lock "cinder-ea0e006f-6d94-4f5c-89a9-523a9bb07974-delete_volume" released by "delete_volume" :: held 1.378s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:47:41 devstack cinder-volume[86310]: INFO cinder.volume.manager [req-d33c2422-1de1-499a-9edc-d709937f5f27 req-eae9293c-0273-4e93-a35e-0244b7e4528b tempest-TestStampPattern-1114451325 None] Terminate volume connection completed successfully. Sep 23 14:47:41 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [req-d33c2422-1de1-499a-9edc-d709937f5f27 req-eae9293c-0273-4e93-a35e-0244b7e4528b tempest-TestStampPattern-1114451325 None] Deleting attachment cc19412e-3f60-4cb9-9238-a059d1b549c5. {{(pid=86310) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 14:47:43 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c679c6e-8988-4151-a8a2-55fb417e28df tempest-ProjectReaderTests-1952475106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:47:43 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-6c679c6e-8988-4151-a8a2-55fb417e28df tempest-ProjectReaderTests-1952475106 None] Flow 'volume_create_manager' (3f611e2f-f051-4668-aaf7-e2634c23aa33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:47:43 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-6c679c6e-8988-4151-a8a2-55fb417e28df tempest-ProjectReaderTests-1952475106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d398b7de-0c09-43cc-a9d8-8c5ab69bc161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:47:43 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-6c679c6e-8988-4151-a8a2-55fb417e28df tempest-ProjectReaderTests-1952475106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d398b7de-0c09-43cc-a9d8-8c5ab69bc161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:47:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-765422197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5c5d657-0705-449f-9dcc-6fbeef8bfbf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea015ab32cd1455ab9c5f73a591dbe0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:47:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:47:44Z,use_quota=True,user_id='0446f2b68d82477ea9501fb81d9c536d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:47:43 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-6c679c6e-8988-4151-a8a2-55fb417e28df tempest-ProjectReaderTests-1952475106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27d1add6-709c-4c82-9b1e-9654408daf16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:47:43 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-6c679c6e-8988-4151-a8a2-55fb417e28df tempest-ProjectReaderTests-1952475106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27d1add6-709c-4c82-9b1e-9654408daf16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:47:43 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-6c679c6e-8988-4151-a8a2-55fb417e28df tempest-ProjectReaderTests-1952475106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7965d1f-997f-4ccf-a796-5eb36edf7e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:47:43 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-6c679c6e-8988-4151-a8a2-55fb417e28df tempest-ProjectReaderTests-1952475106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7965d1f-997f-4ccf-a796-5eb36edf7e9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5c5d657-0705-449f-9dcc-6fbeef8bfbf6', 'volume_name': 'volume-a5c5d657-0705-449f-9dcc-6fbeef8bfbf6', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:47:43 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-6c679c6e-8988-4151-a8a2-55fb417e28df tempest-ProjectReaderTests-1952475106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (236c90b3-f0bf-49a0-b76b-c95450bfa150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:47:43 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-6c679c6e-8988-4151-a8a2-55fb417e28df tempest-ProjectReaderTests-1952475106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (236c90b3-f0bf-49a0-b76b-c95450bfa150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:47:43 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-6c679c6e-8988-4151-a8a2-55fb417e28df tempest-ProjectReaderTests-1952475106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9f74ab5-5cd7-464d-ac7d-1b8fcc7cb513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:47:43 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-6c679c6e-8988-4151-a8a2-55fb417e28df tempest-ProjectReaderTests-1952475106 None] Volume a5c5d657-0705-449f-9dcc-6fbeef8bfbf6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5c5d657-0705-449f-9dcc-6fbeef8bfbf6', 'volume_size': 1} Sep 23 14:47:43 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-6c679c6e-8988-4151-a8a2-55fb417e28df tempest-ProjectReaderTests-1952475106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:47:43 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-6c679c6e-8988-4151-a8a2-55fb417e28df tempest-ProjectReaderTests-1952475106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:47:43 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-6c679c6e-8988-4151-a8a2-55fb417e28df tempest-ProjectReaderTests-1952475106 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:47:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-765422197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5c5d657-0705-449f-9dcc-6fbeef8bfbf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea015ab32cd1455ab9c5f73a591dbe0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:47:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:47:44Z,use_quota=True,user_id='0446f2b68d82477ea9501fb81d9c536d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:47:43 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-6c679c6e-8988-4151-a8a2-55fb417e28df tempest-ProjectReaderTests-1952475106 None] Creating volume a5c5d657-0705-449f-9dcc-6fbeef8bfbf6 {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:47:43 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-6c679c6e-8988-4151-a8a2-55fb417e28df tempest-ProjectReaderTests-1952475106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:47:43 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-6c679c6e-8988-4151-a8a2-55fb417e28df tempest-ProjectReaderTests-1952475106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:47:43 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-6c679c6e-8988-4151-a8a2-55fb417e28df tempest-ProjectReaderTests-1952475106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:47:44 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-6c679c6e-8988-4151-a8a2-55fb417e28df tempest-ProjectReaderTests-1952475106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:47:44 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-6c679c6e-8988-4151-a8a2-55fb417e28df tempest-ProjectReaderTests-1952475106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:47:44 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-6c679c6e-8988-4151-a8a2-55fb417e28df tempest-ProjectReaderTests-1952475106 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:47:44 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-6c679c6e-8988-4151-a8a2-55fb417e28df tempest-ProjectReaderTests-1952475106 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:47:44 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-6c679c6e-8988-4151-a8a2-55fb417e28df tempest-ProjectReaderTests-1952475106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-a5c5d657-0705-449f-9dcc-6fbeef8bfbf6 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:47:44 devstack sudo[102357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-a5c5d657-0705-449f-9dcc-6fbeef8bfbf6 1073741824 Sep 23 14:47:44 devstack sudo[102357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:47:44 devstack sudo[102357]: pam_unix(sudo:session): session closed for user root Sep 23 14:47:44 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-6c679c6e-8988-4151-a8a2-55fb417e28df tempest-ProjectReaderTests-1952475106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-a5c5d657-0705-449f-9dcc-6fbeef8bfbf6 1073741824" returned: 0 in 0.577s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:47:44 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-6c679c6e-8988-4151-a8a2-55fb417e28df tempest-ProjectReaderTests-1952475106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-a5c5d657-0705-449f-9dcc-6fbeef8bfbf6 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:47:44 devstack sudo[102364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-a5c5d657-0705-449f-9dcc-6fbeef8bfbf6 Sep 23 14:47:44 devstack sudo[102364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:47:44 devstack sudo[102364]: pam_unix(sudo:session): session closed for user root Sep 23 14:47:44 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-6c679c6e-8988-4151-a8a2-55fb417e28df tempest-ProjectReaderTests-1952475106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-a5c5d657-0705-449f-9dcc-6fbeef8bfbf6" returned: 0 in 0.303s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:47:44 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-6c679c6e-8988-4151-a8a2-55fb417e28df tempest-ProjectReaderTests-1952475106 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:47:44 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-6c679c6e-8988-4151-a8a2-55fb417e28df tempest-ProjectReaderTests-1952475106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:47:44 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-6c679c6e-8988-4151-a8a2-55fb417e28df tempest-ProjectReaderTests-1952475106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9f74ab5-5cd7-464d-ac7d-1b8fcc7cb513) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5c5d657-0705-449f-9dcc-6fbeef8bfbf6', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:47:44 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-6c679c6e-8988-4151-a8a2-55fb417e28df tempest-ProjectReaderTests-1952475106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c66a56b6-09f3-4c9e-a572-1d749a717f71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:47:44 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-6c679c6e-8988-4151-a8a2-55fb417e28df tempest-ProjectReaderTests-1952475106 None] Volume volume-a5c5d657-0705-449f-9dcc-6fbeef8bfbf6 (a5c5d657-0705-449f-9dcc-6fbeef8bfbf6): created successfully Sep 23 14:47:44 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-6c679c6e-8988-4151-a8a2-55fb417e28df tempest-ProjectReaderTests-1952475106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c66a56b6-09f3-4c9e-a572-1d749a717f71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:47:45 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-6c679c6e-8988-4151-a8a2-55fb417e28df tempest-ProjectReaderTests-1952475106 None] Flow 'volume_create_manager' (3f611e2f-f051-4668-aaf7-e2634c23aa33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:47:45 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-6c679c6e-8988-4151-a8a2-55fb417e28df tempest-ProjectReaderTests-1952475106 None] Created volume successfully. Sep 23 14:47:45 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-a7d421b8-2e3e-4e46-afe1-739f187266e6 tempest-ProjectReaderTests-1952475106 None] Acquiring lock "cinder-a5c5d657-0705-449f-9dcc-6fbeef8bfbf6-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:47:45 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-a7d421b8-2e3e-4e46-afe1-739f187266e6 tempest-ProjectReaderTests-1952475106 None] Lock "cinder-a5c5d657-0705-449f-9dcc-6fbeef8bfbf6-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:47:45 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-a7d421b8-2e3e-4e46-afe1-739f187266e6 tempest-ProjectReaderTests-1952475106 None] Acquiring lock "cinder-quobyte-a5c5d657-0705-449f-9dcc-6fbeef8bfbf6" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:47:45 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-1ac65aa4-4509-438f-b884-b1b360a94241 tempest-TestStampPattern-1114451325 None] Acquiring lock "cinder-08d52c32-414d-4c62-abd9-4f6b1ac3119f-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:47:46 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-1ac65aa4-4509-438f-b884-b1b360a94241 tempest-TestStampPattern-1114451325 None] Lock "cinder-08d52c32-414d-4c62-abd9-4f6b1ac3119f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:47:46 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-a7d421b8-2e3e-4e46-afe1-739f187266e6 tempest-ProjectReaderTests-1952475106 None] Lock "cinder-quobyte-a5c5d657-0705-449f-9dcc-6fbeef8bfbf6" acquired by "delete_volume" :: waited 0.031s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:47:46 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dc349ab-8705-4a93-8607-3e74d649470b]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:47:46 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a7d421b8-2e3e-4e46-afe1-739f187266e6 tempest-ProjectReaderTests-1952475106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-a5c5d657-0705-449f-9dcc-6fbeef8bfbf6 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:47:46 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-1ac65aa4-4509-438f-b884-b1b360a94241 tempest-TestStampPattern-1114451325 None] Acquiring lock "cinder-quobyte-08d52c32-414d-4c62-abd9-4f6b1ac3119f" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:47:46 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-1ac65aa4-4509-438f-b884-b1b360a94241 tempest-TestStampPattern-1114451325 None] Lock "cinder-quobyte-08d52c32-414d-4c62-abd9-4f6b1ac3119f" acquired by "delete_volume" :: waited 0.017s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:47:46 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b9ddf6a-eb07-4543-94ef-beb8c03a74fa]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:47:46 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-1ac65aa4-4509-438f-b884-b1b360a94241 tempest-TestStampPattern-1114451325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-08d52c32-414d-4c62-abd9-4f6b1ac3119f {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:47:46 devstack sudo[102369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-a5c5d657-0705-449f-9dcc-6fbeef8bfbf6 Sep 23 14:47:46 devstack sudo[102369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:47:46 devstack sudo[102370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-08d52c32-414d-4c62-abd9-4f6b1ac3119f Sep 23 14:47:46 devstack sudo[102370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:47:46 devstack sudo[102369]: pam_unix(sudo:session): session closed for user root Sep 23 14:47:46 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a7d421b8-2e3e-4e46-afe1-739f187266e6 tempest-ProjectReaderTests-1952475106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-a5c5d657-0705-449f-9dcc-6fbeef8bfbf6" returned: 0 in 0.393s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:47:46 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a7d421b8-2e3e-4e46-afe1-739f187266e6 tempest-ProjectReaderTests-1952475106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-a5c5d657-0705-449f-9dcc-6fbeef8bfbf6 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:47:46 devstack sudo[102378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-a5c5d657-0705-449f-9dcc-6fbeef8bfbf6 Sep 23 14:47:46 devstack sudo[102378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:47:46 devstack sudo[102370]: pam_unix(sudo:session): session closed for user root Sep 23 14:47:46 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-1ac65aa4-4509-438f-b884-b1b360a94241 tempest-TestStampPattern-1114451325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-08d52c32-414d-4c62-abd9-4f6b1ac3119f" returned: 0 in 0.391s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:47:46 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-1ac65aa4-4509-438f-b884-b1b360a94241 tempest-TestStampPattern-1114451325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-08d52c32-414d-4c62-abd9-4f6b1ac3119f {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:47:46 devstack sudo[102382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-08d52c32-414d-4c62-abd9-4f6b1ac3119f Sep 23 14:47:46 devstack sudo[102382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:47:46 devstack sudo[102378]: pam_unix(sudo:session): session closed for user root Sep 23 14:47:46 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a7d421b8-2e3e-4e46-afe1-739f187266e6 tempest-ProjectReaderTests-1952475106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-a5c5d657-0705-449f-9dcc-6fbeef8bfbf6" returned: 0 in 0.251s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:47:46 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-a7d421b8-2e3e-4e46-afe1-739f187266e6 tempest-ProjectReaderTests-1952475106 None] Lock "cinder-quobyte-a5c5d657-0705-449f-9dcc-6fbeef8bfbf6" released by "delete_volume" :: held 0.698s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:47:46 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-a7d421b8-2e3e-4e46-afe1-739f187266e6 tempest-ProjectReaderTests-1952475106 None] Created reservations ['58eca685-2c26-4e01-a26c-76877d4b5795', '2bfb59e6-d291-4989-bb04-9d0500728ae7', 'd6352b14-913b-4950-89e7-d409f7acda7d', '6ed4a2ef-cbcd-4762-a15d-e3058b5caab6'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:47:46 devstack sudo[102382]: pam_unix(sudo:session): session closed for user root Sep 23 14:47:46 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-1ac65aa4-4509-438f-b884-b1b360a94241 tempest-TestStampPattern-1114451325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-08d52c32-414d-4c62-abd9-4f6b1ac3119f" returned: 0 in 0.252s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:47:46 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-1ac65aa4-4509-438f-b884-b1b360a94241 tempest-TestStampPattern-1114451325 None] Lock "cinder-quobyte-08d52c32-414d-4c62-abd9-4f6b1ac3119f" released by "delete_volume" :: held 0.688s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:47:46 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-a7d421b8-2e3e-4e46-afe1-739f187266e6 tempest-ProjectReaderTests-1952475106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:47:46 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-a7d421b8-2e3e-4e46-afe1-739f187266e6 tempest-ProjectReaderTests-1952475106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:47:46 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-a7d421b8-2e3e-4e46-afe1-739f187266e6 tempest-ProjectReaderTests-1952475106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:47:46 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-a7d421b8-2e3e-4e46-afe1-739f187266e6 tempest-ProjectReaderTests-1952475106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:47:46 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-a7d421b8-2e3e-4e46-afe1-739f187266e6 tempest-ProjectReaderTests-1952475106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:47:46 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a7d421b8-2e3e-4e46-afe1-739f187266e6 tempest-ProjectReaderTests-1952475106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:47:46 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-1ac65aa4-4509-438f-b884-b1b360a94241 tempest-TestStampPattern-1114451325 None] Created reservations ['0584a3a8-664d-44f3-a404-2b76ef370a63', '137e4c20-5048-4672-919c-dc4dafc942c6', '1521c2ed-0a1b-4ac6-97d6-853916e1bb2b', 'fbf4ad01-784c-4dad-a2f9-230b82e3f402'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:47:46 devstack sudo[102386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:47:46 devstack sudo[102386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:47:46 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-1ac65aa4-4509-438f-b884-b1b360a94241 tempest-TestStampPattern-1114451325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:47:46 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-1ac65aa4-4509-438f-b884-b1b360a94241 tempest-TestStampPattern-1114451325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:47:46 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-1ac65aa4-4509-438f-b884-b1b360a94241 tempest-TestStampPattern-1114451325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:47:46 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-1ac65aa4-4509-438f-b884-b1b360a94241 tempest-TestStampPattern-1114451325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:47:46 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-1ac65aa4-4509-438f-b884-b1b360a94241 tempest-TestStampPattern-1114451325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:47:46 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-1ac65aa4-4509-438f-b884-b1b360a94241 tempest-TestStampPattern-1114451325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:47:46 devstack sudo[102388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:47:46 devstack sudo[102388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:47:47 devstack sudo[102386]: pam_unix(sudo:session): session closed for user root Sep 23 14:47:47 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a7d421b8-2e3e-4e46-afe1-739f187266e6 tempest-ProjectReaderTests-1952475106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.271s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:47:47 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-a7d421b8-2e3e-4e46-afe1-739f187266e6 tempest-ProjectReaderTests-1952475106 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:47:47 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-a7d421b8-2e3e-4e46-afe1-739f187266e6 tempest-ProjectReaderTests-1952475106 None] Deleted volume successfully. Sep 23 14:47:47 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-a7d421b8-2e3e-4e46-afe1-739f187266e6 tempest-ProjectReaderTests-1952475106 None] Lock "cinder-a5c5d657-0705-449f-9dcc-6fbeef8bfbf6-delete_volume" released by "delete_volume" :: held 1.241s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:47:47 devstack sudo[102388]: pam_unix(sudo:session): session closed for user root Sep 23 14:47:47 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-1ac65aa4-4509-438f-b884-b1b360a94241 tempest-TestStampPattern-1114451325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.283s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:47:47 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-1ac65aa4-4509-438f-b884-b1b360a94241 tempest-TestStampPattern-1114451325 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:47:47 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-1ac65aa4-4509-438f-b884-b1b360a94241 tempest-TestStampPattern-1114451325 None] Deleted volume successfully. Sep 23 14:47:47 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-1ac65aa4-4509-438f-b884-b1b360a94241 tempest-TestStampPattern-1114451325 None] Lock "cinder-08d52c32-414d-4c62-abd9-4f6b1ac3119f-delete_volume" released by "delete_volume" :: held 1.273s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:47:47 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-c0f2ef48-f5d3-4f50-adeb-f904dca29185 tempest-TestStampPattern-1114451325 None] Acquiring lock "cinder-421cf3f0-0ede-4125-a838-d138ea04ac58-delete_snapshot" by "delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:47:47 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-c0f2ef48-f5d3-4f50-adeb-f904dca29185 tempest-TestStampPattern-1114451325 None] Lock "cinder-421cf3f0-0ede-4125-a838-d138ea04ac58-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:47:47 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-c0f2ef48-f5d3-4f50-adeb-f904dca29185 tempest-TestStampPattern-1114451325 None] Acquiring lock "cinder-quobyte-b48b56ce-ca56-4a1f-a71a-0c0613fd3960" by "delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:47:47 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-c0f2ef48-f5d3-4f50-adeb-f904dca29185 tempest-TestStampPattern-1114451325 None] Lock "cinder-quobyte-b48b56ce-ca56-4a1f-a71a-0c0613fd3960" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:47:47 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-c0f2ef48-f5d3-4f50-adeb-f904dca29185 tempest-TestStampPattern-1114451325 None] Acquiring lock "cinder-quobyte-421cf3f0-0ede-4125-a838-d138ea04ac58" by "_delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:47:47 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-c0f2ef48-f5d3-4f50-adeb-f904dca29185 tempest-TestStampPattern-1114451325 None] Lock "cinder-quobyte-421cf3f0-0ede-4125-a838-d138ea04ac58" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:47:47 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-c0f2ef48-f5d3-4f50-adeb-f904dca29185 tempest-TestStampPattern-1114451325 None] Deleting offline snapshot 421cf3f0-0ede-4125-a838-d138ea04ac58 of volume b48b56ce-ca56-4a1f-a71a-0c0613fd3960 {{(pid=86310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 14:47:47 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-c0f2ef48-f5d3-4f50-adeb-f904dca29185 tempest-TestStampPattern-1114451325 None] snapshot_file for this snap is: volume-b48b56ce-ca56-4a1f-a71a-0c0613fd3960.421cf3f0-0ede-4125-a838-d138ea04ac58 {{(pid=86310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 14:47:47 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[77d89146-2bb8-4bc9-b13c-cc53f204d810]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:47:47 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-c0f2ef48-f5d3-4f50-adeb-f904dca29185 tempest-TestStampPattern-1114451325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b48b56ce-ca56-4a1f-a71a-0c0613fd3960.421cf3f0-0ede-4125-a838-d138ea04ac58 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:47:47 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-707018de-92b7-4a3a-b89a-e462fa325179 tempest-ProjectReaderTests-1952475106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:47:47 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-707018de-92b7-4a3a-b89a-e462fa325179 tempest-ProjectReaderTests-1952475106 None] Flow 'volume_create_manager' (8ec63a64-fe57-4f57-b45f-8bb90dd65c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:47:47 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-707018de-92b7-4a3a-b89a-e462fa325179 tempest-ProjectReaderTests-1952475106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdc8c1a5-fa56-49c0-be56-fe37d2ba2952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:47:47 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-707018de-92b7-4a3a-b89a-e462fa325179 tempest-ProjectReaderTests-1952475106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdc8c1a5-fa56-49c0-be56-fe37d2ba2952) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:47:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1142448357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca7385ca-2d78-41bf-9a12-c43246400b1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea015ab32cd1455ab9c5f73a591dbe0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:47:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:47:48Z,use_quota=True,user_id='0446f2b68d82477ea9501fb81d9c536d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:47:47 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-707018de-92b7-4a3a-b89a-e462fa325179 tempest-ProjectReaderTests-1952475106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f11f983-e54d-4dbf-9496-4af803dc6210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:47:47 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-707018de-92b7-4a3a-b89a-e462fa325179 tempest-ProjectReaderTests-1952475106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f11f983-e54d-4dbf-9496-4af803dc6210) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:47:47 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-707018de-92b7-4a3a-b89a-e462fa325179 tempest-ProjectReaderTests-1952475106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5be5950-f682-4097-894e-ab363da857a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:47:47 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-707018de-92b7-4a3a-b89a-e462fa325179 tempest-ProjectReaderTests-1952475106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5be5950-f682-4097-894e-ab363da857a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca7385ca-2d78-41bf-9a12-c43246400b1f', 'volume_name': 'volume-ca7385ca-2d78-41bf-9a12-c43246400b1f', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:47:47 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-707018de-92b7-4a3a-b89a-e462fa325179 tempest-ProjectReaderTests-1952475106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (231e4378-5491-49aa-91f9-152728ead9ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:47:47 devstack sudo[102392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b48b56ce-ca56-4a1f-a71a-0c0613fd3960.421cf3f0-0ede-4125-a838-d138ea04ac58 Sep 23 14:47:47 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-707018de-92b7-4a3a-b89a-e462fa325179 tempest-ProjectReaderTests-1952475106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (231e4378-5491-49aa-91f9-152728ead9ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:47:47 devstack sudo[102392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:47:47 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-707018de-92b7-4a3a-b89a-e462fa325179 tempest-ProjectReaderTests-1952475106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8dd1e6c-e034-4326-bc64-34049d0090fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:47:47 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-707018de-92b7-4a3a-b89a-e462fa325179 tempest-ProjectReaderTests-1952475106 None] Volume ca7385ca-2d78-41bf-9a12-c43246400b1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca7385ca-2d78-41bf-9a12-c43246400b1f', 'volume_size': 1} Sep 23 14:47:47 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-707018de-92b7-4a3a-b89a-e462fa325179 tempest-ProjectReaderTests-1952475106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:47:47 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-707018de-92b7-4a3a-b89a-e462fa325179 tempest-ProjectReaderTests-1952475106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:47:47 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-707018de-92b7-4a3a-b89a-e462fa325179 tempest-ProjectReaderTests-1952475106 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:47:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1142448357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca7385ca-2d78-41bf-9a12-c43246400b1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea015ab32cd1455ab9c5f73a591dbe0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:47:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:47:48Z,use_quota=True,user_id='0446f2b68d82477ea9501fb81d9c536d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:47:47 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-707018de-92b7-4a3a-b89a-e462fa325179 tempest-ProjectReaderTests-1952475106 None] Creating volume ca7385ca-2d78-41bf-9a12-c43246400b1f {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:47:47 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-707018de-92b7-4a3a-b89a-e462fa325179 tempest-ProjectReaderTests-1952475106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:47:47 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-707018de-92b7-4a3a-b89a-e462fa325179 tempest-ProjectReaderTests-1952475106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:47:47 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-707018de-92b7-4a3a-b89a-e462fa325179 tempest-ProjectReaderTests-1952475106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:47:47 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-707018de-92b7-4a3a-b89a-e462fa325179 tempest-ProjectReaderTests-1952475106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:47:47 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-707018de-92b7-4a3a-b89a-e462fa325179 tempest-ProjectReaderTests-1952475106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:47:47 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-707018de-92b7-4a3a-b89a-e462fa325179 tempest-ProjectReaderTests-1952475106 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:47:47 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-707018de-92b7-4a3a-b89a-e462fa325179 tempest-ProjectReaderTests-1952475106 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:47:47 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-707018de-92b7-4a3a-b89a-e462fa325179 tempest-ProjectReaderTests-1952475106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-ca7385ca-2d78-41bf-9a12-c43246400b1f 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:47:47 devstack sudo[102394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-ca7385ca-2d78-41bf-9a12-c43246400b1f 1073741824 Sep 23 14:47:47 devstack sudo[102394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:47:48 devstack sudo[102392]: pam_unix(sudo:session): session closed for user root Sep 23 14:47:48 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-c0f2ef48-f5d3-4f50-adeb-f904dca29185 tempest-TestStampPattern-1114451325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b48b56ce-ca56-4a1f-a71a-0c0613fd3960.421cf3f0-0ede-4125-a838-d138ea04ac58" returned: 0 in 0.398s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:47:48 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-c0f2ef48-f5d3-4f50-adeb-f904dca29185 tempest-TestStampPattern-1114451325 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b48b56ce-ca56-4a1f-a71a-0c0613fd3960(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 14:47:48 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[847fd5ed-fa54-4d19-8c8a-18d00fa96da5]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:47:48 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-c0f2ef48-f5d3-4f50-adeb-f904dca29185 tempest-TestStampPattern-1114451325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b48b56ce-ca56-4a1f-a71a-0c0613fd3960 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:47:48 devstack sudo[102402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b48b56ce-ca56-4a1f-a71a-0c0613fd3960 Sep 23 14:47:48 devstack sudo[102402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:47:48 devstack sudo[102394]: pam_unix(sudo:session): session closed for user root Sep 23 14:47:48 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-707018de-92b7-4a3a-b89a-e462fa325179 tempest-ProjectReaderTests-1952475106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-ca7385ca-2d78-41bf-9a12-c43246400b1f 1073741824" returned: 0 in 0.463s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:47:48 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-707018de-92b7-4a3a-b89a-e462fa325179 tempest-ProjectReaderTests-1952475106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-ca7385ca-2d78-41bf-9a12-c43246400b1f {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:47:48 devstack sudo[102405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-ca7385ca-2d78-41bf-9a12-c43246400b1f Sep 23 14:47:48 devstack sudo[102405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:47:48 devstack sudo[102405]: pam_unix(sudo:session): session closed for user root Sep 23 14:47:48 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-707018de-92b7-4a3a-b89a-e462fa325179 tempest-ProjectReaderTests-1952475106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-ca7385ca-2d78-41bf-9a12-c43246400b1f" returned: 0 in 0.289s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:47:48 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-707018de-92b7-4a3a-b89a-e462fa325179 tempest-ProjectReaderTests-1952475106 None] <== create_volume: return (801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:47:48 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-707018de-92b7-4a3a-b89a-e462fa325179 tempest-ProjectReaderTests-1952475106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.804s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:47:48 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-707018de-92b7-4a3a-b89a-e462fa325179 tempest-ProjectReaderTests-1952475106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8dd1e6c-e034-4326-bc64-34049d0090fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca7385ca-2d78-41bf-9a12-c43246400b1f', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:47:48 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-707018de-92b7-4a3a-b89a-e462fa325179 tempest-ProjectReaderTests-1952475106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d6fbff2-dee5-409c-96df-f20e7c193826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:47:48 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-707018de-92b7-4a3a-b89a-e462fa325179 tempest-ProjectReaderTests-1952475106 None] Volume volume-ca7385ca-2d78-41bf-9a12-c43246400b1f (ca7385ca-2d78-41bf-9a12-c43246400b1f): created successfully Sep 23 14:47:48 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-707018de-92b7-4a3a-b89a-e462fa325179 tempest-ProjectReaderTests-1952475106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d6fbff2-dee5-409c-96df-f20e7c193826) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:47:48 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-707018de-92b7-4a3a-b89a-e462fa325179 tempest-ProjectReaderTests-1952475106 None] Flow 'volume_create_manager' (8ec63a64-fe57-4f57-b45f-8bb90dd65c5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:47:48 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-707018de-92b7-4a3a-b89a-e462fa325179 tempest-ProjectReaderTests-1952475106 None] Created volume successfully. Sep 23 14:47:48 devstack sudo[102402]: pam_unix(sudo:session): session closed for user root Sep 23 14:47:48 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-c0f2ef48-f5d3-4f50-adeb-f904dca29185 tempest-TestStampPattern-1114451325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b48b56ce-ca56-4a1f-a71a-0c0613fd3960" returned: 0 in 0.604s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:47:48 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-c0f2ef48-f5d3-4f50-adeb-f904dca29185 tempest-TestStampPattern-1114451325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b48b56ce-ca56-4a1f-a71a-0c0613fd3960.421cf3f0-0ede-4125-a838-d138ea04ac58 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:47:48 devstack sudo[102411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b48b56ce-ca56-4a1f-a71a-0c0613fd3960.421cf3f0-0ede-4125-a838-d138ea04ac58 Sep 23 14:47:48 devstack sudo[102411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:47:48 devstack sudo[102411]: pam_unix(sudo:session): session closed for user root Sep 23 14:47:48 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-c0f2ef48-f5d3-4f50-adeb-f904dca29185 tempest-TestStampPattern-1114451325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b48b56ce-ca56-4a1f-a71a-0c0613fd3960.421cf3f0-0ede-4125-a838-d138ea04ac58" returned: 0 in 0.335s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:47:48 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-c0f2ef48-f5d3-4f50-adeb-f904dca29185 tempest-TestStampPattern-1114451325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b48b56ce-ca56-4a1f-a71a-0c0613fd3960.421cf3f0-0ede-4125-a838-d138ea04ac58 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:47:49 devstack sudo[102416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b48b56ce-ca56-4a1f-a71a-0c0613fd3960.421cf3f0-0ede-4125-a838-d138ea04ac58 Sep 23 14:47:49 devstack sudo[102416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:47:49 devstack sudo[102416]: pam_unix(sudo:session): session closed for user root Sep 23 14:47:49 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-c0f2ef48-f5d3-4f50-adeb-f904dca29185 tempest-TestStampPattern-1114451325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b48b56ce-ca56-4a1f-a71a-0c0613fd3960.421cf3f0-0ede-4125-a838-d138ea04ac58" returned: 0 in 0.251s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:47:49 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-c0f2ef48-f5d3-4f50-adeb-f904dca29185 tempest-TestStampPattern-1114451325 None] Lock "cinder-quobyte-421cf3f0-0ede-4125-a838-d138ea04ac58" released by "_delete_snapshot" :: held 1.715s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:47:49 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-c0f2ef48-f5d3-4f50-adeb-f904dca29185 tempest-TestStampPattern-1114451325 None] Lock "cinder-quobyte-b48b56ce-ca56-4a1f-a71a-0c0613fd3960" released by "delete_snapshot" :: held 1.739s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:47:49 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-c0f2ef48-f5d3-4f50-adeb-f904dca29185 tempest-TestStampPattern-1114451325 None] Created reservations ['4d8419fa-832e-482e-8435-021eee6a1c83', '9c2e544f-3459-466d-881a-920da67b3d77', '7597be84-e85e-4968-a325-1420160094cc', 'abad547b-ab98-4d76-9bff-99524e27b2f3'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:47:49 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-c0f2ef48-f5d3-4f50-adeb-f904dca29185 tempest-TestStampPattern-1114451325 None] Delete snapshot completed successfully. Sep 23 14:47:49 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-c0f2ef48-f5d3-4f50-adeb-f904dca29185 tempest-TestStampPattern-1114451325 None] Lock "cinder-421cf3f0-0ede-4125-a838-d138ea04ac58-delete_snapshot" released by "delete_snapshot" :: held 1.891s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:47:49 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-2a2256e0-6970-4305-8599-db19145bef55 tempest-ProjectReaderTests-1952475106 None] Acquiring lock "cinder-ca7385ca-2d78-41bf-9a12-c43246400b1f-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:47:49 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-2a2256e0-6970-4305-8599-db19145bef55 tempest-ProjectReaderTests-1952475106 None] Lock "cinder-ca7385ca-2d78-41bf-9a12-c43246400b1f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:47:49 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-2a2256e0-6970-4305-8599-db19145bef55 tempest-ProjectReaderTests-1952475106 None] Acquiring lock "cinder-quobyte-ca7385ca-2d78-41bf-9a12-c43246400b1f" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:47:49 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-2a2256e0-6970-4305-8599-db19145bef55 tempest-ProjectReaderTests-1952475106 None] Lock "cinder-quobyte-ca7385ca-2d78-41bf-9a12-c43246400b1f" acquired by "delete_volume" :: waited 0.017s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:47:49 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[386bed42-ffb5-4f74-8d34-51d226d5b4bf]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:47:49 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-2a2256e0-6970-4305-8599-db19145bef55 tempest-ProjectReaderTests-1952475106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-ca7385ca-2d78-41bf-9a12-c43246400b1f {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:47:50 devstack sudo[102420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-ca7385ca-2d78-41bf-9a12-c43246400b1f Sep 23 14:47:50 devstack sudo[102420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:47:50 devstack sudo[102420]: pam_unix(sudo:session): session closed for user root Sep 23 14:47:50 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-2a2256e0-6970-4305-8599-db19145bef55 tempest-ProjectReaderTests-1952475106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-ca7385ca-2d78-41bf-9a12-c43246400b1f" returned: 0 in 0.461s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:47:50 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-2a2256e0-6970-4305-8599-db19145bef55 tempest-ProjectReaderTests-1952475106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-ca7385ca-2d78-41bf-9a12-c43246400b1f {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:47:50 devstack sudo[102427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-ca7385ca-2d78-41bf-9a12-c43246400b1f Sep 23 14:47:50 devstack sudo[102427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:47:50 devstack sudo[102427]: pam_unix(sudo:session): session closed for user root Sep 23 14:47:50 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-2a2256e0-6970-4305-8599-db19145bef55 tempest-ProjectReaderTests-1952475106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-ca7385ca-2d78-41bf-9a12-c43246400b1f" returned: 0 in 0.280s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:47:50 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-2a2256e0-6970-4305-8599-db19145bef55 tempest-ProjectReaderTests-1952475106 None] Lock "cinder-quobyte-ca7385ca-2d78-41bf-9a12-c43246400b1f" released by "delete_volume" :: held 0.801s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:47:50 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-2a2256e0-6970-4305-8599-db19145bef55 tempest-ProjectReaderTests-1952475106 None] Created reservations ['bbf34359-61e8-4bf2-a569-8d1ca3140b3d', '4749c6db-c605-4927-a1ef-9d09091c8ba5', '0e0b9a93-02a0-44f9-b3a6-ad1d1ae08daa', 'b8d404e5-493d-453a-9d93-c231ae932c68'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:47:50 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-2a2256e0-6970-4305-8599-db19145bef55 tempest-ProjectReaderTests-1952475106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:47:50 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-2a2256e0-6970-4305-8599-db19145bef55 tempest-ProjectReaderTests-1952475106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:47:50 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-2a2256e0-6970-4305-8599-db19145bef55 tempest-ProjectReaderTests-1952475106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:47:50 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-2a2256e0-6970-4305-8599-db19145bef55 tempest-ProjectReaderTests-1952475106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:47:50 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-2a2256e0-6970-4305-8599-db19145bef55 tempest-ProjectReaderTests-1952475106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:47:50 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-2a2256e0-6970-4305-8599-db19145bef55 tempest-ProjectReaderTests-1952475106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:47:50 devstack sudo[102432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:47:50 devstack sudo[102432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:47:51 devstack cinder-volume[86310]: DEBUG oslo_service.periodic_task [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86310) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 14:47:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:47:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:47:51 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:47:51 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:47:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:47:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:47:51 devstack sudo[102432]: pam_unix(sudo:session): session closed for user root Sep 23 14:47:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-2a2256e0-6970-4305-8599-db19145bef55 tempest-ProjectReaderTests-1952475106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.580s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:47:51 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-2a2256e0-6970-4305-8599-db19145bef55 tempest-ProjectReaderTests-1952475106 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:47:51 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-2a2256e0-6970-4305-8599-db19145bef55 tempest-ProjectReaderTests-1952475106 None] Deleted volume successfully. Sep 23 14:47:51 devstack sudo[102454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:47:51 devstack sudo[102454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:47:51 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-2a2256e0-6970-4305-8599-db19145bef55 tempest-ProjectReaderTests-1952475106 None] Lock "cinder-ca7385ca-2d78-41bf-9a12-c43246400b1f-delete_volume" released by "delete_volume" :: held 1.633s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:47:51 devstack sudo[102454]: pam_unix(sudo:session): session closed for user root Sep 23 14:47:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.353s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:47:51 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:47:51 devstack cinder-volume[86310]: DEBUG oslo_service.periodic_task [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Running periodic task VolumeManager._thread_info {{(pid=86310) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 14:47:51 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] thread count: 28 {{(pid=86310) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 14:47:51 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] thread info: [<_MainThread(MainThread, started 128854208852096)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86310) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 14:47:53 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-aa152ca0-d69f-40d3-824d-7893a8625d9c tempest-TestStampPattern-1114451325 None] Acquiring lock "cinder-b48b56ce-ca56-4a1f-a71a-0c0613fd3960-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:47:53 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-aa152ca0-d69f-40d3-824d-7893a8625d9c tempest-TestStampPattern-1114451325 None] Lock "cinder-b48b56ce-ca56-4a1f-a71a-0c0613fd3960-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:47:53 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-aa152ca0-d69f-40d3-824d-7893a8625d9c tempest-TestStampPattern-1114451325 None] Acquiring lock "cinder-quobyte-b48b56ce-ca56-4a1f-a71a-0c0613fd3960" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:47:53 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-aa152ca0-d69f-40d3-824d-7893a8625d9c tempest-TestStampPattern-1114451325 None] Lock "cinder-quobyte-b48b56ce-ca56-4a1f-a71a-0c0613fd3960" acquired by "delete_volume" :: waited 0.021s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:47:53 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[c437b317-dcb9-4385-ab3b-9fffc162e3df]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:47:53 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-aa152ca0-d69f-40d3-824d-7893a8625d9c tempest-TestStampPattern-1114451325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b48b56ce-ca56-4a1f-a71a-0c0613fd3960 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:47:53 devstack sudo[102470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b48b56ce-ca56-4a1f-a71a-0c0613fd3960 Sep 23 14:47:53 devstack sudo[102470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:47:53 devstack sudo[102470]: pam_unix(sudo:session): session closed for user root Sep 23 14:47:53 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-aa152ca0-d69f-40d3-824d-7893a8625d9c tempest-TestStampPattern-1114451325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b48b56ce-ca56-4a1f-a71a-0c0613fd3960" returned: 0 in 0.447s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:47:53 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-aa152ca0-d69f-40d3-824d-7893a8625d9c tempest-TestStampPattern-1114451325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b48b56ce-ca56-4a1f-a71a-0c0613fd3960 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:47:54 devstack sudo[102475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b48b56ce-ca56-4a1f-a71a-0c0613fd3960 Sep 23 14:47:54 devstack sudo[102475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:47:54 devstack sudo[102475]: pam_unix(sudo:session): session closed for user root Sep 23 14:47:54 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-aa152ca0-d69f-40d3-824d-7893a8625d9c tempest-TestStampPattern-1114451325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b48b56ce-ca56-4a1f-a71a-0c0613fd3960" returned: 0 in 0.335s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:47:54 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-aa152ca0-d69f-40d3-824d-7893a8625d9c tempest-TestStampPattern-1114451325 None] Lock "cinder-quobyte-b48b56ce-ca56-4a1f-a71a-0c0613fd3960" released by "delete_volume" :: held 0.878s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:47:54 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-aa152ca0-d69f-40d3-824d-7893a8625d9c tempest-TestStampPattern-1114451325 None] Created reservations ['66ebd73f-da19-48d7-a5ce-4d7c149cd648', '4c4ab7d1-b1a8-4fbc-afb1-bca3bc7bb0dc', 'fcb314a3-47e1-4273-b78b-545fcde35cdc', 'a21f3b56-c5d5-470b-a1a6-70d6c19dbf4c'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:47:54 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-aa152ca0-d69f-40d3-824d-7893a8625d9c tempest-TestStampPattern-1114451325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:47:54 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-aa152ca0-d69f-40d3-824d-7893a8625d9c tempest-TestStampPattern-1114451325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:47:54 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-aa152ca0-d69f-40d3-824d-7893a8625d9c tempest-TestStampPattern-1114451325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:47:54 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-aa152ca0-d69f-40d3-824d-7893a8625d9c tempest-TestStampPattern-1114451325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:47:54 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-aa152ca0-d69f-40d3-824d-7893a8625d9c tempest-TestStampPattern-1114451325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:47:54 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-aa152ca0-d69f-40d3-824d-7893a8625d9c tempest-TestStampPattern-1114451325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:47:54 devstack sudo[102478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:47:54 devstack sudo[102478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:47:54 devstack sudo[102478]: pam_unix(sudo:session): session closed for user root Sep 23 14:47:54 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-aa152ca0-d69f-40d3-824d-7893a8625d9c tempest-TestStampPattern-1114451325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.335s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:47:54 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-aa152ca0-d69f-40d3-824d-7893a8625d9c tempest-TestStampPattern-1114451325 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:47:54 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-aa152ca0-d69f-40d3-824d-7893a8625d9c tempest-TestStampPattern-1114451325 None] Deleted volume successfully. Sep 23 14:47:54 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-aa152ca0-d69f-40d3-824d-7893a8625d9c tempest-TestStampPattern-1114451325 None] Lock "cinder-b48b56ce-ca56-4a1f-a71a-0c0613fd3960-delete_volume" released by "delete_volume" :: held 1.501s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:47:55 devstack cinder-volume[86310]: INFO cinder.volume.manager [req-b50dd465-71e1-4e53-87dd-2079040da491 req-ea7c4009-2809-44ed-a42f-7a389e5df1d5 tempest-TestShelveInstance-1881221595 None] Terminate volume connection completed successfully. Sep 23 14:47:55 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [req-b50dd465-71e1-4e53-87dd-2079040da491 req-ea7c4009-2809-44ed-a42f-7a389e5df1d5 tempest-TestShelveInstance-1881221595 None] Deleting attachment ccedc602-37a9-4829-8c1d-1d70753ec5f0. {{(pid=86310) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 14:47:58 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [req-3ae28e06-e273-455b-9822-c4d5a10013e9 req-5db2656a-bf13-4d0c-956b-3cccd0ca64d8 tempest-TestShelveInstance-1881221595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:47:58 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [req-3ae28e06-e273-455b-9822-c4d5a10013e9 req-5db2656a-bf13-4d0c-956b-3cccd0ca64d8 tempest-TestShelveInstance-1881221595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:47:58 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [req-3ae28e06-e273-455b-9822-c4d5a10013e9 req-5db2656a-bf13-4d0c-956b-3cccd0ca64d8 tempest-TestShelveInstance-1881221595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:47:58 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [req-3ae28e06-e273-455b-9822-c4d5a10013e9 req-5db2656a-bf13-4d0c-956b-3cccd0ca64d8 tempest-TestShelveInstance-1881221595 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362', 'name': 'volume-b7484332-4caa-49ff-90d7-cc3a08c2d230', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'efece103-1d24-4265-89b8-85633df147c4', 'enforce_multipath': True} {{(pid=86310) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 14:47:58 devstack cinder-volume[86310]: INFO cinder.volume.manager [req-3ae28e06-e273-455b-9822-c4d5a10013e9 req-5db2656a-bf13-4d0c-956b-3cccd0ca64d8 tempest-TestShelveInstance-1881221595 None] attachment_update completed successfully. Sep 23 14:48:08 devstack cinder-volume[86310]: DEBUG dbcounter [-] [86310] Writing DB stats cinder:INSERT=32,cinder:UPDATE=126,cinder:SELECT=100,cinder:DELETE=12 {{(pid=86310) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 14:48:08 devstack cinder-volume[86310]: DEBUG dbcounter [-] [86310] Writing DB stats cinder:UPDATE=55,cinder:SELECT=44,cinder:INSERT=13,cinder:DELETE=2 {{(pid=86310) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 14:48:37 devstack cinder-volume[86310]: DEBUG dbcounter [-] [86310] Writing DB stats cinder:SELECT=1 {{(pid=86310) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 14:48:37 devstack cinder-volume[86310]: DEBUG dbcounter [-] [86310] Writing DB stats cinder:UPDATE=1 {{(pid=86310) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 14:48:44 devstack cinder-volume[86310]: INFO cinder.volume.manager [req-c053ef32-f64c-498b-abbc-f7f81f5076f5 req-132cd633-2203-49a4-959c-5859e797a332 tempest-TestShelveInstance-1881221595 None] Terminate volume connection completed successfully. Sep 23 14:48:44 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [req-c053ef32-f64c-498b-abbc-f7f81f5076f5 req-132cd633-2203-49a4-959c-5859e797a332 tempest-TestShelveInstance-1881221595 None] Deleting attachment efece103-1d24-4265-89b8-85633df147c4. {{(pid=86310) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 14:48:44 devstack cinder-volume[86310]: DEBUG cinder.coordination [req-c053ef32-f64c-498b-abbc-f7f81f5076f5 req-646f3b79-d469-4699-93d0-e30bb2679b4f tempest-TestShelveInstance-1881221595 None] Acquiring lock "cinder-b7484332-4caa-49ff-90d7-cc3a08c2d230-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:48:44 devstack cinder-volume[86310]: DEBUG cinder.coordination [req-c053ef32-f64c-498b-abbc-f7f81f5076f5 req-646f3b79-d469-4699-93d0-e30bb2679b4f tempest-TestShelveInstance-1881221595 None] Lock "cinder-b7484332-4caa-49ff-90d7-cc3a08c2d230-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:48:44 devstack cinder-volume[86310]: DEBUG cinder.coordination [req-c053ef32-f64c-498b-abbc-f7f81f5076f5 req-646f3b79-d469-4699-93d0-e30bb2679b4f tempest-TestShelveInstance-1881221595 None] Acquiring lock "cinder-quobyte-b7484332-4caa-49ff-90d7-cc3a08c2d230" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:48:44 devstack cinder-volume[86310]: DEBUG cinder.coordination [req-c053ef32-f64c-498b-abbc-f7f81f5076f5 req-646f3b79-d469-4699-93d0-e30bb2679b4f tempest-TestShelveInstance-1881221595 None] Lock "cinder-quobyte-b7484332-4caa-49ff-90d7-cc3a08c2d230" acquired by "delete_volume" :: waited 0.014s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:48:44 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[35f5cdd0-9324-4292-970b-a3891580ac2d]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:48:44 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [req-c053ef32-f64c-498b-abbc-f7f81f5076f5 req-646f3b79-d469-4699-93d0-e30bb2679b4f tempest-TestShelveInstance-1881221595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b7484332-4caa-49ff-90d7-cc3a08c2d230 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:48:44 devstack sudo[103112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b7484332-4caa-49ff-90d7-cc3a08c2d230 Sep 23 14:48:44 devstack sudo[103112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:48:44 devstack sudo[103112]: pam_unix(sudo:session): session closed for user root Sep 23 14:48:44 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [req-c053ef32-f64c-498b-abbc-f7f81f5076f5 req-646f3b79-d469-4699-93d0-e30bb2679b4f tempest-TestShelveInstance-1881221595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b7484332-4caa-49ff-90d7-cc3a08c2d230" returned: 0 in 0.373s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:48:44 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [req-c053ef32-f64c-498b-abbc-f7f81f5076f5 req-646f3b79-d469-4699-93d0-e30bb2679b4f tempest-TestShelveInstance-1881221595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b7484332-4caa-49ff-90d7-cc3a08c2d230 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:48:44 devstack sudo[103117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b7484332-4caa-49ff-90d7-cc3a08c2d230 Sep 23 14:48:44 devstack sudo[103117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:48:44 devstack sudo[103117]: pam_unix(sudo:session): session closed for user root Sep 23 14:48:44 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [req-c053ef32-f64c-498b-abbc-f7f81f5076f5 req-646f3b79-d469-4699-93d0-e30bb2679b4f tempest-TestShelveInstance-1881221595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b7484332-4caa-49ff-90d7-cc3a08c2d230" returned: 0 in 0.254s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:48:44 devstack cinder-volume[86310]: DEBUG cinder.coordination [req-c053ef32-f64c-498b-abbc-f7f81f5076f5 req-646f3b79-d469-4699-93d0-e30bb2679b4f tempest-TestShelveInstance-1881221595 None] Lock "cinder-quobyte-b7484332-4caa-49ff-90d7-cc3a08c2d230" released by "delete_volume" :: held 0.674s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:48:45 devstack cinder-volume[86310]: DEBUG cinder.quota [req-c053ef32-f64c-498b-abbc-f7f81f5076f5 req-646f3b79-d469-4699-93d0-e30bb2679b4f tempest-TestShelveInstance-1881221595 None] Created reservations ['2ec3e4c2-5a8b-4f90-97c6-c77ddc670fe9', 'e44fbed4-b7de-4210-9c97-28cab259a6ea', '377d53c7-3b05-4836-8752-e96dd9686802', '235a3d20-d46a-4494-9880-cc01a8de329b'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:48:45 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [req-c053ef32-f64c-498b-abbc-f7f81f5076f5 req-646f3b79-d469-4699-93d0-e30bb2679b4f tempest-TestShelveInstance-1881221595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:48:45 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [req-c053ef32-f64c-498b-abbc-f7f81f5076f5 req-646f3b79-d469-4699-93d0-e30bb2679b4f tempest-TestShelveInstance-1881221595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:48:45 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [req-c053ef32-f64c-498b-abbc-f7f81f5076f5 req-646f3b79-d469-4699-93d0-e30bb2679b4f tempest-TestShelveInstance-1881221595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:48:45 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [req-c053ef32-f64c-498b-abbc-f7f81f5076f5 req-646f3b79-d469-4699-93d0-e30bb2679b4f tempest-TestShelveInstance-1881221595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:48:45 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [req-c053ef32-f64c-498b-abbc-f7f81f5076f5 req-646f3b79-d469-4699-93d0-e30bb2679b4f tempest-TestShelveInstance-1881221595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:48:45 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [req-c053ef32-f64c-498b-abbc-f7f81f5076f5 req-646f3b79-d469-4699-93d0-e30bb2679b4f tempest-TestShelveInstance-1881221595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:48:45 devstack sudo[103120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:48:45 devstack sudo[103120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:48:45 devstack sudo[103120]: pam_unix(sudo:session): session closed for user root Sep 23 14:48:45 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [req-c053ef32-f64c-498b-abbc-f7f81f5076f5 req-646f3b79-d469-4699-93d0-e30bb2679b4f tempest-TestShelveInstance-1881221595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.260s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:48:45 devstack cinder-volume[86310]: DEBUG cinder.manager [req-c053ef32-f64c-498b-abbc-f7f81f5076f5 req-646f3b79-d469-4699-93d0-e30bb2679b4f tempest-TestShelveInstance-1881221595 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:48:45 devstack cinder-volume[86310]: INFO cinder.volume.manager [req-c053ef32-f64c-498b-abbc-f7f81f5076f5 req-646f3b79-d469-4699-93d0-e30bb2679b4f tempest-TestShelveInstance-1881221595 None] Deleted volume successfully. Sep 23 14:48:45 devstack cinder-volume[86310]: DEBUG cinder.coordination [req-c053ef32-f64c-498b-abbc-f7f81f5076f5 req-646f3b79-d469-4699-93d0-e30bb2679b4f tempest-TestShelveInstance-1881221595 None] Lock "cinder-b7484332-4caa-49ff-90d7-cc3a08c2d230-delete_volume" released by "delete_volume" :: held 1.152s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:48:51 devstack cinder-volume[86310]: DEBUG oslo_service.periodic_task [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86310) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 14:48:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:48:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:48:51 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:48:51 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:48:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:48:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:48:51 devstack sudo[103127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:48:51 devstack sudo[103127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:48:51 devstack sudo[103127]: pam_unix(sudo:session): session closed for user root Sep 23 14:48:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.271s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:48:51 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:48:51 devstack cinder-volume[86310]: DEBUG oslo_service.periodic_task [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Running periodic task VolumeManager._thread_info {{(pid=86310) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 14:48:51 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] thread count: 28 {{(pid=86310) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 14:48:51 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] thread info: [<_MainThread(MainThread, started 128854208852096)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86310) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 14:48:55 devstack cinder-volume[86310]: DEBUG dbcounter [-] [86310] Writing DB stats cinder:SELECT=8,cinder:UPDATE=8,cinder:INSERT=2 {{(pid=86310) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 14:48:55 devstack cinder-volume[86310]: DEBUG dbcounter [-] [86310] Writing DB stats cinder:SELECT=4,cinder:INSERT=2,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=86310) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 14:49:00 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-68d9a5e2-4670-4a66-973f-ebb86d8812cb tempest-VolumeAndVolumeTypeFromImageTest-1553207140 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:49:00 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-68d9a5e2-4670-4a66-973f-ebb86d8812cb tempest-VolumeAndVolumeTypeFromImageTest-1553207140 None] Flow 'volume_create_manager' (fb164039-0a04-4e7b-b8e6-c4d87f7c4a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:49:00 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-68d9a5e2-4670-4a66-973f-ebb86d8812cb tempest-VolumeAndVolumeTypeFromImageTest-1553207140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2034872-3806-4da0-85a7-66092447ac61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:49:00 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-68d9a5e2-4670-4a66-973f-ebb86d8812cb tempest-VolumeAndVolumeTypeFromImageTest-1553207140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2034872-3806-4da0-85a7-66092447ac61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:49:00Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8ab7686-843f-44c7-8ac5-262a83dc94ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7085eba9840b43088c560b187a5e3c9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:49:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:49:00Z,use_quota=True,user_id='158f41dc7827412cbe92a7b6ef4f7737',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2dacff78-df66-42de-816a-d57a9f2b7367),volume_type_id=2dacff78-df66-42de-816a-d57a9f2b7367)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:49:00 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-68d9a5e2-4670-4a66-973f-ebb86d8812cb tempest-VolumeAndVolumeTypeFromImageTest-1553207140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (256c5e94-48f4-419f-a8a8-25cfdc63f6f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:49:00 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-68d9a5e2-4670-4a66-973f-ebb86d8812cb tempest-VolumeAndVolumeTypeFromImageTest-1553207140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (256c5e94-48f4-419f-a8a8-25cfdc63f6f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:49:00 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-68d9a5e2-4670-4a66-973f-ebb86d8812cb tempest-VolumeAndVolumeTypeFromImageTest-1553207140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af0dd029-2096-4067-bc31-82e0d18e5b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:49:00 devstack cinder-volume[86310]: DEBUG cinder.image.glance [None req-68d9a5e2-4670-4a66-973f-ebb86d8812cb tempest-VolumeAndVolumeTypeFromImageTest-1553207140 None] Creating Keystone auth plugin from conf {{(pid=86310) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 23 14:49:00 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-68d9a5e2-4670-4a66-973f-ebb86d8812cb tempest-VolumeAndVolumeTypeFromImageTest-1553207140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af0dd029-2096-4067-bc31-82e0d18e5b57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b8ab7686-843f-44c7-8ac5-262a83dc94ff', 'volume_name': 'volume-b8ab7686-843f-44c7-8ac5-262a83dc94ff', 'volume_size': 1, 'image_id': 'f3292ab8-ac31-433c-aa3b-f796b8685fda', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f3292ab8-ac31-433c-aa3b-f796b8685fda', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ab9646d612307806be73df34590557fb', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7085eba9840b43088c560b187a5e3c9b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ba7038064b744f7f9fa52be1c2f81881bc84ba674845d5aa0a12827426173a11f480cd3cef1ac976eb4fe8ecfe8b8c835ba3032dfef2fee200b2c48586b73eaa', 'id': 'f3292ab8-ac31-433c-aa3b-f796b8685fda', 'created_at': datetime.datetime(2026, 9, 23, 12, 48, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 23, 12, 48, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f3292ab8-ac31-433c-aa3b-f796b8685fda/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:49:00 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-68d9a5e2-4670-4a66-973f-ebb86d8812cb tempest-VolumeAndVolumeTypeFromImageTest-1553207140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81f93667-116d-420f-a48e-ba46b6add8f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:49:00 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-68d9a5e2-4670-4a66-973f-ebb86d8812cb tempest-VolumeAndVolumeTypeFromImageTest-1553207140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81f93667-116d-420f-a48e-ba46b6add8f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:49:00 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-68d9a5e2-4670-4a66-973f-ebb86d8812cb tempest-VolumeAndVolumeTypeFromImageTest-1553207140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22b3a7be-cba5-4f9e-85de-598612928c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:49:00 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-68d9a5e2-4670-4a66-973f-ebb86d8812cb tempest-VolumeAndVolumeTypeFromImageTest-1553207140 None] Volume b8ab7686-843f-44c7-8ac5-262a83dc94ff: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b8ab7686-843f-44c7-8ac5-262a83dc94ff', 'volume_size': 1, 'image_id': 'f3292ab8-ac31-433c-aa3b-f796b8685fda', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f3292ab8-ac31-433c-aa3b-f796b8685fda', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ab9646d612307806be73df34590557fb', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7085eba9840b43088c560b187a5e3c9b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ba7038064b744f7f9fa52be1c2f81881bc84ba674845d5aa0a12827426173a11f480cd3cef1ac976eb4fe8ecfe8b8c835ba3032dfef2fee200b2c48586b73eaa', 'id': 'f3292ab8-ac31-433c-aa3b-f796b8685fda', 'created_at': datetime.datetime(2026, 9, 23, 12, 48, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 23, 12, 48, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f3292ab8-ac31-433c-aa3b-f796b8685fda/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 23 14:49:00 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-68d9a5e2-4670-4a66-973f-ebb86d8812cb tempest-VolumeAndVolumeTypeFromImageTest-1553207140 None] Trying to clone b8ab7686-843f-44c7-8ac5-262a83dc94ff from image f3292ab8-ac31-433c-aa3b-f796b8685fda at location (None, [{'url': 'file:///opt/stack/data/glance/images/f3292ab8-ac31-433c-aa3b-f796b8685fda', 'metadata': {}}]). {{(pid=86310) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 23 14:49:00 devstack cinder-volume[86310]: DEBUG cinder.image.image_utils [None req-68d9a5e2-4670-4a66-973f-ebb86d8812cb tempest-VolumeAndVolumeTypeFromImageTest-1553207140 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f3292ab8-ac31-433c-aa3b-f796b8685fda_3g6z1cazdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86310) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 23 14:49:00 devstack cinder-volume[86310]: INFO cinder.image.image_utils [None req-68d9a5e2-4670-4a66-973f-ebb86d8812cb tempest-VolumeAndVolumeTypeFromImageTest-1553207140 None] Image download 0.00 MB at 0.00 MB/s Sep 23 14:49:00 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec20ab3-8f1e-4ced-9f69-3b194aed8eea]: (4, 'raw') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:49:00 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-68d9a5e2-4670-4a66-973f-ebb86d8812cb tempest-VolumeAndVolumeTypeFromImageTest-1553207140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f3292ab8-ac31-433c-aa3b-f796b8685fda_3g6z1cazdevstack@QuobyteHD {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:49:00 devstack sudo[103132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f3292ab8-ac31-433c-aa3b-f796b8685fda_3g6z1cazdevstack@QuobyteHD Sep 23 14:49:00 devstack sudo[103132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:49:00 devstack sudo[103132]: pam_unix(sudo:session): session closed for user root Sep 23 14:49:00 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-68d9a5e2-4670-4a66-973f-ebb86d8812cb tempest-VolumeAndVolumeTypeFromImageTest-1553207140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f3292ab8-ac31-433c-aa3b-f796b8685fda_3g6z1cazdevstack@QuobyteHD" returned: 0 in 0.327s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:49:00 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-68d9a5e2-4670-4a66-973f-ebb86d8812cb tempest-VolumeAndVolumeTypeFromImageTest-1553207140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f3292ab8-ac31-433c-aa3b-f796b8685fda_3g6z1cazdevstack@QuobyteHD {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:49:00 devstack sudo[103136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f3292ab8-ac31-433c-aa3b-f796b8685fda_3g6z1cazdevstack@QuobyteHD Sep 23 14:49:00 devstack sudo[103136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:49:01 devstack sudo[103136]: pam_unix(sudo:session): session closed for user root Sep 23 14:49:01 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-68d9a5e2-4670-4a66-973f-ebb86d8812cb tempest-VolumeAndVolumeTypeFromImageTest-1553207140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f3292ab8-ac31-433c-aa3b-f796b8685fda_3g6z1cazdevstack@QuobyteHD" returned: 1 in 0.324s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:49:01 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-68d9a5e2-4670-4a66-973f-ebb86d8812cb tempest-VolumeAndVolumeTypeFromImageTest-1553207140 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f3292ab8-ac31-433c-aa3b-f796b8685fda_3g6z1cazdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 14:49:01 devstack cinder-volume[86310]: DEBUG cinder.image.image_utils [None req-68d9a5e2-4670-4a66-973f-ebb86d8812cb tempest-VolumeAndVolumeTypeFromImageTest-1553207140 None] Temporary image f3292ab8-ac31-433c-aa3b-f796b8685fda is fetched for user 158f41dc7827412cbe92a7b6ef4f7737. {{(pid=86310) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 23 14:49:01 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[3370e520-ae19-4b84-aa88-8dd75542cc97]: (4, 'raw') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:49:01 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-68d9a5e2-4670-4a66-973f-ebb86d8812cb tempest-VolumeAndVolumeTypeFromImageTest-1553207140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f3292ab8-ac31-433c-aa3b-f796b8685fda_3g6z1cazdevstack@QuobyteHD {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:49:01 devstack sudo[103141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f3292ab8-ac31-433c-aa3b-f796b8685fda_3g6z1cazdevstack@QuobyteHD Sep 23 14:49:01 devstack sudo[103141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:49:01 devstack sudo[103141]: pam_unix(sudo:session): session closed for user root Sep 23 14:49:01 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-68d9a5e2-4670-4a66-973f-ebb86d8812cb tempest-VolumeAndVolumeTypeFromImageTest-1553207140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f3292ab8-ac31-433c-aa3b-f796b8685fda_3g6z1cazdevstack@QuobyteHD" returned: 0 in 0.316s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:49:01 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-68d9a5e2-4670-4a66-973f-ebb86d8812cb tempest-VolumeAndVolumeTypeFromImageTest-1553207140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f3292ab8-ac31-433c-aa3b-f796b8685fda_3g6z1cazdevstack@QuobyteHD {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:49:01 devstack sudo[103145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f3292ab8-ac31-433c-aa3b-f796b8685fda_3g6z1cazdevstack@QuobyteHD Sep 23 14:49:01 devstack sudo[103145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:49:01 devstack sudo[103145]: pam_unix(sudo:session): session closed for user root Sep 23 14:49:01 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-68d9a5e2-4670-4a66-973f-ebb86d8812cb tempest-VolumeAndVolumeTypeFromImageTest-1553207140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f3292ab8-ac31-433c-aa3b-f796b8685fda_3g6z1cazdevstack@QuobyteHD" returned: 1 in 0.327s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:49:01 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-68d9a5e2-4670-4a66-973f-ebb86d8812cb tempest-VolumeAndVolumeTypeFromImageTest-1553207140 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f3292ab8-ac31-433c-aa3b-f796b8685fda_3g6z1cazdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 14:49:01 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-68d9a5e2-4670-4a66-973f-ebb86d8812cb tempest-VolumeAndVolumeTypeFromImageTest-1553207140 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:49:01 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-68d9a5e2-4670-4a66-973f-ebb86d8812cb tempest-VolumeAndVolumeTypeFromImageTest-1553207140 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:49:01 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-68d9a5e2-4670-4a66-973f-ebb86d8812cb tempest-VolumeAndVolumeTypeFromImageTest-1553207140 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:49:00Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8ab7686-843f-44c7-8ac5-262a83dc94ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7085eba9840b43088c560b187a5e3c9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:49:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:49:00Z,use_quota=True,user_id='158f41dc7827412cbe92a7b6ef4f7737',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2dacff78-df66-42de-816a-d57a9f2b7367),volume_type_id=2dacff78-df66-42de-816a-d57a9f2b7367)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:49:01 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-68d9a5e2-4670-4a66-973f-ebb86d8812cb tempest-VolumeAndVolumeTypeFromImageTest-1553207140 None] Creating volume b8ab7686-843f-44c7-8ac5-262a83dc94ff {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:49:01 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-68d9a5e2-4670-4a66-973f-ebb86d8812cb tempest-VolumeAndVolumeTypeFromImageTest-1553207140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:49:01 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-68d9a5e2-4670-4a66-973f-ebb86d8812cb tempest-VolumeAndVolumeTypeFromImageTest-1553207140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:49:01 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-68d9a5e2-4670-4a66-973f-ebb86d8812cb tempest-VolumeAndVolumeTypeFromImageTest-1553207140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:49:01 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-68d9a5e2-4670-4a66-973f-ebb86d8812cb tempest-VolumeAndVolumeTypeFromImageTest-1553207140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:49:01 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-68d9a5e2-4670-4a66-973f-ebb86d8812cb tempest-VolumeAndVolumeTypeFromImageTest-1553207140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:49:01 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-68d9a5e2-4670-4a66-973f-ebb86d8812cb tempest-VolumeAndVolumeTypeFromImageTest-1553207140 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:49:01 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-68d9a5e2-4670-4a66-973f-ebb86d8812cb tempest-VolumeAndVolumeTypeFromImageTest-1553207140 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:49:01 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-68d9a5e2-4670-4a66-973f-ebb86d8812cb tempest-VolumeAndVolumeTypeFromImageTest-1553207140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b8ab7686-843f-44c7-8ac5-262a83dc94ff 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:49:01 devstack sudo[103150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b8ab7686-843f-44c7-8ac5-262a83dc94ff 1073741824 Sep 23 14:49:01 devstack sudo[103150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:49:02 devstack sudo[103150]: pam_unix(sudo:session): session closed for user root Sep 23 14:49:02 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-68d9a5e2-4670-4a66-973f-ebb86d8812cb tempest-VolumeAndVolumeTypeFromImageTest-1553207140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b8ab7686-843f-44c7-8ac5-262a83dc94ff 1073741824" returned: 0 in 0.397s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:49:02 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-68d9a5e2-4670-4a66-973f-ebb86d8812cb tempest-VolumeAndVolumeTypeFromImageTest-1553207140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b8ab7686-843f-44c7-8ac5-262a83dc94ff {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:49:02 devstack sudo[103156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b8ab7686-843f-44c7-8ac5-262a83dc94ff Sep 23 14:49:02 devstack sudo[103156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:49:02 devstack sudo[103156]: pam_unix(sudo:session): session closed for user root Sep 23 14:49:02 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-68d9a5e2-4670-4a66-973f-ebb86d8812cb tempest-VolumeAndVolumeTypeFromImageTest-1553207140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b8ab7686-843f-44c7-8ac5-262a83dc94ff" returned: 0 in 0.245s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:49:02 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-68d9a5e2-4670-4a66-973f-ebb86d8812cb tempest-VolumeAndVolumeTypeFromImageTest-1553207140 None] <== create_volume: return (682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:49:02 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-68d9a5e2-4670-4a66-973f-ebb86d8812cb tempest-VolumeAndVolumeTypeFromImageTest-1553207140 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.686s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:49:02 devstack cinder-volume[86310]: DEBUG cinder.volume.volume_utils [None req-68d9a5e2-4670-4a66-973f-ebb86d8812cb tempest-VolumeAndVolumeTypeFromImageTest-1553207140 None] Attempting download of f3292ab8-ac31-433c-aa3b-f796b8685fda ((None, [{'url': 'file:///opt/stack/data/glance/images/f3292ab8-ac31-433c-aa3b-f796b8685fda', 'metadata': {}}])) to volume b8ab7686-843f-44c7-8ac5-262a83dc94ff. {{(pid=86310) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 23 14:49:02 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[20325b9f-a4a7-4cec-a9c1-ae83a36f13af]: (4, 'raw') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:49:02 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-68d9a5e2-4670-4a66-973f-ebb86d8812cb tempest-VolumeAndVolumeTypeFromImageTest-1553207140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f3292ab8-ac31-433c-aa3b-f796b8685fda_1_i8a73p {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:49:02 devstack sudo[103159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f3292ab8-ac31-433c-aa3b-f796b8685fda_1_i8a73p Sep 23 14:49:02 devstack sudo[103159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:49:02 devstack sudo[103159]: pam_unix(sudo:session): session closed for user root Sep 23 14:49:02 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-68d9a5e2-4670-4a66-973f-ebb86d8812cb tempest-VolumeAndVolumeTypeFromImageTest-1553207140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f3292ab8-ac31-433c-aa3b-f796b8685fda_1_i8a73p" returned: 0 in 0.318s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:49:02 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-68d9a5e2-4670-4a66-973f-ebb86d8812cb tempest-VolumeAndVolumeTypeFromImageTest-1553207140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f3292ab8-ac31-433c-aa3b-f796b8685fda_1_i8a73p {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:49:03 devstack sudo[103164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f3292ab8-ac31-433c-aa3b-f796b8685fda_1_i8a73p Sep 23 14:49:03 devstack sudo[103164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:49:03 devstack sudo[103164]: pam_unix(sudo:session): session closed for user root Sep 23 14:49:03 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-68d9a5e2-4670-4a66-973f-ebb86d8812cb tempest-VolumeAndVolumeTypeFromImageTest-1553207140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f3292ab8-ac31-433c-aa3b-f796b8685fda_1_i8a73p" returned: 1 in 0.313s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:49:03 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-68d9a5e2-4670-4a66-973f-ebb86d8812cb tempest-VolumeAndVolumeTypeFromImageTest-1553207140 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f3292ab8-ac31-433c-aa3b-f796b8685fda_1_i8a73p' failed. Not Retrying. {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 14:49:03 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[a871fdc2-290c-47ab-b929-81c8880261b0]: (4, 'raw') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:49:03 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-68d9a5e2-4670-4a66-973f-ebb86d8812cb tempest-VolumeAndVolumeTypeFromImageTest-1553207140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f3292ab8-ac31-433c-aa3b-f796b8685fda_3g6z1cazdevstack@QuobyteHD {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:49:03 devstack sudo[103168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f3292ab8-ac31-433c-aa3b-f796b8685fda_3g6z1cazdevstack@QuobyteHD Sep 23 14:49:03 devstack sudo[103168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:49:03 devstack sudo[103168]: pam_unix(sudo:session): session closed for user root Sep 23 14:49:03 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-68d9a5e2-4670-4a66-973f-ebb86d8812cb tempest-VolumeAndVolumeTypeFromImageTest-1553207140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f3292ab8-ac31-433c-aa3b-f796b8685fda_3g6z1cazdevstack@QuobyteHD" returned: 0 in 0.311s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:49:03 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-68d9a5e2-4670-4a66-973f-ebb86d8812cb tempest-VolumeAndVolumeTypeFromImageTest-1553207140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f3292ab8-ac31-433c-aa3b-f796b8685fda_3g6z1cazdevstack@QuobyteHD {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:49:03 devstack sudo[103172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f3292ab8-ac31-433c-aa3b-f796b8685fda_3g6z1cazdevstack@QuobyteHD Sep 23 14:49:03 devstack sudo[103172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:49:03 devstack sudo[103172]: pam_unix(sudo:session): session closed for user root Sep 23 14:49:03 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-68d9a5e2-4670-4a66-973f-ebb86d8812cb tempest-VolumeAndVolumeTypeFromImageTest-1553207140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f3292ab8-ac31-433c-aa3b-f796b8685fda_3g6z1cazdevstack@QuobyteHD" returned: 1 in 0.311s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:49:03 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-68d9a5e2-4670-4a66-973f-ebb86d8812cb tempest-VolumeAndVolumeTypeFromImageTest-1553207140 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f3292ab8-ac31-433c-aa3b-f796b8685fda_3g6z1cazdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 14:49:03 devstack cinder-volume[86310]: DEBUG cinder.image.image_utils [None req-68d9a5e2-4670-4a66-973f-ebb86d8812cb tempest-VolumeAndVolumeTypeFromImageTest-1553207140 None] f3292ab8-ac31-433c-aa3b-f796b8685fda was raw, converting to qcow2 {{(pid=86310) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 23 14:49:03 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-68d9a5e2-4670-4a66-973f-ebb86d8812cb tempest-VolumeAndVolumeTypeFromImageTest-1553207140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f3292ab8-ac31-433c-aa3b-f796b8685fda_3g6z1cazdevstack@QuobyteHD /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b8ab7686-843f-44c7-8ac5-262a83dc94ff {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:49:03 devstack sudo[103177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f3292ab8-ac31-433c-aa3b-f796b8685fda_3g6z1cazdevstack@QuobyteHD /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b8ab7686-843f-44c7-8ac5-262a83dc94ff Sep 23 14:49:03 devstack sudo[103177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:49:04 devstack sudo[103177]: pam_unix(sudo:session): session closed for user root Sep 23 14:49:04 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-68d9a5e2-4670-4a66-973f-ebb86d8812cb tempest-VolumeAndVolumeTypeFromImageTest-1553207140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f3292ab8-ac31-433c-aa3b-f796b8685fda_3g6z1cazdevstack@QuobyteHD /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b8ab7686-843f-44c7-8ac5-262a83dc94ff" returned: 0 in 0.423s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:49:04 devstack cinder-volume[86310]: DEBUG cinder.image.image_utils [None req-68d9a5e2-4670-4a66-973f-ebb86d8812cb tempest-VolumeAndVolumeTypeFromImageTest-1553207140 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f3292ab8-ac31-433c-aa3b-f796b8685fda_3g6z1cazdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b8ab7686-843f-44c7-8ac5-262a83dc94ff {{(pid=86310) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 14:49:04 devstack cinder-volume[86310]: INFO cinder.image.image_utils [None req-68d9a5e2-4670-4a66-973f-ebb86d8812cb tempest-VolumeAndVolumeTypeFromImageTest-1553207140 None] Converted 0.00 MB image at 0.00 MB/s Sep 23 14:49:04 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-68d9a5e2-4670-4a66-973f-ebb86d8812cb tempest-VolumeAndVolumeTypeFromImageTest-1553207140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b8ab7686-843f-44c7-8ac5-262a83dc94ff 1G {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:49:04 devstack sudo[103183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b8ab7686-843f-44c7-8ac5-262a83dc94ff 1G Sep 23 14:49:04 devstack sudo[103183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:49:04 devstack sudo[103183]: pam_unix(sudo:session): session closed for user root Sep 23 14:49:04 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-68d9a5e2-4670-4a66-973f-ebb86d8812cb tempest-VolumeAndVolumeTypeFromImageTest-1553207140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b8ab7686-843f-44c7-8ac5-262a83dc94ff 1G" returned: 0 in 0.293s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:49:04 devstack cinder-volume[86310]: DEBUG cinder.volume.volume_utils [None req-68d9a5e2-4670-4a66-973f-ebb86d8812cb tempest-VolumeAndVolumeTypeFromImageTest-1553207140 None] Downloaded image f3292ab8-ac31-433c-aa3b-f796b8685fda ((None, [{'url': 'file:///opt/stack/data/glance/images/f3292ab8-ac31-433c-aa3b-f796b8685fda', 'metadata': {}}])) to volume b8ab7686-843f-44c7-8ac5-262a83dc94ff successfully. {{(pid=86310) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 23 14:49:04 devstack cinder-volume[86310]: DEBUG cinder.image.image_utils [None req-68d9a5e2-4670-4a66-973f-ebb86d8812cb tempest-VolumeAndVolumeTypeFromImageTest-1553207140 None] Temporary image f3292ab8-ac31-433c-aa3b-f796b8685fda for user 158f41dc7827412cbe92a7b6ef4f7737 is deleted. {{(pid=86310) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 23 14:49:04 devstack cinder-volume[86310]: DEBUG cinder.volume.volume_utils [None req-68d9a5e2-4670-4a66-973f-ebb86d8812cb tempest-VolumeAndVolumeTypeFromImageTest-1553207140 None] Marking volume b8ab7686-843f-44c7-8ac5-262a83dc94ff as bootable. {{(pid=86310) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 23 14:49:04 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-68d9a5e2-4670-4a66-973f-ebb86d8812cb tempest-VolumeAndVolumeTypeFromImageTest-1553207140 None] Copying metadata from image f3292ab8-ac31-433c-aa3b-f796b8685fda to b8ab7686-843f-44c7-8ac5-262a83dc94ff. {{(pid=86310) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 23 14:49:04 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-68d9a5e2-4670-4a66-973f-ebb86d8812cb tempest-VolumeAndVolumeTypeFromImageTest-1553207140 None] Creating volume glance metadata for volume b8ab7686-843f-44c7-8ac5-262a83dc94ff backed by image f3292ab8-ac31-433c-aa3b-f796b8685fda with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'f3292ab8-ac31-433c-aa3b-f796b8685fda', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'ab9646d612307806be73df34590557fb', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86310) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 23 14:49:04 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-68d9a5e2-4670-4a66-973f-ebb86d8812cb tempest-VolumeAndVolumeTypeFromImageTest-1553207140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22b3a7be-cba5-4f9e-85de-598612928c88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8ab7686-843f-44c7-8ac5-262a83dc94ff', 'volume_size': 1, 'image_id': 'f3292ab8-ac31-433c-aa3b-f796b8685fda', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f3292ab8-ac31-433c-aa3b-f796b8685fda', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ab9646d612307806be73df34590557fb', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7085eba9840b43088c560b187a5e3c9b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ba7038064b744f7f9fa52be1c2f81881bc84ba674845d5aa0a12827426173a11f480cd3cef1ac976eb4fe8ecfe8b8c835ba3032dfef2fee200b2c48586b73eaa', 'id': 'f3292ab8-ac31-433c-aa3b-f796b8685fda', 'created_at': datetime.datetime(2026, 9, 23, 12, 48, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 23, 12, 48, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f3292ab8-ac31-433c-aa3b-f796b8685fda/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:49:04 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-68d9a5e2-4670-4a66-973f-ebb86d8812cb tempest-VolumeAndVolumeTypeFromImageTest-1553207140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39236073-735f-455d-8eed-b34114c9399b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:49:04 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-68d9a5e2-4670-4a66-973f-ebb86d8812cb tempest-VolumeAndVolumeTypeFromImageTest-1553207140 None] Volume volume-b8ab7686-843f-44c7-8ac5-262a83dc94ff (b8ab7686-843f-44c7-8ac5-262a83dc94ff): created successfully Sep 23 14:49:04 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-68d9a5e2-4670-4a66-973f-ebb86d8812cb tempest-VolumeAndVolumeTypeFromImageTest-1553207140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39236073-735f-455d-8eed-b34114c9399b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:49:04 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-68d9a5e2-4670-4a66-973f-ebb86d8812cb tempest-VolumeAndVolumeTypeFromImageTest-1553207140 None] Flow 'volume_create_manager' (fb164039-0a04-4e7b-b8e6-c4d87f7c4a59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:49:04 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-68d9a5e2-4670-4a66-973f-ebb86d8812cb tempest-VolumeAndVolumeTypeFromImageTest-1553207140 None] Created volume successfully. Sep 23 14:49:05 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-715bc0d9-cbcb-4a08-8be0-972e8ad6c6a3 tempest-VolumeAndVolumeTypeFromImageTest-1553207140 None] Acquiring lock "cinder-b8ab7686-843f-44c7-8ac5-262a83dc94ff-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:49:05 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-715bc0d9-cbcb-4a08-8be0-972e8ad6c6a3 tempest-VolumeAndVolumeTypeFromImageTest-1553207140 None] Lock "cinder-b8ab7686-843f-44c7-8ac5-262a83dc94ff-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:49:05 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-715bc0d9-cbcb-4a08-8be0-972e8ad6c6a3 tempest-VolumeAndVolumeTypeFromImageTest-1553207140 None] Acquiring lock "cinder-quobyte-b8ab7686-843f-44c7-8ac5-262a83dc94ff" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:49:05 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-715bc0d9-cbcb-4a08-8be0-972e8ad6c6a3 tempest-VolumeAndVolumeTypeFromImageTest-1553207140 None] Lock "cinder-quobyte-b8ab7686-843f-44c7-8ac5-262a83dc94ff" acquired by "delete_volume" :: waited 0.013s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:49:05 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[da76afb1-b6e1-4b44-bab0-b2d20c2d99f5]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:49:05 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-715bc0d9-cbcb-4a08-8be0-972e8ad6c6a3 tempest-VolumeAndVolumeTypeFromImageTest-1553207140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b8ab7686-843f-44c7-8ac5-262a83dc94ff {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:49:05 devstack sudo[103188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b8ab7686-843f-44c7-8ac5-262a83dc94ff Sep 23 14:49:05 devstack sudo[103188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:49:05 devstack sudo[103188]: pam_unix(sudo:session): session closed for user root Sep 23 14:49:05 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-715bc0d9-cbcb-4a08-8be0-972e8ad6c6a3 tempest-VolumeAndVolumeTypeFromImageTest-1553207140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b8ab7686-843f-44c7-8ac5-262a83dc94ff" returned: 0 in 0.352s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:49:05 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-715bc0d9-cbcb-4a08-8be0-972e8ad6c6a3 tempest-VolumeAndVolumeTypeFromImageTest-1553207140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b8ab7686-843f-44c7-8ac5-262a83dc94ff {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:49:05 devstack sudo[103193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b8ab7686-843f-44c7-8ac5-262a83dc94ff Sep 23 14:49:05 devstack sudo[103193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:49:06 devstack sudo[103193]: pam_unix(sudo:session): session closed for user root Sep 23 14:49:06 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-715bc0d9-cbcb-4a08-8be0-972e8ad6c6a3 tempest-VolumeAndVolumeTypeFromImageTest-1553207140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b8ab7686-843f-44c7-8ac5-262a83dc94ff" returned: 0 in 0.244s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:49:06 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-715bc0d9-cbcb-4a08-8be0-972e8ad6c6a3 tempest-VolumeAndVolumeTypeFromImageTest-1553207140 None] Lock "cinder-quobyte-b8ab7686-843f-44c7-8ac5-262a83dc94ff" released by "delete_volume" :: held 0.640s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:49:06 devstack cinder-volume[86310]: WARNING cinder.quota [None req-715bc0d9-cbcb-4a08-8be0-972e8ad6c6a3 tempest-VolumeAndVolumeTypeFromImageTest-1553207140 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 23 14:49:06 devstack cinder-volume[86310]: WARNING cinder.quota [None req-715bc0d9-cbcb-4a08-8be0-972e8ad6c6a3 tempest-VolumeAndVolumeTypeFromImageTest-1553207140 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 23 14:49:06 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-715bc0d9-cbcb-4a08-8be0-972e8ad6c6a3 tempest-VolumeAndVolumeTypeFromImageTest-1553207140 None] Created reservations ['b1b388a8-8d67-4391-8e63-18cb75197285', 'ae761503-509f-402f-a688-fba56fb79c4c', '0de69360-4038-4275-b9fe-719d64dbda70', '8414b6ce-e192-4ff9-91ab-24838249c121'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:49:06 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-715bc0d9-cbcb-4a08-8be0-972e8ad6c6a3 tempest-VolumeAndVolumeTypeFromImageTest-1553207140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:49:06 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-715bc0d9-cbcb-4a08-8be0-972e8ad6c6a3 tempest-VolumeAndVolumeTypeFromImageTest-1553207140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:49:06 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-715bc0d9-cbcb-4a08-8be0-972e8ad6c6a3 tempest-VolumeAndVolumeTypeFromImageTest-1553207140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:49:06 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-715bc0d9-cbcb-4a08-8be0-972e8ad6c6a3 tempest-VolumeAndVolumeTypeFromImageTest-1553207140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:49:06 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-715bc0d9-cbcb-4a08-8be0-972e8ad6c6a3 tempest-VolumeAndVolumeTypeFromImageTest-1553207140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:49:06 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-715bc0d9-cbcb-4a08-8be0-972e8ad6c6a3 tempest-VolumeAndVolumeTypeFromImageTest-1553207140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:49:06 devstack sudo[103196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:49:06 devstack sudo[103196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:49:06 devstack sudo[103196]: pam_unix(sudo:session): session closed for user root Sep 23 14:49:06 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-715bc0d9-cbcb-4a08-8be0-972e8ad6c6a3 tempest-VolumeAndVolumeTypeFromImageTest-1553207140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.238s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:49:06 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-715bc0d9-cbcb-4a08-8be0-972e8ad6c6a3 tempest-VolumeAndVolumeTypeFromImageTest-1553207140 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:49:06 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-715bc0d9-cbcb-4a08-8be0-972e8ad6c6a3 tempest-VolumeAndVolumeTypeFromImageTest-1553207140 None] Deleted volume successfully. Sep 23 14:49:06 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-715bc0d9-cbcb-4a08-8be0-972e8ad6c6a3 tempest-VolumeAndVolumeTypeFromImageTest-1553207140 None] Lock "cinder-b8ab7686-843f-44c7-8ac5-262a83dc94ff-delete_volume" released by "delete_volume" :: held 1.156s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:49:10 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a17440b-70a1-4659-ac57-a18ae0ae25d2 tempest-CreateVolumesFromSnapshotTest-383178896 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:49:10 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-2a17440b-70a1-4659-ac57-a18ae0ae25d2 tempest-CreateVolumesFromSnapshotTest-383178896 None] Flow 'volume_create_manager' (1e3923a4-2822-4b08-b5e8-1e2214e76571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:49:10 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-2a17440b-70a1-4659-ac57-a18ae0ae25d2 tempest-CreateVolumesFromSnapshotTest-383178896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (750b4708-29d7-4a22-8325-cdd1a7abf1a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:49:10 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-2a17440b-70a1-4659-ac57-a18ae0ae25d2 tempest-CreateVolumesFromSnapshotTest-383178896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (750b4708-29d7-4a22-8325-cdd1a7abf1a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:49:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-368129743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a964103-df4b-46bb-956e-99b87e969909,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45ad44c461e44beeb7fb525ecdccf630',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:49:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:49:11Z,use_quota=True,user_id='b4914dc42a7c4440b721a76d60ccd238',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:49:10 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-2a17440b-70a1-4659-ac57-a18ae0ae25d2 tempest-CreateVolumesFromSnapshotTest-383178896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c32a293-f974-49b3-9cf9-98f2c1dbd489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:49:10 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-2a17440b-70a1-4659-ac57-a18ae0ae25d2 tempest-CreateVolumesFromSnapshotTest-383178896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c32a293-f974-49b3-9cf9-98f2c1dbd489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:49:10 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-2a17440b-70a1-4659-ac57-a18ae0ae25d2 tempest-CreateVolumesFromSnapshotTest-383178896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e43f3ff4-a6de-4c7a-9944-c9a90954786e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:49:10 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-2a17440b-70a1-4659-ac57-a18ae0ae25d2 tempest-CreateVolumesFromSnapshotTest-383178896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e43f3ff4-a6de-4c7a-9944-c9a90954786e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a964103-df4b-46bb-956e-99b87e969909', 'volume_name': 'volume-8a964103-df4b-46bb-956e-99b87e969909', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:49:10 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-2a17440b-70a1-4659-ac57-a18ae0ae25d2 tempest-CreateVolumesFromSnapshotTest-383178896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38330c0a-cb0f-4b11-a123-e4aff88210e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:49:10 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-2a17440b-70a1-4659-ac57-a18ae0ae25d2 tempest-CreateVolumesFromSnapshotTest-383178896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38330c0a-cb0f-4b11-a123-e4aff88210e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:49:10 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-2a17440b-70a1-4659-ac57-a18ae0ae25d2 tempest-CreateVolumesFromSnapshotTest-383178896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de7b0d8e-ac22-45b5-a63e-24f8a85c5bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:49:10 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-2a17440b-70a1-4659-ac57-a18ae0ae25d2 tempest-CreateVolumesFromSnapshotTest-383178896 None] Volume 8a964103-df4b-46bb-956e-99b87e969909: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a964103-df4b-46bb-956e-99b87e969909', 'volume_size': 1} Sep 23 14:49:10 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-2a17440b-70a1-4659-ac57-a18ae0ae25d2 tempest-CreateVolumesFromSnapshotTest-383178896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:49:10 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-2a17440b-70a1-4659-ac57-a18ae0ae25d2 tempest-CreateVolumesFromSnapshotTest-383178896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:49:10 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-2a17440b-70a1-4659-ac57-a18ae0ae25d2 tempest-CreateVolumesFromSnapshotTest-383178896 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:49:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-368129743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a964103-df4b-46bb-956e-99b87e969909,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45ad44c461e44beeb7fb525ecdccf630',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:49:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:49:11Z,use_quota=True,user_id='b4914dc42a7c4440b721a76d60ccd238',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:49:10 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-2a17440b-70a1-4659-ac57-a18ae0ae25d2 tempest-CreateVolumesFromSnapshotTest-383178896 None] Creating volume 8a964103-df4b-46bb-956e-99b87e969909 {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:49:10 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-2a17440b-70a1-4659-ac57-a18ae0ae25d2 tempest-CreateVolumesFromSnapshotTest-383178896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:49:10 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-2a17440b-70a1-4659-ac57-a18ae0ae25d2 tempest-CreateVolumesFromSnapshotTest-383178896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:49:10 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-2a17440b-70a1-4659-ac57-a18ae0ae25d2 tempest-CreateVolumesFromSnapshotTest-383178896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:49:10 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-2a17440b-70a1-4659-ac57-a18ae0ae25d2 tempest-CreateVolumesFromSnapshotTest-383178896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:49:10 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-2a17440b-70a1-4659-ac57-a18ae0ae25d2 tempest-CreateVolumesFromSnapshotTest-383178896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:49:10 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-2a17440b-70a1-4659-ac57-a18ae0ae25d2 tempest-CreateVolumesFromSnapshotTest-383178896 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:49:10 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-2a17440b-70a1-4659-ac57-a18ae0ae25d2 tempest-CreateVolumesFromSnapshotTest-383178896 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:49:10 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-2a17440b-70a1-4659-ac57-a18ae0ae25d2 tempest-CreateVolumesFromSnapshotTest-383178896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8a964103-df4b-46bb-956e-99b87e969909 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:49:10 devstack sudo[103200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8a964103-df4b-46bb-956e-99b87e969909 1073741824 Sep 23 14:49:10 devstack sudo[103200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:49:11 devstack sudo[103200]: pam_unix(sudo:session): session closed for user root Sep 23 14:49:11 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-2a17440b-70a1-4659-ac57-a18ae0ae25d2 tempest-CreateVolumesFromSnapshotTest-383178896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8a964103-df4b-46bb-956e-99b87e969909 1073741824" returned: 0 in 0.407s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:49:11 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-2a17440b-70a1-4659-ac57-a18ae0ae25d2 tempest-CreateVolumesFromSnapshotTest-383178896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8a964103-df4b-46bb-956e-99b87e969909 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:49:11 devstack sudo[103209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8a964103-df4b-46bb-956e-99b87e969909 Sep 23 14:49:11 devstack sudo[103209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:49:11 devstack sudo[103209]: pam_unix(sudo:session): session closed for user root Sep 23 14:49:11 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-2a17440b-70a1-4659-ac57-a18ae0ae25d2 tempest-CreateVolumesFromSnapshotTest-383178896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8a964103-df4b-46bb-956e-99b87e969909" returned: 0 in 0.244s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:49:11 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-2a17440b-70a1-4659-ac57-a18ae0ae25d2 tempest-CreateVolumesFromSnapshotTest-383178896 None] <== create_volume: return (691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:49:11 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-2a17440b-70a1-4659-ac57-a18ae0ae25d2 tempest-CreateVolumesFromSnapshotTest-383178896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.694s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:49:11 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-2a17440b-70a1-4659-ac57-a18ae0ae25d2 tempest-CreateVolumesFromSnapshotTest-383178896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de7b0d8e-ac22-45b5-a63e-24f8a85c5bb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a964103-df4b-46bb-956e-99b87e969909', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:49:11 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-2a17440b-70a1-4659-ac57-a18ae0ae25d2 tempest-CreateVolumesFromSnapshotTest-383178896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14015385-3146-425a-89bf-6fea73c9c596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:49:11 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-2a17440b-70a1-4659-ac57-a18ae0ae25d2 tempest-CreateVolumesFromSnapshotTest-383178896 None] Volume volume-8a964103-df4b-46bb-956e-99b87e969909 (8a964103-df4b-46bb-956e-99b87e969909): created successfully Sep 23 14:49:11 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-2a17440b-70a1-4659-ac57-a18ae0ae25d2 tempest-CreateVolumesFromSnapshotTest-383178896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14015385-3146-425a-89bf-6fea73c9c596) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:49:11 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-2a17440b-70a1-4659-ac57-a18ae0ae25d2 tempest-CreateVolumesFromSnapshotTest-383178896 None] Flow 'volume_create_manager' (1e3923a4-2822-4b08-b5e8-1e2214e76571) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:49:11 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-2a17440b-70a1-4659-ac57-a18ae0ae25d2 tempest-CreateVolumesFromSnapshotTest-383178896 None] Created volume successfully. Sep 23 14:49:11 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-78c0cb54-c43d-43c8-8316-796cd2ecfdfe tempest-CreateVolumesFromSnapshotTest-383178896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:49:11 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-78c0cb54-c43d-43c8-8316-796cd2ecfdfe tempest-CreateVolumesFromSnapshotTest-383178896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:49:11 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-78c0cb54-c43d-43c8-8316-796cd2ecfdfe tempest-CreateVolumesFromSnapshotTest-383178896 None] Creating offline snapshot fa707b2a-b6ef-4308-ad22-304b9b808fad of volume 8a964103-df4b-46bb-956e-99b87e969909 {{(pid=86310) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 14:49:11 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9bd964d-b7dc-4fbf-bc84-5d4ea578e324]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:49:11 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-78c0cb54-c43d-43c8-8316-796cd2ecfdfe tempest-CreateVolumesFromSnapshotTest-383178896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8a964103-df4b-46bb-956e-99b87e969909 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:49:11 devstack sudo[103212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8a964103-df4b-46bb-956e-99b87e969909 Sep 23 14:49:11 devstack sudo[103212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:49:12 devstack sudo[103212]: pam_unix(sudo:session): session closed for user root Sep 23 14:49:12 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-78c0cb54-c43d-43c8-8316-796cd2ecfdfe tempest-CreateVolumesFromSnapshotTest-383178896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8a964103-df4b-46bb-956e-99b87e969909" returned: 0 in 0.364s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:49:12 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-78c0cb54-c43d-43c8-8316-796cd2ecfdfe tempest-CreateVolumesFromSnapshotTest-383178896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8a964103-df4b-46bb-956e-99b87e969909,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8a964103-df4b-46bb-956e-99b87e969909.fa707b2a-b6ef-4308-ad22-304b9b808fad 1G {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:49:12 devstack sudo[103217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8a964103-df4b-46bb-956e-99b87e969909,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8a964103-df4b-46bb-956e-99b87e969909.fa707b2a-b6ef-4308-ad22-304b9b808fad 1G Sep 23 14:49:12 devstack sudo[103217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:49:12 devstack sudo[103217]: pam_unix(sudo:session): session closed for user root Sep 23 14:49:12 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-78c0cb54-c43d-43c8-8316-796cd2ecfdfe tempest-CreateVolumesFromSnapshotTest-383178896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8a964103-df4b-46bb-956e-99b87e969909,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8a964103-df4b-46bb-956e-99b87e969909.fa707b2a-b6ef-4308-ad22-304b9b808fad 1G" returned: 0 in 0.393s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:49:12 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-78c0cb54-c43d-43c8-8316-796cd2ecfdfe tempest-CreateVolumesFromSnapshotTest-383178896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a964103-df4b-46bb-956e-99b87e969909 -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8a964103-df4b-46bb-956e-99b87e969909.fa707b2a-b6ef-4308-ad22-304b9b808fad {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:49:12 devstack sudo[103223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a964103-df4b-46bb-956e-99b87e969909 -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8a964103-df4b-46bb-956e-99b87e969909.fa707b2a-b6ef-4308-ad22-304b9b808fad Sep 23 14:49:12 devstack sudo[103223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:49:12 devstack sudo[103223]: pam_unix(sudo:session): session closed for user root Sep 23 14:49:12 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-78c0cb54-c43d-43c8-8316-796cd2ecfdfe tempest-CreateVolumesFromSnapshotTest-383178896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a964103-df4b-46bb-956e-99b87e969909 -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8a964103-df4b-46bb-956e-99b87e969909.fa707b2a-b6ef-4308-ad22-304b9b808fad" returned: 0 in 0.292s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:49:12 devstack cinder-volume[86310]: WARNING cinder.volume.drivers.remotefs [None req-78c0cb54-c43d-43c8-8316-796cd2ecfdfe tempest-CreateVolumesFromSnapshotTest-383178896 None] /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8a964103-df4b-46bb-956e-99b87e969909.fa707b2a-b6ef-4308-ad22-304b9b808fad is being set with open permissions: ugo+rw Sep 23 14:49:12 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-78c0cb54-c43d-43c8-8316-796cd2ecfdfe tempest-CreateVolumesFromSnapshotTest-383178896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8a964103-df4b-46bb-956e-99b87e969909.fa707b2a-b6ef-4308-ad22-304b9b808fad {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:49:12 devstack sudo[103230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8a964103-df4b-46bb-956e-99b87e969909.fa707b2a-b6ef-4308-ad22-304b9b808fad Sep 23 14:49:12 devstack sudo[103230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:49:13 devstack sudo[103230]: pam_unix(sudo:session): session closed for user root Sep 23 14:49:13 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-78c0cb54-c43d-43c8-8316-796cd2ecfdfe tempest-CreateVolumesFromSnapshotTest-383178896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8a964103-df4b-46bb-956e-99b87e969909.fa707b2a-b6ef-4308-ad22-304b9b808fad" returned: 0 in 0.248s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:49:13 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-78c0cb54-c43d-43c8-8316-796cd2ecfdfe tempest-CreateVolumesFromSnapshotTest-383178896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8a964103-df4b-46bb-956e-99b87e969909.info {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:49:13 devstack sudo[103233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8a964103-df4b-46bb-956e-99b87e969909.info Sep 23 14:49:13 devstack sudo[103233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:49:13 devstack sudo[103233]: pam_unix(sudo:session): session closed for user root Sep 23 14:49:13 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-78c0cb54-c43d-43c8-8316-796cd2ecfdfe tempest-CreateVolumesFromSnapshotTest-383178896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8a964103-df4b-46bb-956e-99b87e969909.info" returned: 0 in 0.239s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:49:13 devstack cinder-volume[86310]: WARNING cinder.volume.drivers.remotefs [None req-78c0cb54-c43d-43c8-8316-796cd2ecfdfe tempest-CreateVolumesFromSnapshotTest-383178896 None] /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8a964103-df4b-46bb-956e-99b87e969909.info is being set with open permissions: ugo+rw Sep 23 14:49:13 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-78c0cb54-c43d-43c8-8316-796cd2ecfdfe tempest-CreateVolumesFromSnapshotTest-383178896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8a964103-df4b-46bb-956e-99b87e969909.info {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:49:13 devstack sudo[103236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8a964103-df4b-46bb-956e-99b87e969909.info Sep 23 14:49:13 devstack sudo[103236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:49:13 devstack sudo[103236]: pam_unix(sudo:session): session closed for user root Sep 23 14:49:13 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-78c0cb54-c43d-43c8-8316-796cd2ecfdfe tempest-CreateVolumesFromSnapshotTest-383178896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8a964103-df4b-46bb-956e-99b87e969909.info" returned: 0 in 0.234s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:49:13 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-78c0cb54-c43d-43c8-8316-796cd2ecfdfe tempest-CreateVolumesFromSnapshotTest-383178896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.865s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:49:13 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-78c0cb54-c43d-43c8-8316-796cd2ecfdfe tempest-CreateVolumesFromSnapshotTest-383178896 None] Create snapshot completed successfully Sep 23 14:49:14 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-68ce3f79-4832-4319-9828-0644f2a0df02 tempest-CreateVolumesFromSnapshotTest-383178896 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:49:14 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-68ce3f79-4832-4319-9828-0644f2a0df02 tempest-CreateVolumesFromSnapshotTest-383178896 None] Flow 'volume_create_manager' (43fc9c2c-1bcf-49f7-b65f-e6d71a9fd070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:49:14 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-68ce3f79-4832-4319-9828-0644f2a0df02 tempest-CreateVolumesFromSnapshotTest-383178896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (187ecb1e-00ea-4ab7-b107-08fb5e0e1581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:49:14 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-68ce3f79-4832-4319-9828-0644f2a0df02 tempest-CreateVolumesFromSnapshotTest-383178896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (187ecb1e-00ea-4ab7-b107-08fb5e0e1581) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:49:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1869812457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cff9a9a-4004-40ce-b13f-7ca1bda98e04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45ad44c461e44beeb7fb525ecdccf630',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:49:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:49:14Z,use_quota=True,user_id='b4914dc42a7c4440b721a76d60ccd238',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:49:14 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-68ce3f79-4832-4319-9828-0644f2a0df02 tempest-CreateVolumesFromSnapshotTest-383178896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35b99c3e-890b-41a6-a835-0448538fc1af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:49:14 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-68ce3f79-4832-4319-9828-0644f2a0df02 tempest-CreateVolumesFromSnapshotTest-383178896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35b99c3e-890b-41a6-a835-0448538fc1af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:49:14 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-68ce3f79-4832-4319-9828-0644f2a0df02 tempest-CreateVolumesFromSnapshotTest-383178896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d06133e-b0be-41c7-81c4-a13b23d54e3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:49:14 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-68ce3f79-4832-4319-9828-0644f2a0df02 tempest-CreateVolumesFromSnapshotTest-383178896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d06133e-b0be-41c7-81c4-a13b23d54e3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7cff9a9a-4004-40ce-b13f-7ca1bda98e04', 'volume_name': 'volume-7cff9a9a-4004-40ce-b13f-7ca1bda98e04', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:49:14 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-68ce3f79-4832-4319-9828-0644f2a0df02 tempest-CreateVolumesFromSnapshotTest-383178896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76af8493-192e-4658-812e-d9c9d818a0ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:49:14 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-68ce3f79-4832-4319-9828-0644f2a0df02 tempest-CreateVolumesFromSnapshotTest-383178896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76af8493-192e-4658-812e-d9c9d818a0ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:49:14 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-68ce3f79-4832-4319-9828-0644f2a0df02 tempest-CreateVolumesFromSnapshotTest-383178896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (666996a1-f37e-4053-91b8-11e28e85e19c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:49:14 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-68ce3f79-4832-4319-9828-0644f2a0df02 tempest-CreateVolumesFromSnapshotTest-383178896 None] Volume 7cff9a9a-4004-40ce-b13f-7ca1bda98e04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7cff9a9a-4004-40ce-b13f-7ca1bda98e04', 'volume_size': 1} Sep 23 14:49:14 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-68ce3f79-4832-4319-9828-0644f2a0df02 tempest-CreateVolumesFromSnapshotTest-383178896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:49:14 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-68ce3f79-4832-4319-9828-0644f2a0df02 tempest-CreateVolumesFromSnapshotTest-383178896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:49:14 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-68ce3f79-4832-4319-9828-0644f2a0df02 tempest-CreateVolumesFromSnapshotTest-383178896 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:49:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1869812457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cff9a9a-4004-40ce-b13f-7ca1bda98e04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45ad44c461e44beeb7fb525ecdccf630',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:49:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:49:14Z,use_quota=True,user_id='b4914dc42a7c4440b721a76d60ccd238',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:49:14 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-68ce3f79-4832-4319-9828-0644f2a0df02 tempest-CreateVolumesFromSnapshotTest-383178896 None] Creating volume 7cff9a9a-4004-40ce-b13f-7ca1bda98e04 {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:49:14 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-68ce3f79-4832-4319-9828-0644f2a0df02 tempest-CreateVolumesFromSnapshotTest-383178896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:49:14 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-68ce3f79-4832-4319-9828-0644f2a0df02 tempest-CreateVolumesFromSnapshotTest-383178896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:49:14 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-68ce3f79-4832-4319-9828-0644f2a0df02 tempest-CreateVolumesFromSnapshotTest-383178896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:49:14 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-68ce3f79-4832-4319-9828-0644f2a0df02 tempest-CreateVolumesFromSnapshotTest-383178896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:49:14 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-68ce3f79-4832-4319-9828-0644f2a0df02 tempest-CreateVolumesFromSnapshotTest-383178896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:49:14 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-68ce3f79-4832-4319-9828-0644f2a0df02 tempest-CreateVolumesFromSnapshotTest-383178896 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:49:14 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-68ce3f79-4832-4319-9828-0644f2a0df02 tempest-CreateVolumesFromSnapshotTest-383178896 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:49:14 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-68ce3f79-4832-4319-9828-0644f2a0df02 tempest-CreateVolumesFromSnapshotTest-383178896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7cff9a9a-4004-40ce-b13f-7ca1bda98e04 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:49:14 devstack sudo[103239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7cff9a9a-4004-40ce-b13f-7ca1bda98e04 1073741824 Sep 23 14:49:14 devstack sudo[103239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:49:14 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a961959-88bb-4b71-b3d0-abae3c309ff7 tempest-CreateVolumesFromSnapshotTest-383178896 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:49:14 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-6a961959-88bb-4b71-b3d0-abae3c309ff7 tempest-CreateVolumesFromSnapshotTest-383178896 None] Flow 'volume_create_manager' (47a1a0e5-3458-4d7d-b85d-e53c689fc81d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:49:14 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-6a961959-88bb-4b71-b3d0-abae3c309ff7 tempest-CreateVolumesFromSnapshotTest-383178896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (200e0e6a-5669-4c46-b370-90d929822ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:49:14 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-6a961959-88bb-4b71-b3d0-abae3c309ff7 tempest-CreateVolumesFromSnapshotTest-383178896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (200e0e6a-5669-4c46-b370-90d929822ed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:49:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1552318830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea0f01d7-9dc4-4290-aafc-197d0305a4bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45ad44c461e44beeb7fb525ecdccf630',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:49:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:49:15Z,use_quota=True,user_id='b4914dc42a7c4440b721a76d60ccd238',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:49:14 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-6a961959-88bb-4b71-b3d0-abae3c309ff7 tempest-CreateVolumesFromSnapshotTest-383178896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59688ca7-0bef-4758-92a4-91da0a4dde8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:49:14 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-6a961959-88bb-4b71-b3d0-abae3c309ff7 tempest-CreateVolumesFromSnapshotTest-383178896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59688ca7-0bef-4758-92a4-91da0a4dde8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:49:14 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-6a961959-88bb-4b71-b3d0-abae3c309ff7 tempest-CreateVolumesFromSnapshotTest-383178896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31747bd7-d22b-4cea-9f1c-b93e9d8260e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:49:14 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-6a961959-88bb-4b71-b3d0-abae3c309ff7 tempest-CreateVolumesFromSnapshotTest-383178896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31747bd7-d22b-4cea-9f1c-b93e9d8260e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea0f01d7-9dc4-4290-aafc-197d0305a4bd', 'volume_name': 'volume-ea0f01d7-9dc4-4290-aafc-197d0305a4bd', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:49:14 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-6a961959-88bb-4b71-b3d0-abae3c309ff7 tempest-CreateVolumesFromSnapshotTest-383178896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bac76b7f-6f13-4646-9252-f6ca9d8eade6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:49:14 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-6a961959-88bb-4b71-b3d0-abae3c309ff7 tempest-CreateVolumesFromSnapshotTest-383178896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bac76b7f-6f13-4646-9252-f6ca9d8eade6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:49:14 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-6a961959-88bb-4b71-b3d0-abae3c309ff7 tempest-CreateVolumesFromSnapshotTest-383178896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b54a12f9-95d9-41ce-a108-16e0b3c0ee5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:49:14 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-6a961959-88bb-4b71-b3d0-abae3c309ff7 tempest-CreateVolumesFromSnapshotTest-383178896 None] Volume ea0f01d7-9dc4-4290-aafc-197d0305a4bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea0f01d7-9dc4-4290-aafc-197d0305a4bd', 'volume_size': 1} Sep 23 14:49:14 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-6a961959-88bb-4b71-b3d0-abae3c309ff7 tempest-CreateVolumesFromSnapshotTest-383178896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:49:14 devstack sudo[103239]: pam_unix(sudo:session): session closed for user root Sep 23 14:49:14 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-68ce3f79-4832-4319-9828-0644f2a0df02 tempest-CreateVolumesFromSnapshotTest-383178896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7cff9a9a-4004-40ce-b13f-7ca1bda98e04 1073741824" returned: 0 in 0.484s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:49:14 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-68ce3f79-4832-4319-9828-0644f2a0df02 tempest-CreateVolumesFromSnapshotTest-383178896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7cff9a9a-4004-40ce-b13f-7ca1bda98e04 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:49:14 devstack sudo[103245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7cff9a9a-4004-40ce-b13f-7ca1bda98e04 Sep 23 14:49:14 devstack sudo[103245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:49:15 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e6fc41b-bb46-4f45-99a7-0d54c440a299 tempest-CreateVolumesFromSnapshotTest-383178896 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:49:15 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-1e6fc41b-bb46-4f45-99a7-0d54c440a299 tempest-CreateVolumesFromSnapshotTest-383178896 None] Flow 'volume_create_manager' (f220a1b2-9066-4124-8ead-ed8c34c0fd92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:49:15 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-1e6fc41b-bb46-4f45-99a7-0d54c440a299 tempest-CreateVolumesFromSnapshotTest-383178896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7829225-89af-4502-9121-fc671c2383e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:49:15 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-1e6fc41b-bb46-4f45-99a7-0d54c440a299 tempest-CreateVolumesFromSnapshotTest-383178896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7829225-89af-4502-9121-fc671c2383e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:49:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1112689118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d6e3e55-4aea-418e-83fa-ee22c5c5bd1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45ad44c461e44beeb7fb525ecdccf630',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:49:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:49:15Z,use_quota=True,user_id='b4914dc42a7c4440b721a76d60ccd238',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:49:15 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-1e6fc41b-bb46-4f45-99a7-0d54c440a299 tempest-CreateVolumesFromSnapshotTest-383178896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07540e75-ec11-43bc-b7c9-1e3515b4c138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:49:15 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-1e6fc41b-bb46-4f45-99a7-0d54c440a299 tempest-CreateVolumesFromSnapshotTest-383178896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07540e75-ec11-43bc-b7c9-1e3515b4c138) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:49:15 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-1e6fc41b-bb46-4f45-99a7-0d54c440a299 tempest-CreateVolumesFromSnapshotTest-383178896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (508968a0-cac2-4f73-ad30-32877f7d2de1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:49:15 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-1e6fc41b-bb46-4f45-99a7-0d54c440a299 tempest-CreateVolumesFromSnapshotTest-383178896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (508968a0-cac2-4f73-ad30-32877f7d2de1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d6e3e55-4aea-418e-83fa-ee22c5c5bd1d', 'volume_name': 'volume-6d6e3e55-4aea-418e-83fa-ee22c5c5bd1d', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:49:15 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-1e6fc41b-bb46-4f45-99a7-0d54c440a299 tempest-CreateVolumesFromSnapshotTest-383178896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e49a67f8-812e-4448-ba9f-f857b995e98f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:49:15 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-1e6fc41b-bb46-4f45-99a7-0d54c440a299 tempest-CreateVolumesFromSnapshotTest-383178896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e49a67f8-812e-4448-ba9f-f857b995e98f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:49:15 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-1e6fc41b-bb46-4f45-99a7-0d54c440a299 tempest-CreateVolumesFromSnapshotTest-383178896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d9cac9b-c2c1-4243-baa5-847ac9433e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:49:15 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-1e6fc41b-bb46-4f45-99a7-0d54c440a299 tempest-CreateVolumesFromSnapshotTest-383178896 None] Volume 6d6e3e55-4aea-418e-83fa-ee22c5c5bd1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d6e3e55-4aea-418e-83fa-ee22c5c5bd1d', 'volume_size': 1} Sep 23 14:49:15 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-1e6fc41b-bb46-4f45-99a7-0d54c440a299 tempest-CreateVolumesFromSnapshotTest-383178896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:49:15 devstack sudo[103245]: pam_unix(sudo:session): session closed for user root Sep 23 14:49:15 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-68ce3f79-4832-4319-9828-0644f2a0df02 tempest-CreateVolumesFromSnapshotTest-383178896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7cff9a9a-4004-40ce-b13f-7ca1bda98e04" returned: 0 in 0.265s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:49:15 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-68ce3f79-4832-4319-9828-0644f2a0df02 tempest-CreateVolumesFromSnapshotTest-383178896 None] <== create_volume: return (793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:49:15 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-68ce3f79-4832-4319-9828-0644f2a0df02 tempest-CreateVolumesFromSnapshotTest-383178896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.796s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:49:15 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-6a961959-88bb-4b71-b3d0-abae3c309ff7 tempest-CreateVolumesFromSnapshotTest-383178896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.458s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:49:15 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-6a961959-88bb-4b71-b3d0-abae3c309ff7 tempest-CreateVolumesFromSnapshotTest-383178896 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:49:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1552318830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea0f01d7-9dc4-4290-aafc-197d0305a4bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45ad44c461e44beeb7fb525ecdccf630',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:49:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:49:15Z,use_quota=True,user_id='b4914dc42a7c4440b721a76d60ccd238',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:49:15 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-6a961959-88bb-4b71-b3d0-abae3c309ff7 tempest-CreateVolumesFromSnapshotTest-383178896 None] Creating volume ea0f01d7-9dc4-4290-aafc-197d0305a4bd {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:49:15 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-6a961959-88bb-4b71-b3d0-abae3c309ff7 tempest-CreateVolumesFromSnapshotTest-383178896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:49:15 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-6a961959-88bb-4b71-b3d0-abae3c309ff7 tempest-CreateVolumesFromSnapshotTest-383178896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:49:15 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-6a961959-88bb-4b71-b3d0-abae3c309ff7 tempest-CreateVolumesFromSnapshotTest-383178896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:49:15 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-6a961959-88bb-4b71-b3d0-abae3c309ff7 tempest-CreateVolumesFromSnapshotTest-383178896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:49:15 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-6a961959-88bb-4b71-b3d0-abae3c309ff7 tempest-CreateVolumesFromSnapshotTest-383178896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:49:15 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-6a961959-88bb-4b71-b3d0-abae3c309ff7 tempest-CreateVolumesFromSnapshotTest-383178896 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:49:15 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-6a961959-88bb-4b71-b3d0-abae3c309ff7 tempest-CreateVolumesFromSnapshotTest-383178896 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:49:15 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-6a961959-88bb-4b71-b3d0-abae3c309ff7 tempest-CreateVolumesFromSnapshotTest-383178896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-ea0f01d7-9dc4-4290-aafc-197d0305a4bd 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:49:15 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-68ce3f79-4832-4319-9828-0644f2a0df02 tempest-CreateVolumesFromSnapshotTest-383178896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (666996a1-f37e-4053-91b8-11e28e85e19c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cff9a9a-4004-40ce-b13f-7ca1bda98e04', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:49:15 devstack sudo[103248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-ea0f01d7-9dc4-4290-aafc-197d0305a4bd 1073741824 Sep 23 14:49:15 devstack sudo[103248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:49:15 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-68ce3f79-4832-4319-9828-0644f2a0df02 tempest-CreateVolumesFromSnapshotTest-383178896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1775c2c-33b9-4c93-91d8-c35d50c3c572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:49:15 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-68ce3f79-4832-4319-9828-0644f2a0df02 tempest-CreateVolumesFromSnapshotTest-383178896 None] Volume volume-7cff9a9a-4004-40ce-b13f-7ca1bda98e04 (7cff9a9a-4004-40ce-b13f-7ca1bda98e04): created successfully Sep 23 14:49:15 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-68ce3f79-4832-4319-9828-0644f2a0df02 tempest-CreateVolumesFromSnapshotTest-383178896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1775c2c-33b9-4c93-91d8-c35d50c3c572) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:49:15 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-68ce3f79-4832-4319-9828-0644f2a0df02 tempest-CreateVolumesFromSnapshotTest-383178896 None] Flow 'volume_create_manager' (43fc9c2c-1bcf-49f7-b65f-e6d71a9fd070) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:49:15 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-68ce3f79-4832-4319-9828-0644f2a0df02 tempest-CreateVolumesFromSnapshotTest-383178896 None] Created volume successfully. Sep 23 14:49:15 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d9b386f-c372-4340-a13e-972949e3dd68 tempest-CreateVolumesFromSnapshotTest-383178896 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:49:15 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-2d9b386f-c372-4340-a13e-972949e3dd68 tempest-CreateVolumesFromSnapshotTest-383178896 None] Flow 'volume_create_manager' (aeadc6dd-9b13-490a-8522-1c2a516cb0e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:49:15 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-2d9b386f-c372-4340-a13e-972949e3dd68 tempest-CreateVolumesFromSnapshotTest-383178896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d3aa3c9-6a2d-4d74-a073-1ef3e8f3047d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:49:15 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-2d9b386f-c372-4340-a13e-972949e3dd68 tempest-CreateVolumesFromSnapshotTest-383178896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d3aa3c9-6a2d-4d74-a073-1ef3e8f3047d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:49:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-416604507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=743ee55d-5b92-4364-86cf-22af1102f02c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45ad44c461e44beeb7fb525ecdccf630',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:49:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:49:15Z,use_quota=True,user_id='b4914dc42a7c4440b721a76d60ccd238',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:49:15 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-2d9b386f-c372-4340-a13e-972949e3dd68 tempest-CreateVolumesFromSnapshotTest-383178896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e90e09dd-d43f-4f4e-acb6-482e80746e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:49:15 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-2d9b386f-c372-4340-a13e-972949e3dd68 tempest-CreateVolumesFromSnapshotTest-383178896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e90e09dd-d43f-4f4e-acb6-482e80746e97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:49:15 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-2d9b386f-c372-4340-a13e-972949e3dd68 tempest-CreateVolumesFromSnapshotTest-383178896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81045ccc-6173-4163-b17e-09357e79ee2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:49:15 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-2d9b386f-c372-4340-a13e-972949e3dd68 tempest-CreateVolumesFromSnapshotTest-383178896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81045ccc-6173-4163-b17e-09357e79ee2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '743ee55d-5b92-4364-86cf-22af1102f02c', 'volume_name': 'volume-743ee55d-5b92-4364-86cf-22af1102f02c', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:49:15 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-2d9b386f-c372-4340-a13e-972949e3dd68 tempest-CreateVolumesFromSnapshotTest-383178896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c482f41-ad08-46f2-849e-9f89d18580c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:49:15 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-2d9b386f-c372-4340-a13e-972949e3dd68 tempest-CreateVolumesFromSnapshotTest-383178896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c482f41-ad08-46f2-849e-9f89d18580c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:49:15 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-2d9b386f-c372-4340-a13e-972949e3dd68 tempest-CreateVolumesFromSnapshotTest-383178896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0805ea2-e559-4547-8f0a-444231da98b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:49:15 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-2d9b386f-c372-4340-a13e-972949e3dd68 tempest-CreateVolumesFromSnapshotTest-383178896 None] Volume 743ee55d-5b92-4364-86cf-22af1102f02c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-743ee55d-5b92-4364-86cf-22af1102f02c', 'volume_size': 1} Sep 23 14:49:15 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-2d9b386f-c372-4340-a13e-972949e3dd68 tempest-CreateVolumesFromSnapshotTest-383178896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:49:15 devstack sudo[103248]: pam_unix(sudo:session): session closed for user root Sep 23 14:49:15 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-6a961959-88bb-4b71-b3d0-abae3c309ff7 tempest-CreateVolumesFromSnapshotTest-383178896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-ea0f01d7-9dc4-4290-aafc-197d0305a4bd 1073741824" returned: 0 in 0.521s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:49:15 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-707e43a6-ae9c-4942-95c2-6c22a3447dbd tempest-CreateVolumesFromSnapshotTest-383178896 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:49:15 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-707e43a6-ae9c-4942-95c2-6c22a3447dbd tempest-CreateVolumesFromSnapshotTest-383178896 None] Flow 'volume_create_manager' (71bcb36b-958d-4514-8ed2-87e9e3188a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:49:15 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-707e43a6-ae9c-4942-95c2-6c22a3447dbd tempest-CreateVolumesFromSnapshotTest-383178896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e07f78c-b75d-4420-baf8-c850eb1edd62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:49:15 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-6a961959-88bb-4b71-b3d0-abae3c309ff7 tempest-CreateVolumesFromSnapshotTest-383178896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-ea0f01d7-9dc4-4290-aafc-197d0305a4bd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:49:15 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-707e43a6-ae9c-4942-95c2-6c22a3447dbd tempest-CreateVolumesFromSnapshotTest-383178896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e07f78c-b75d-4420-baf8-c850eb1edd62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:49:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1097111739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a868f7a0-aac7-4ee4-a6f6-ff31c2e15791,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45ad44c461e44beeb7fb525ecdccf630',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:49:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:49:16Z,use_quota=True,user_id='b4914dc42a7c4440b721a76d60ccd238',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:49:15 devstack sudo[103254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-ea0f01d7-9dc4-4290-aafc-197d0305a4bd Sep 23 14:49:15 devstack sudo[103254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:49:15 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-707e43a6-ae9c-4942-95c2-6c22a3447dbd tempest-CreateVolumesFromSnapshotTest-383178896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba406cbb-6058-482a-b1b8-084ab025f3de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:49:15 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-707e43a6-ae9c-4942-95c2-6c22a3447dbd tempest-CreateVolumesFromSnapshotTest-383178896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba406cbb-6058-482a-b1b8-084ab025f3de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:49:15 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-707e43a6-ae9c-4942-95c2-6c22a3447dbd tempest-CreateVolumesFromSnapshotTest-383178896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97ba0a19-c2ad-4ec2-8a35-6022b932c819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:49:15 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-707e43a6-ae9c-4942-95c2-6c22a3447dbd tempest-CreateVolumesFromSnapshotTest-383178896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97ba0a19-c2ad-4ec2-8a35-6022b932c819) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a868f7a0-aac7-4ee4-a6f6-ff31c2e15791', 'volume_name': 'volume-a868f7a0-aac7-4ee4-a6f6-ff31c2e15791', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:49:15 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-707e43a6-ae9c-4942-95c2-6c22a3447dbd tempest-CreateVolumesFromSnapshotTest-383178896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94a4353f-417a-4329-8f08-5323ea08f7b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:49:15 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-707e43a6-ae9c-4942-95c2-6c22a3447dbd tempest-CreateVolumesFromSnapshotTest-383178896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94a4353f-417a-4329-8f08-5323ea08f7b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:49:15 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-707e43a6-ae9c-4942-95c2-6c22a3447dbd tempest-CreateVolumesFromSnapshotTest-383178896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9830ddeb-80c7-483e-b3e2-5138cd21c425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:49:15 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-707e43a6-ae9c-4942-95c2-6c22a3447dbd tempest-CreateVolumesFromSnapshotTest-383178896 None] Volume a868f7a0-aac7-4ee4-a6f6-ff31c2e15791: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a868f7a0-aac7-4ee4-a6f6-ff31c2e15791', 'volume_size': 1} Sep 23 14:49:15 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-707e43a6-ae9c-4942-95c2-6c22a3447dbd tempest-CreateVolumesFromSnapshotTest-383178896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:49:16 devstack sudo[103254]: pam_unix(sudo:session): session closed for user root Sep 23 14:49:16 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-6a961959-88bb-4b71-b3d0-abae3c309ff7 tempest-CreateVolumesFromSnapshotTest-383178896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-ea0f01d7-9dc4-4290-aafc-197d0305a4bd" returned: 0 in 0.242s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:49:16 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-6a961959-88bb-4b71-b3d0-abae3c309ff7 tempest-CreateVolumesFromSnapshotTest-383178896 None] <== create_volume: return (838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:49:16 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-6a961959-88bb-4b71-b3d0-abae3c309ff7 tempest-CreateVolumesFromSnapshotTest-383178896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.841s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:49:16 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-1e6fc41b-bb46-4f45-99a7-0d54c440a299 tempest-CreateVolumesFromSnapshotTest-383178896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.914s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:49:16 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-1e6fc41b-bb46-4f45-99a7-0d54c440a299 tempest-CreateVolumesFromSnapshotTest-383178896 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:49:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1112689118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d6e3e55-4aea-418e-83fa-ee22c5c5bd1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45ad44c461e44beeb7fb525ecdccf630',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:49:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:49:15Z,use_quota=True,user_id='b4914dc42a7c4440b721a76d60ccd238',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:49:16 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-1e6fc41b-bb46-4f45-99a7-0d54c440a299 tempest-CreateVolumesFromSnapshotTest-383178896 None] Creating volume 6d6e3e55-4aea-418e-83fa-ee22c5c5bd1d {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:49:16 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-1e6fc41b-bb46-4f45-99a7-0d54c440a299 tempest-CreateVolumesFromSnapshotTest-383178896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:49:16 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-1e6fc41b-bb46-4f45-99a7-0d54c440a299 tempest-CreateVolumesFromSnapshotTest-383178896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:49:16 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-1e6fc41b-bb46-4f45-99a7-0d54c440a299 tempest-CreateVolumesFromSnapshotTest-383178896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:49:16 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-1e6fc41b-bb46-4f45-99a7-0d54c440a299 tempest-CreateVolumesFromSnapshotTest-383178896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:49:16 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-1e6fc41b-bb46-4f45-99a7-0d54c440a299 tempest-CreateVolumesFromSnapshotTest-383178896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:49:16 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-1e6fc41b-bb46-4f45-99a7-0d54c440a299 tempest-CreateVolumesFromSnapshotTest-383178896 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:49:16 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-1e6fc41b-bb46-4f45-99a7-0d54c440a299 tempest-CreateVolumesFromSnapshotTest-383178896 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:49:16 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-1e6fc41b-bb46-4f45-99a7-0d54c440a299 tempest-CreateVolumesFromSnapshotTest-383178896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6d6e3e55-4aea-418e-83fa-ee22c5c5bd1d 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:49:16 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-6a961959-88bb-4b71-b3d0-abae3c309ff7 tempest-CreateVolumesFromSnapshotTest-383178896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b54a12f9-95d9-41ce-a108-16e0b3c0ee5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea0f01d7-9dc4-4290-aafc-197d0305a4bd', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:49:16 devstack sudo[103257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6d6e3e55-4aea-418e-83fa-ee22c5c5bd1d 1073741824 Sep 23 14:49:16 devstack sudo[103257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:49:16 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-6a961959-88bb-4b71-b3d0-abae3c309ff7 tempest-CreateVolumesFromSnapshotTest-383178896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1761e2e-bf6e-4fe0-86ed-fefa7d7d5d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:49:16 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-6a961959-88bb-4b71-b3d0-abae3c309ff7 tempest-CreateVolumesFromSnapshotTest-383178896 None] Volume volume-ea0f01d7-9dc4-4290-aafc-197d0305a4bd (ea0f01d7-9dc4-4290-aafc-197d0305a4bd): created successfully Sep 23 14:49:16 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-6a961959-88bb-4b71-b3d0-abae3c309ff7 tempest-CreateVolumesFromSnapshotTest-383178896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1761e2e-bf6e-4fe0-86ed-fefa7d7d5d9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:49:16 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-6a961959-88bb-4b71-b3d0-abae3c309ff7 tempest-CreateVolumesFromSnapshotTest-383178896 None] Flow 'volume_create_manager' (47a1a0e5-3458-4d7d-b85d-e53c689fc81d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:49:16 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-6a961959-88bb-4b71-b3d0-abae3c309ff7 tempest-CreateVolumesFromSnapshotTest-383178896 None] Created volume successfully. Sep 23 14:49:16 devstack sudo[103257]: pam_unix(sudo:session): session closed for user root Sep 23 14:49:16 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-1e6fc41b-bb46-4f45-99a7-0d54c440a299 tempest-CreateVolumesFromSnapshotTest-383178896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6d6e3e55-4aea-418e-83fa-ee22c5c5bd1d 1073741824" returned: 0 in 0.419s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:49:16 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-1e6fc41b-bb46-4f45-99a7-0d54c440a299 tempest-CreateVolumesFromSnapshotTest-383178896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6d6e3e55-4aea-418e-83fa-ee22c5c5bd1d {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:49:16 devstack sudo[103263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6d6e3e55-4aea-418e-83fa-ee22c5c5bd1d Sep 23 14:49:16 devstack sudo[103263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:49:16 devstack sudo[103263]: pam_unix(sudo:session): session closed for user root Sep 23 14:49:16 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-1e6fc41b-bb46-4f45-99a7-0d54c440a299 tempest-CreateVolumesFromSnapshotTest-383178896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6d6e3e55-4aea-418e-83fa-ee22c5c5bd1d" returned: 0 in 0.241s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:49:16 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-1e6fc41b-bb46-4f45-99a7-0d54c440a299 tempest-CreateVolumesFromSnapshotTest-383178896 None] <== create_volume: return (698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:49:16 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-1e6fc41b-bb46-4f45-99a7-0d54c440a299 tempest-CreateVolumesFromSnapshotTest-383178896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.700s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:49:16 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-2d9b386f-c372-4340-a13e-972949e3dd68 tempest-CreateVolumesFromSnapshotTest-383178896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.242s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:49:16 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-2d9b386f-c372-4340-a13e-972949e3dd68 tempest-CreateVolumesFromSnapshotTest-383178896 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:49:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-416604507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=743ee55d-5b92-4364-86cf-22af1102f02c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45ad44c461e44beeb7fb525ecdccf630',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:49:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:49:15Z,use_quota=True,user_id='b4914dc42a7c4440b721a76d60ccd238',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:49:16 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-2d9b386f-c372-4340-a13e-972949e3dd68 tempest-CreateVolumesFromSnapshotTest-383178896 None] Creating volume 743ee55d-5b92-4364-86cf-22af1102f02c {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:49:16 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-2d9b386f-c372-4340-a13e-972949e3dd68 tempest-CreateVolumesFromSnapshotTest-383178896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:49:16 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-2d9b386f-c372-4340-a13e-972949e3dd68 tempest-CreateVolumesFromSnapshotTest-383178896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:49:16 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-2d9b386f-c372-4340-a13e-972949e3dd68 tempest-CreateVolumesFromSnapshotTest-383178896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:49:16 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-2d9b386f-c372-4340-a13e-972949e3dd68 tempest-CreateVolumesFromSnapshotTest-383178896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:49:16 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-2d9b386f-c372-4340-a13e-972949e3dd68 tempest-CreateVolumesFromSnapshotTest-383178896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:49:16 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-2d9b386f-c372-4340-a13e-972949e3dd68 tempest-CreateVolumesFromSnapshotTest-383178896 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:49:16 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-2d9b386f-c372-4340-a13e-972949e3dd68 tempest-CreateVolumesFromSnapshotTest-383178896 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:49:16 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-2d9b386f-c372-4340-a13e-972949e3dd68 tempest-CreateVolumesFromSnapshotTest-383178896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-743ee55d-5b92-4364-86cf-22af1102f02c 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:49:16 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-1e6fc41b-bb46-4f45-99a7-0d54c440a299 tempest-CreateVolumesFromSnapshotTest-383178896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d9cac9b-c2c1-4243-baa5-847ac9433e4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d6e3e55-4aea-418e-83fa-ee22c5c5bd1d', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:49:16 devstack sudo[103266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-743ee55d-5b92-4364-86cf-22af1102f02c 1073741824 Sep 23 14:49:16 devstack sudo[103266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:49:16 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-1e6fc41b-bb46-4f45-99a7-0d54c440a299 tempest-CreateVolumesFromSnapshotTest-383178896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02f27cf7-80b8-4f16-b443-4cfb1f4a2922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:49:16 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-1e6fc41b-bb46-4f45-99a7-0d54c440a299 tempest-CreateVolumesFromSnapshotTest-383178896 None] Volume volume-6d6e3e55-4aea-418e-83fa-ee22c5c5bd1d (6d6e3e55-4aea-418e-83fa-ee22c5c5bd1d): created successfully Sep 23 14:49:16 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-1e6fc41b-bb46-4f45-99a7-0d54c440a299 tempest-CreateVolumesFromSnapshotTest-383178896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02f27cf7-80b8-4f16-b443-4cfb1f4a2922) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:49:16 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-1e6fc41b-bb46-4f45-99a7-0d54c440a299 tempest-CreateVolumesFromSnapshotTest-383178896 None] Flow 'volume_create_manager' (f220a1b2-9066-4124-8ead-ed8c34c0fd92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:49:16 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-1e6fc41b-bb46-4f45-99a7-0d54c440a299 tempest-CreateVolumesFromSnapshotTest-383178896 None] Created volume successfully. Sep 23 14:49:17 devstack sudo[103266]: pam_unix(sudo:session): session closed for user root Sep 23 14:49:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-2d9b386f-c372-4340-a13e-972949e3dd68 tempest-CreateVolumesFromSnapshotTest-383178896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-743ee55d-5b92-4364-86cf-22af1102f02c 1073741824" returned: 0 in 0.434s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:49:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-2d9b386f-c372-4340-a13e-972949e3dd68 tempest-CreateVolumesFromSnapshotTest-383178896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-743ee55d-5b92-4364-86cf-22af1102f02c {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:49:17 devstack sudo[103272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-743ee55d-5b92-4364-86cf-22af1102f02c Sep 23 14:49:17 devstack sudo[103272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:49:17 devstack sudo[103272]: pam_unix(sudo:session): session closed for user root Sep 23 14:49:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-2d9b386f-c372-4340-a13e-972949e3dd68 tempest-CreateVolumesFromSnapshotTest-383178896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-743ee55d-5b92-4364-86cf-22af1102f02c" returned: 0 in 0.237s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:49:17 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-2d9b386f-c372-4340-a13e-972949e3dd68 tempest-CreateVolumesFromSnapshotTest-383178896 None] <== create_volume: return (712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:49:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-2d9b386f-c372-4340-a13e-972949e3dd68 tempest-CreateVolumesFromSnapshotTest-383178896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.715s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:49:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-707e43a6-ae9c-4942-95c2-6c22a3447dbd tempest-CreateVolumesFromSnapshotTest-383178896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.607s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:49:17 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-707e43a6-ae9c-4942-95c2-6c22a3447dbd tempest-CreateVolumesFromSnapshotTest-383178896 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:49:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1097111739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a868f7a0-aac7-4ee4-a6f6-ff31c2e15791,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45ad44c461e44beeb7fb525ecdccf630',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:49:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:49:16Z,use_quota=True,user_id='b4914dc42a7c4440b721a76d60ccd238',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:49:17 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-707e43a6-ae9c-4942-95c2-6c22a3447dbd tempest-CreateVolumesFromSnapshotTest-383178896 None] Creating volume a868f7a0-aac7-4ee4-a6f6-ff31c2e15791 {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:49:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-707e43a6-ae9c-4942-95c2-6c22a3447dbd tempest-CreateVolumesFromSnapshotTest-383178896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:49:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-707e43a6-ae9c-4942-95c2-6c22a3447dbd tempest-CreateVolumesFromSnapshotTest-383178896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:49:17 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-707e43a6-ae9c-4942-95c2-6c22a3447dbd tempest-CreateVolumesFromSnapshotTest-383178896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:49:17 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-707e43a6-ae9c-4942-95c2-6c22a3447dbd tempest-CreateVolumesFromSnapshotTest-383178896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:49:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-707e43a6-ae9c-4942-95c2-6c22a3447dbd tempest-CreateVolumesFromSnapshotTest-383178896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:49:17 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-707e43a6-ae9c-4942-95c2-6c22a3447dbd tempest-CreateVolumesFromSnapshotTest-383178896 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:49:17 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-707e43a6-ae9c-4942-95c2-6c22a3447dbd tempest-CreateVolumesFromSnapshotTest-383178896 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:49:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-707e43a6-ae9c-4942-95c2-6c22a3447dbd tempest-CreateVolumesFromSnapshotTest-383178896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-a868f7a0-aac7-4ee4-a6f6-ff31c2e15791 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:49:17 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-2d9b386f-c372-4340-a13e-972949e3dd68 tempest-CreateVolumesFromSnapshotTest-383178896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0805ea2-e559-4547-8f0a-444231da98b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-743ee55d-5b92-4364-86cf-22af1102f02c', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:49:17 devstack sudo[103275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-a868f7a0-aac7-4ee4-a6f6-ff31c2e15791 1073741824 Sep 23 14:49:17 devstack sudo[103275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:49:17 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-2d9b386f-c372-4340-a13e-972949e3dd68 tempest-CreateVolumesFromSnapshotTest-383178896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac15aaf9-1871-46b6-993c-ff263b9e4c25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:49:17 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-2d9b386f-c372-4340-a13e-972949e3dd68 tempest-CreateVolumesFromSnapshotTest-383178896 None] Volume volume-743ee55d-5b92-4364-86cf-22af1102f02c (743ee55d-5b92-4364-86cf-22af1102f02c): created successfully Sep 23 14:49:17 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-2d9b386f-c372-4340-a13e-972949e3dd68 tempest-CreateVolumesFromSnapshotTest-383178896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac15aaf9-1871-46b6-993c-ff263b9e4c25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:49:17 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-2d9b386f-c372-4340-a13e-972949e3dd68 tempest-CreateVolumesFromSnapshotTest-383178896 None] Flow 'volume_create_manager' (aeadc6dd-9b13-490a-8522-1c2a516cb0e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:49:17 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-2d9b386f-c372-4340-a13e-972949e3dd68 tempest-CreateVolumesFromSnapshotTest-383178896 None] Created volume successfully. Sep 23 14:49:17 devstack sudo[103275]: pam_unix(sudo:session): session closed for user root Sep 23 14:49:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-707e43a6-ae9c-4942-95c2-6c22a3447dbd tempest-CreateVolumesFromSnapshotTest-383178896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-a868f7a0-aac7-4ee4-a6f6-ff31c2e15791 1073741824" returned: 0 in 0.435s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:49:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-707e43a6-ae9c-4942-95c2-6c22a3447dbd tempest-CreateVolumesFromSnapshotTest-383178896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-a868f7a0-aac7-4ee4-a6f6-ff31c2e15791 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:49:17 devstack sudo[103281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-a868f7a0-aac7-4ee4-a6f6-ff31c2e15791 Sep 23 14:49:17 devstack sudo[103281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:49:18 devstack sudo[103281]: pam_unix(sudo:session): session closed for user root Sep 23 14:49:18 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-707e43a6-ae9c-4942-95c2-6c22a3447dbd tempest-CreateVolumesFromSnapshotTest-383178896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-a868f7a0-aac7-4ee4-a6f6-ff31c2e15791" returned: 0 in 0.256s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:49:18 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-707e43a6-ae9c-4942-95c2-6c22a3447dbd tempest-CreateVolumesFromSnapshotTest-383178896 None] <== create_volume: return (741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:49:18 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-707e43a6-ae9c-4942-95c2-6c22a3447dbd tempest-CreateVolumesFromSnapshotTest-383178896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.743s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:49:18 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-707e43a6-ae9c-4942-95c2-6c22a3447dbd tempest-CreateVolumesFromSnapshotTest-383178896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9830ddeb-80c7-483e-b3e2-5138cd21c425) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a868f7a0-aac7-4ee4-a6f6-ff31c2e15791', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:49:18 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-707e43a6-ae9c-4942-95c2-6c22a3447dbd tempest-CreateVolumesFromSnapshotTest-383178896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcaaf81f-b8e7-4504-a4ad-c64203fa229d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:49:18 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-707e43a6-ae9c-4942-95c2-6c22a3447dbd tempest-CreateVolumesFromSnapshotTest-383178896 None] Volume volume-a868f7a0-aac7-4ee4-a6f6-ff31c2e15791 (a868f7a0-aac7-4ee4-a6f6-ff31c2e15791): created successfully Sep 23 14:49:18 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-707e43a6-ae9c-4942-95c2-6c22a3447dbd tempest-CreateVolumesFromSnapshotTest-383178896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcaaf81f-b8e7-4504-a4ad-c64203fa229d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:49:18 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-707e43a6-ae9c-4942-95c2-6c22a3447dbd tempest-CreateVolumesFromSnapshotTest-383178896 None] Flow 'volume_create_manager' (71bcb36b-958d-4514-8ed2-87e9e3188a26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:49:18 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-707e43a6-ae9c-4942-95c2-6c22a3447dbd tempest-CreateVolumesFromSnapshotTest-383178896 None] Created volume successfully. Sep 23 14:49:19 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-66429527-e7a1-4a3c-971f-9199b2feb571 tempest-CreateVolumesFromSnapshotTest-383178896 None] Acquiring lock "cinder-a868f7a0-aac7-4ee4-a6f6-ff31c2e15791-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:49:19 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-66429527-e7a1-4a3c-971f-9199b2feb571 tempest-CreateVolumesFromSnapshotTest-383178896 None] Lock "cinder-a868f7a0-aac7-4ee4-a6f6-ff31c2e15791-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:49:19 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-66429527-e7a1-4a3c-971f-9199b2feb571 tempest-CreateVolumesFromSnapshotTest-383178896 None] Acquiring lock "cinder-quobyte-a868f7a0-aac7-4ee4-a6f6-ff31c2e15791" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:49:19 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-66429527-e7a1-4a3c-971f-9199b2feb571 tempest-CreateVolumesFromSnapshotTest-383178896 None] Lock "cinder-quobyte-a868f7a0-aac7-4ee4-a6f6-ff31c2e15791" acquired by "delete_volume" :: waited 0.012s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:49:19 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[294f55c0-f0f6-4a8e-a03e-7c0e8b0d816d]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:49:19 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-66429527-e7a1-4a3c-971f-9199b2feb571 tempest-CreateVolumesFromSnapshotTest-383178896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-a868f7a0-aac7-4ee4-a6f6-ff31c2e15791 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:49:19 devstack sudo[103284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-a868f7a0-aac7-4ee4-a6f6-ff31c2e15791 Sep 23 14:49:19 devstack sudo[103284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:49:19 devstack sudo[103284]: pam_unix(sudo:session): session closed for user root Sep 23 14:49:19 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-66429527-e7a1-4a3c-971f-9199b2feb571 tempest-CreateVolumesFromSnapshotTest-383178896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-a868f7a0-aac7-4ee4-a6f6-ff31c2e15791" returned: 0 in 0.344s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:49:19 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-66429527-e7a1-4a3c-971f-9199b2feb571 tempest-CreateVolumesFromSnapshotTest-383178896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-a868f7a0-aac7-4ee4-a6f6-ff31c2e15791 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:49:19 devstack sudo[103289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-a868f7a0-aac7-4ee4-a6f6-ff31c2e15791 Sep 23 14:49:19 devstack sudo[103289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:49:19 devstack sudo[103289]: pam_unix(sudo:session): session closed for user root Sep 23 14:49:19 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-66429527-e7a1-4a3c-971f-9199b2feb571 tempest-CreateVolumesFromSnapshotTest-383178896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-a868f7a0-aac7-4ee4-a6f6-ff31c2e15791" returned: 0 in 0.235s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:49:19 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-66429527-e7a1-4a3c-971f-9199b2feb571 tempest-CreateVolumesFromSnapshotTest-383178896 None] Lock "cinder-quobyte-a868f7a0-aac7-4ee4-a6f6-ff31c2e15791" released by "delete_volume" :: held 0.616s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:49:19 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-66429527-e7a1-4a3c-971f-9199b2feb571 tempest-CreateVolumesFromSnapshotTest-383178896 None] Created reservations ['7e425c59-0a8f-447f-8184-d580b24a0f88', 'c485c13b-6d3d-45b9-b91e-85bd135b1a42', '4c1199f0-df0d-4416-acca-685447a46c0e', '9fddd9ba-8020-4713-9d40-5dfa76942feb'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:49:19 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-66429527-e7a1-4a3c-971f-9199b2feb571 tempest-CreateVolumesFromSnapshotTest-383178896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:49:19 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-66429527-e7a1-4a3c-971f-9199b2feb571 tempest-CreateVolumesFromSnapshotTest-383178896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:49:19 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-66429527-e7a1-4a3c-971f-9199b2feb571 tempest-CreateVolumesFromSnapshotTest-383178896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:49:19 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-66429527-e7a1-4a3c-971f-9199b2feb571 tempest-CreateVolumesFromSnapshotTest-383178896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:49:19 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-66429527-e7a1-4a3c-971f-9199b2feb571 tempest-CreateVolumesFromSnapshotTest-383178896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:49:19 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-66429527-e7a1-4a3c-971f-9199b2feb571 tempest-CreateVolumesFromSnapshotTest-383178896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:49:19 devstack sudo[103292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:49:19 devstack sudo[103292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:49:20 devstack sudo[103292]: pam_unix(sudo:session): session closed for user root Sep 23 14:49:20 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-66429527-e7a1-4a3c-971f-9199b2feb571 tempest-CreateVolumesFromSnapshotTest-383178896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.235s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:49:20 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-66429527-e7a1-4a3c-971f-9199b2feb571 tempest-CreateVolumesFromSnapshotTest-383178896 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:49:20 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-66429527-e7a1-4a3c-971f-9199b2feb571 tempest-CreateVolumesFromSnapshotTest-383178896 None] Deleted volume successfully. Sep 23 14:49:20 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-66429527-e7a1-4a3c-971f-9199b2feb571 tempest-CreateVolumesFromSnapshotTest-383178896 None] Lock "cinder-a868f7a0-aac7-4ee4-a6f6-ff31c2e15791-delete_volume" released by "delete_volume" :: held 1.029s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:49:20 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-2dc1a2f0-ca59-4c69-bf42-8fdd47ec9e57 tempest-CreateVolumesFromSnapshotTest-383178896 None] Acquiring lock "cinder-743ee55d-5b92-4364-86cf-22af1102f02c-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:49:20 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-2dc1a2f0-ca59-4c69-bf42-8fdd47ec9e57 tempest-CreateVolumesFromSnapshotTest-383178896 None] Lock "cinder-743ee55d-5b92-4364-86cf-22af1102f02c-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:49:20 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-2dc1a2f0-ca59-4c69-bf42-8fdd47ec9e57 tempest-CreateVolumesFromSnapshotTest-383178896 None] Acquiring lock "cinder-quobyte-743ee55d-5b92-4364-86cf-22af1102f02c" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:49:20 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-2dc1a2f0-ca59-4c69-bf42-8fdd47ec9e57 tempest-CreateVolumesFromSnapshotTest-383178896 None] Lock "cinder-quobyte-743ee55d-5b92-4364-86cf-22af1102f02c" acquired by "delete_volume" :: waited 0.014s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:49:20 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[74e1e99f-129d-445d-aab5-6de3c4064517]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:49:20 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-2dc1a2f0-ca59-4c69-bf42-8fdd47ec9e57 tempest-CreateVolumesFromSnapshotTest-383178896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-743ee55d-5b92-4364-86cf-22af1102f02c {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:49:20 devstack sudo[103295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-743ee55d-5b92-4364-86cf-22af1102f02c Sep 23 14:49:20 devstack sudo[103295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:49:20 devstack sudo[103295]: pam_unix(sudo:session): session closed for user root Sep 23 14:49:20 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-2dc1a2f0-ca59-4c69-bf42-8fdd47ec9e57 tempest-CreateVolumesFromSnapshotTest-383178896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-743ee55d-5b92-4364-86cf-22af1102f02c" returned: 0 in 0.349s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:49:20 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-2dc1a2f0-ca59-4c69-bf42-8fdd47ec9e57 tempest-CreateVolumesFromSnapshotTest-383178896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-743ee55d-5b92-4364-86cf-22af1102f02c {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:49:20 devstack sudo[103300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-743ee55d-5b92-4364-86cf-22af1102f02c Sep 23 14:49:20 devstack sudo[103300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:49:20 devstack sudo[103300]: pam_unix(sudo:session): session closed for user root Sep 23 14:49:20 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-2dc1a2f0-ca59-4c69-bf42-8fdd47ec9e57 tempest-CreateVolumesFromSnapshotTest-383178896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-743ee55d-5b92-4364-86cf-22af1102f02c" returned: 0 in 0.237s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:49:20 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-2dc1a2f0-ca59-4c69-bf42-8fdd47ec9e57 tempest-CreateVolumesFromSnapshotTest-383178896 None] Lock "cinder-quobyte-743ee55d-5b92-4364-86cf-22af1102f02c" released by "delete_volume" :: held 0.630s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:49:20 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-2dc1a2f0-ca59-4c69-bf42-8fdd47ec9e57 tempest-CreateVolumesFromSnapshotTest-383178896 None] Created reservations ['f8c200e8-208b-4135-b5de-e9204728d924', '47d3d632-d31c-4d2f-8597-f7b3c87b5098', '1a8f68b3-72f8-4205-9738-412fcd7c1d49', 'cc10ad1c-7d38-4153-b3ba-61fdc5958f54'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:49:21 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-2dc1a2f0-ca59-4c69-bf42-8fdd47ec9e57 tempest-CreateVolumesFromSnapshotTest-383178896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:49:21 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-2dc1a2f0-ca59-4c69-bf42-8fdd47ec9e57 tempest-CreateVolumesFromSnapshotTest-383178896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:49:21 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-2dc1a2f0-ca59-4c69-bf42-8fdd47ec9e57 tempest-CreateVolumesFromSnapshotTest-383178896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:49:21 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-2dc1a2f0-ca59-4c69-bf42-8fdd47ec9e57 tempest-CreateVolumesFromSnapshotTest-383178896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:49:21 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-2dc1a2f0-ca59-4c69-bf42-8fdd47ec9e57 tempest-CreateVolumesFromSnapshotTest-383178896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:49:21 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-2dc1a2f0-ca59-4c69-bf42-8fdd47ec9e57 tempest-CreateVolumesFromSnapshotTest-383178896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:49:21 devstack sudo[103303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:49:21 devstack sudo[103303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:49:21 devstack sudo[103303]: pam_unix(sudo:session): session closed for user root Sep 23 14:49:21 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-2dc1a2f0-ca59-4c69-bf42-8fdd47ec9e57 tempest-CreateVolumesFromSnapshotTest-383178896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.233s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:49:21 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-2dc1a2f0-ca59-4c69-bf42-8fdd47ec9e57 tempest-CreateVolumesFromSnapshotTest-383178896 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:49:21 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-2dc1a2f0-ca59-4c69-bf42-8fdd47ec9e57 tempest-CreateVolumesFromSnapshotTest-383178896 None] Deleted volume successfully. Sep 23 14:49:21 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-2dc1a2f0-ca59-4c69-bf42-8fdd47ec9e57 tempest-CreateVolumesFromSnapshotTest-383178896 None] Lock "cinder-743ee55d-5b92-4364-86cf-22af1102f02c-delete_volume" released by "delete_volume" :: held 1.050s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:49:21 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-a6caaa11-c284-4446-87cc-58825c00e5aa tempest-CreateVolumesFromSnapshotTest-383178896 None] Acquiring lock "cinder-6d6e3e55-4aea-418e-83fa-ee22c5c5bd1d-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:49:21 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-a6caaa11-c284-4446-87cc-58825c00e5aa tempest-CreateVolumesFromSnapshotTest-383178896 None] Lock "cinder-6d6e3e55-4aea-418e-83fa-ee22c5c5bd1d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:49:21 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-a6caaa11-c284-4446-87cc-58825c00e5aa tempest-CreateVolumesFromSnapshotTest-383178896 None] Acquiring lock "cinder-quobyte-6d6e3e55-4aea-418e-83fa-ee22c5c5bd1d" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:49:21 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-a6caaa11-c284-4446-87cc-58825c00e5aa tempest-CreateVolumesFromSnapshotTest-383178896 None] Lock "cinder-quobyte-6d6e3e55-4aea-418e-83fa-ee22c5c5bd1d" acquired by "delete_volume" :: waited 0.014s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:49:21 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[644a82e5-2a01-44f9-917e-20d859a786c1]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:49:21 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a6caaa11-c284-4446-87cc-58825c00e5aa tempest-CreateVolumesFromSnapshotTest-383178896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6d6e3e55-4aea-418e-83fa-ee22c5c5bd1d {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:49:21 devstack sudo[103306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6d6e3e55-4aea-418e-83fa-ee22c5c5bd1d Sep 23 14:49:21 devstack sudo[103306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:49:21 devstack sudo[103306]: pam_unix(sudo:session): session closed for user root Sep 23 14:49:21 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a6caaa11-c284-4446-87cc-58825c00e5aa tempest-CreateVolumesFromSnapshotTest-383178896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6d6e3e55-4aea-418e-83fa-ee22c5c5bd1d" returned: 0 in 0.349s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:49:21 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a6caaa11-c284-4446-87cc-58825c00e5aa tempest-CreateVolumesFromSnapshotTest-383178896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6d6e3e55-4aea-418e-83fa-ee22c5c5bd1d {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:49:21 devstack sudo[103311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6d6e3e55-4aea-418e-83fa-ee22c5c5bd1d Sep 23 14:49:21 devstack sudo[103311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:49:22 devstack sudo[103311]: pam_unix(sudo:session): session closed for user root Sep 23 14:49:22 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a6caaa11-c284-4446-87cc-58825c00e5aa tempest-CreateVolumesFromSnapshotTest-383178896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6d6e3e55-4aea-418e-83fa-ee22c5c5bd1d" returned: 0 in 0.239s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:49:22 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-a6caaa11-c284-4446-87cc-58825c00e5aa tempest-CreateVolumesFromSnapshotTest-383178896 None] Lock "cinder-quobyte-6d6e3e55-4aea-418e-83fa-ee22c5c5bd1d" released by "delete_volume" :: held 0.626s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:49:22 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-a6caaa11-c284-4446-87cc-58825c00e5aa tempest-CreateVolumesFromSnapshotTest-383178896 None] Created reservations ['12a20f46-609b-4aa1-ad7e-94f5195d7a15', '2ebad3d0-4603-457a-b8aa-e535e36f9fc9', '09658a3f-06d3-4184-959e-35d7082cc810', 'a29a7217-5e83-4470-9e5a-924988ff9cd4'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:49:22 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-a6caaa11-c284-4446-87cc-58825c00e5aa tempest-CreateVolumesFromSnapshotTest-383178896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:49:22 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-a6caaa11-c284-4446-87cc-58825c00e5aa tempest-CreateVolumesFromSnapshotTest-383178896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:49:22 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-a6caaa11-c284-4446-87cc-58825c00e5aa tempest-CreateVolumesFromSnapshotTest-383178896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:49:22 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-a6caaa11-c284-4446-87cc-58825c00e5aa tempest-CreateVolumesFromSnapshotTest-383178896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:49:22 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-a6caaa11-c284-4446-87cc-58825c00e5aa tempest-CreateVolumesFromSnapshotTest-383178896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:49:22 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a6caaa11-c284-4446-87cc-58825c00e5aa tempest-CreateVolumesFromSnapshotTest-383178896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:49:22 devstack sudo[103314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:49:22 devstack sudo[103314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:49:22 devstack sudo[103314]: pam_unix(sudo:session): session closed for user root Sep 23 14:49:22 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a6caaa11-c284-4446-87cc-58825c00e5aa tempest-CreateVolumesFromSnapshotTest-383178896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.235s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:49:22 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-a6caaa11-c284-4446-87cc-58825c00e5aa tempest-CreateVolumesFromSnapshotTest-383178896 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:49:22 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-a6caaa11-c284-4446-87cc-58825c00e5aa tempest-CreateVolumesFromSnapshotTest-383178896 None] Deleted volume successfully. Sep 23 14:49:22 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-a6caaa11-c284-4446-87cc-58825c00e5aa tempest-CreateVolumesFromSnapshotTest-383178896 None] Lock "cinder-6d6e3e55-4aea-418e-83fa-ee22c5c5bd1d-delete_volume" released by "delete_volume" :: held 1.056s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:49:22 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-46c19785-ab8f-4096-a967-dc7580503cf4 tempest-CreateVolumesFromSnapshotTest-383178896 None] Acquiring lock "cinder-ea0f01d7-9dc4-4290-aafc-197d0305a4bd-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:49:22 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-46c19785-ab8f-4096-a967-dc7580503cf4 tempest-CreateVolumesFromSnapshotTest-383178896 None] Lock "cinder-ea0f01d7-9dc4-4290-aafc-197d0305a4bd-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:49:22 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-46c19785-ab8f-4096-a967-dc7580503cf4 tempest-CreateVolumesFromSnapshotTest-383178896 None] Acquiring lock "cinder-quobyte-ea0f01d7-9dc4-4290-aafc-197d0305a4bd" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:49:22 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-46c19785-ab8f-4096-a967-dc7580503cf4 tempest-CreateVolumesFromSnapshotTest-383178896 None] Lock "cinder-quobyte-ea0f01d7-9dc4-4290-aafc-197d0305a4bd" acquired by "delete_volume" :: waited 0.012s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:49:22 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[11464107-67d5-45fb-ab87-55a0446e7218]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:49:22 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-46c19785-ab8f-4096-a967-dc7580503cf4 tempest-CreateVolumesFromSnapshotTest-383178896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-ea0f01d7-9dc4-4290-aafc-197d0305a4bd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:49:22 devstack sudo[103317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-ea0f01d7-9dc4-4290-aafc-197d0305a4bd Sep 23 14:49:22 devstack sudo[103317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:49:23 devstack sudo[103317]: pam_unix(sudo:session): session closed for user root Sep 23 14:49:23 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-46c19785-ab8f-4096-a967-dc7580503cf4 tempest-CreateVolumesFromSnapshotTest-383178896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-ea0f01d7-9dc4-4290-aafc-197d0305a4bd" returned: 0 in 0.353s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:49:23 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-46c19785-ab8f-4096-a967-dc7580503cf4 tempest-CreateVolumesFromSnapshotTest-383178896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-ea0f01d7-9dc4-4290-aafc-197d0305a4bd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:49:23 devstack sudo[103323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-ea0f01d7-9dc4-4290-aafc-197d0305a4bd Sep 23 14:49:23 devstack sudo[103323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:49:23 devstack sudo[103323]: pam_unix(sudo:session): session closed for user root Sep 23 14:49:23 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-46c19785-ab8f-4096-a967-dc7580503cf4 tempest-CreateVolumesFromSnapshotTest-383178896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-ea0f01d7-9dc4-4290-aafc-197d0305a4bd" returned: 0 in 0.244s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:49:23 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-46c19785-ab8f-4096-a967-dc7580503cf4 tempest-CreateVolumesFromSnapshotTest-383178896 None] Lock "cinder-quobyte-ea0f01d7-9dc4-4290-aafc-197d0305a4bd" released by "delete_volume" :: held 0.635s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:49:23 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-46c19785-ab8f-4096-a967-dc7580503cf4 tempest-CreateVolumesFromSnapshotTest-383178896 None] Created reservations ['07577e53-711a-4019-bcd2-8dc1dafc641f', 'f33fb0fd-9a8d-4965-8b2d-da691f618b70', '90147d5c-5f63-46a1-8cae-d3f34c5cab72', '27c36220-85d1-49fa-9686-ec2f08325d45'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:49:23 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-46c19785-ab8f-4096-a967-dc7580503cf4 tempest-CreateVolumesFromSnapshotTest-383178896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:49:23 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-46c19785-ab8f-4096-a967-dc7580503cf4 tempest-CreateVolumesFromSnapshotTest-383178896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:49:23 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-46c19785-ab8f-4096-a967-dc7580503cf4 tempest-CreateVolumesFromSnapshotTest-383178896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:49:23 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-46c19785-ab8f-4096-a967-dc7580503cf4 tempest-CreateVolumesFromSnapshotTest-383178896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:49:23 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-46c19785-ab8f-4096-a967-dc7580503cf4 tempest-CreateVolumesFromSnapshotTest-383178896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:49:23 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-46c19785-ab8f-4096-a967-dc7580503cf4 tempest-CreateVolumesFromSnapshotTest-383178896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:49:23 devstack sudo[103326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:49:23 devstack sudo[103326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:49:23 devstack sudo[103326]: pam_unix(sudo:session): session closed for user root Sep 23 14:49:23 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-46c19785-ab8f-4096-a967-dc7580503cf4 tempest-CreateVolumesFromSnapshotTest-383178896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.234s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:49:23 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-46c19785-ab8f-4096-a967-dc7580503cf4 tempest-CreateVolumesFromSnapshotTest-383178896 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:49:23 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-46c19785-ab8f-4096-a967-dc7580503cf4 tempest-CreateVolumesFromSnapshotTest-383178896 None] Deleted volume successfully. Sep 23 14:49:23 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-46c19785-ab8f-4096-a967-dc7580503cf4 tempest-CreateVolumesFromSnapshotTest-383178896 None] Lock "cinder-ea0f01d7-9dc4-4290-aafc-197d0305a4bd-delete_volume" released by "delete_volume" :: held 1.061s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:49:23 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-5db7055c-14b4-481a-9475-080b58e19f24 tempest-CreateVolumesFromSnapshotTest-383178896 None] Acquiring lock "cinder-7cff9a9a-4004-40ce-b13f-7ca1bda98e04-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:49:23 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-5db7055c-14b4-481a-9475-080b58e19f24 tempest-CreateVolumesFromSnapshotTest-383178896 None] Lock "cinder-7cff9a9a-4004-40ce-b13f-7ca1bda98e04-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:49:23 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-5db7055c-14b4-481a-9475-080b58e19f24 tempest-CreateVolumesFromSnapshotTest-383178896 None] Acquiring lock "cinder-quobyte-7cff9a9a-4004-40ce-b13f-7ca1bda98e04" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:49:23 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-5db7055c-14b4-481a-9475-080b58e19f24 tempest-CreateVolumesFromSnapshotTest-383178896 None] Lock "cinder-quobyte-7cff9a9a-4004-40ce-b13f-7ca1bda98e04" acquired by "delete_volume" :: waited 0.019s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:49:23 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[05c9fda0-0d6e-4a82-a85d-25a61eb23e45]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:49:23 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-5db7055c-14b4-481a-9475-080b58e19f24 tempest-CreateVolumesFromSnapshotTest-383178896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7cff9a9a-4004-40ce-b13f-7ca1bda98e04 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:49:23 devstack sudo[103329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7cff9a9a-4004-40ce-b13f-7ca1bda98e04 Sep 23 14:49:23 devstack sudo[103329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:49:24 devstack sudo[103329]: pam_unix(sudo:session): session closed for user root Sep 23 14:49:24 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-5db7055c-14b4-481a-9475-080b58e19f24 tempest-CreateVolumesFromSnapshotTest-383178896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7cff9a9a-4004-40ce-b13f-7ca1bda98e04" returned: 0 in 0.358s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:49:24 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-5db7055c-14b4-481a-9475-080b58e19f24 tempest-CreateVolumesFromSnapshotTest-383178896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7cff9a9a-4004-40ce-b13f-7ca1bda98e04 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:49:24 devstack sudo[103334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7cff9a9a-4004-40ce-b13f-7ca1bda98e04 Sep 23 14:49:24 devstack sudo[103334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:49:24 devstack sudo[103334]: pam_unix(sudo:session): session closed for user root Sep 23 14:49:24 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-5db7055c-14b4-481a-9475-080b58e19f24 tempest-CreateVolumesFromSnapshotTest-383178896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7cff9a9a-4004-40ce-b13f-7ca1bda98e04" returned: 0 in 0.236s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:49:24 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-5db7055c-14b4-481a-9475-080b58e19f24 tempest-CreateVolumesFromSnapshotTest-383178896 None] Lock "cinder-quobyte-7cff9a9a-4004-40ce-b13f-7ca1bda98e04" released by "delete_volume" :: held 0.634s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:49:24 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-5db7055c-14b4-481a-9475-080b58e19f24 tempest-CreateVolumesFromSnapshotTest-383178896 None] Created reservations ['d0588457-b9ed-49d5-9789-e67b52693e0e', '6a20a9fb-af20-43b0-8e2d-295fbce11bb4', '5d9b822e-2f24-43fb-a717-cd63e95fbaaa', 'e6d2544c-dfbf-4040-a697-d724ed91a5d9'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:49:24 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-5db7055c-14b4-481a-9475-080b58e19f24 tempest-CreateVolumesFromSnapshotTest-383178896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:49:24 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-5db7055c-14b4-481a-9475-080b58e19f24 tempest-CreateVolumesFromSnapshotTest-383178896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:49:24 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-5db7055c-14b4-481a-9475-080b58e19f24 tempest-CreateVolumesFromSnapshotTest-383178896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:49:24 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-5db7055c-14b4-481a-9475-080b58e19f24 tempest-CreateVolumesFromSnapshotTest-383178896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:49:24 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-5db7055c-14b4-481a-9475-080b58e19f24 tempest-CreateVolumesFromSnapshotTest-383178896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:49:24 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-5db7055c-14b4-481a-9475-080b58e19f24 tempest-CreateVolumesFromSnapshotTest-383178896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:49:24 devstack sudo[103337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:49:24 devstack sudo[103337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:49:24 devstack sudo[103337]: pam_unix(sudo:session): session closed for user root Sep 23 14:49:24 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-5db7055c-14b4-481a-9475-080b58e19f24 tempest-CreateVolumesFromSnapshotTest-383178896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.240s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:49:24 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-5db7055c-14b4-481a-9475-080b58e19f24 tempest-CreateVolumesFromSnapshotTest-383178896 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:49:24 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-5db7055c-14b4-481a-9475-080b58e19f24 tempest-CreateVolumesFromSnapshotTest-383178896 None] Deleted volume successfully. Sep 23 14:49:24 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-5db7055c-14b4-481a-9475-080b58e19f24 tempest-CreateVolumesFromSnapshotTest-383178896 None] Lock "cinder-7cff9a9a-4004-40ce-b13f-7ca1bda98e04-delete_volume" released by "delete_volume" :: held 1.063s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:49:24 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-8ff0defd-7258-4b99-b383-5b6541fd9c86 tempest-CreateVolumesFromSnapshotTest-383178896 None] Acquiring lock "cinder-fa707b2a-b6ef-4308-ad22-304b9b808fad-delete_snapshot" by "delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:49:24 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-8ff0defd-7258-4b99-b383-5b6541fd9c86 tempest-CreateVolumesFromSnapshotTest-383178896 None] Lock "cinder-fa707b2a-b6ef-4308-ad22-304b9b808fad-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:49:24 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-8ff0defd-7258-4b99-b383-5b6541fd9c86 tempest-CreateVolumesFromSnapshotTest-383178896 None] Acquiring lock "cinder-quobyte-8a964103-df4b-46bb-956e-99b87e969909" by "delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:49:24 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-8ff0defd-7258-4b99-b383-5b6541fd9c86 tempest-CreateVolumesFromSnapshotTest-383178896 None] Lock "cinder-quobyte-8a964103-df4b-46bb-956e-99b87e969909" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:49:24 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-8ff0defd-7258-4b99-b383-5b6541fd9c86 tempest-CreateVolumesFromSnapshotTest-383178896 None] Acquiring lock "cinder-quobyte-fa707b2a-b6ef-4308-ad22-304b9b808fad" by "_delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:49:24 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-8ff0defd-7258-4b99-b383-5b6541fd9c86 tempest-CreateVolumesFromSnapshotTest-383178896 None] Lock "cinder-quobyte-fa707b2a-b6ef-4308-ad22-304b9b808fad" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:49:24 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-8ff0defd-7258-4b99-b383-5b6541fd9c86 tempest-CreateVolumesFromSnapshotTest-383178896 None] Deleting offline snapshot fa707b2a-b6ef-4308-ad22-304b9b808fad of volume 8a964103-df4b-46bb-956e-99b87e969909 {{(pid=86310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 14:49:24 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-8ff0defd-7258-4b99-b383-5b6541fd9c86 tempest-CreateVolumesFromSnapshotTest-383178896 None] snapshot_file for this snap is: volume-8a964103-df4b-46bb-956e-99b87e969909.fa707b2a-b6ef-4308-ad22-304b9b808fad {{(pid=86310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 14:49:24 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[49e343f6-29eb-436e-a7da-0df4fabdedfa]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:49:24 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8ff0defd-7258-4b99-b383-5b6541fd9c86 tempest-CreateVolumesFromSnapshotTest-383178896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8a964103-df4b-46bb-956e-99b87e969909.fa707b2a-b6ef-4308-ad22-304b9b808fad {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:49:25 devstack sudo[103340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8a964103-df4b-46bb-956e-99b87e969909.fa707b2a-b6ef-4308-ad22-304b9b808fad Sep 23 14:49:25 devstack sudo[103340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:49:25 devstack sudo[103340]: pam_unix(sudo:session): session closed for user root Sep 23 14:49:25 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8ff0defd-7258-4b99-b383-5b6541fd9c86 tempest-CreateVolumesFromSnapshotTest-383178896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8a964103-df4b-46bb-956e-99b87e969909.fa707b2a-b6ef-4308-ad22-304b9b808fad" returned: 0 in 0.362s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:49:25 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-8ff0defd-7258-4b99-b383-5b6541fd9c86 tempest-CreateVolumesFromSnapshotTest-383178896 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8a964103-df4b-46bb-956e-99b87e969909(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 14:49:25 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[f27d0fc2-cc83-4dec-be72-822f97bc11a0]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:49:25 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8ff0defd-7258-4b99-b383-5b6541fd9c86 tempest-CreateVolumesFromSnapshotTest-383178896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8a964103-df4b-46bb-956e-99b87e969909 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:49:25 devstack sudo[103345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8a964103-df4b-46bb-956e-99b87e969909 Sep 23 14:49:25 devstack sudo[103345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:49:25 devstack sudo[103345]: pam_unix(sudo:session): session closed for user root Sep 23 14:49:25 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8ff0defd-7258-4b99-b383-5b6541fd9c86 tempest-CreateVolumesFromSnapshotTest-383178896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8a964103-df4b-46bb-956e-99b87e969909" returned: 0 in 0.365s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:49:25 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8ff0defd-7258-4b99-b383-5b6541fd9c86 tempest-CreateVolumesFromSnapshotTest-383178896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8a964103-df4b-46bb-956e-99b87e969909.fa707b2a-b6ef-4308-ad22-304b9b808fad {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:49:25 devstack sudo[103350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8a964103-df4b-46bb-956e-99b87e969909.fa707b2a-b6ef-4308-ad22-304b9b808fad Sep 23 14:49:25 devstack sudo[103350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:49:26 devstack sudo[103350]: pam_unix(sudo:session): session closed for user root Sep 23 14:49:26 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8ff0defd-7258-4b99-b383-5b6541fd9c86 tempest-CreateVolumesFromSnapshotTest-383178896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8a964103-df4b-46bb-956e-99b87e969909.fa707b2a-b6ef-4308-ad22-304b9b808fad" returned: 0 in 0.335s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:49:26 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8ff0defd-7258-4b99-b383-5b6541fd9c86 tempest-CreateVolumesFromSnapshotTest-383178896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8a964103-df4b-46bb-956e-99b87e969909.fa707b2a-b6ef-4308-ad22-304b9b808fad {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:49:26 devstack sudo[103355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8a964103-df4b-46bb-956e-99b87e969909.fa707b2a-b6ef-4308-ad22-304b9b808fad Sep 23 14:49:26 devstack sudo[103355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:49:26 devstack sudo[103355]: pam_unix(sudo:session): session closed for user root Sep 23 14:49:26 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8ff0defd-7258-4b99-b383-5b6541fd9c86 tempest-CreateVolumesFromSnapshotTest-383178896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8a964103-df4b-46bb-956e-99b87e969909.fa707b2a-b6ef-4308-ad22-304b9b808fad" returned: 0 in 0.258s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:49:26 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-8ff0defd-7258-4b99-b383-5b6541fd9c86 tempest-CreateVolumesFromSnapshotTest-383178896 None] Lock "cinder-quobyte-fa707b2a-b6ef-4308-ad22-304b9b808fad" released by "_delete_snapshot" :: held 1.429s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:49:26 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-8ff0defd-7258-4b99-b383-5b6541fd9c86 tempest-CreateVolumesFromSnapshotTest-383178896 None] Lock "cinder-quobyte-8a964103-df4b-46bb-956e-99b87e969909" released by "delete_snapshot" :: held 1.450s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:49:26 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-8ff0defd-7258-4b99-b383-5b6541fd9c86 tempest-CreateVolumesFromSnapshotTest-383178896 None] Created reservations ['0b69a006-9e35-4cc3-a637-94dc0caa419b', '36ba361a-2f8b-4ecc-95f7-b14fa67bc1f7', '8cb3d7da-8eb7-4c77-b0cc-b3f73f911003', '1f5aa68a-1367-41c1-9a81-fd52245f9670'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:49:26 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-8ff0defd-7258-4b99-b383-5b6541fd9c86 tempest-CreateVolumesFromSnapshotTest-383178896 None] Delete snapshot completed successfully. Sep 23 14:49:26 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-8ff0defd-7258-4b99-b383-5b6541fd9c86 tempest-CreateVolumesFromSnapshotTest-383178896 None] Lock "cinder-fa707b2a-b6ef-4308-ad22-304b9b808fad-delete_snapshot" released by "delete_snapshot" :: held 1.588s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:49:27 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-cc84620a-91b3-4873-9fe9-52b7d9e10588 tempest-CreateVolumesFromSnapshotTest-383178896 None] Acquiring lock "cinder-8a964103-df4b-46bb-956e-99b87e969909-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:49:27 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-cc84620a-91b3-4873-9fe9-52b7d9e10588 tempest-CreateVolumesFromSnapshotTest-383178896 None] Lock "cinder-8a964103-df4b-46bb-956e-99b87e969909-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:49:27 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-cc84620a-91b3-4873-9fe9-52b7d9e10588 tempest-CreateVolumesFromSnapshotTest-383178896 None] Acquiring lock "cinder-quobyte-8a964103-df4b-46bb-956e-99b87e969909" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:49:27 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-cc84620a-91b3-4873-9fe9-52b7d9e10588 tempest-CreateVolumesFromSnapshotTest-383178896 None] Lock "cinder-quobyte-8a964103-df4b-46bb-956e-99b87e969909" acquired by "delete_volume" :: waited 0.020s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:49:27 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f72bdcd-5d70-4594-8d1b-03d15ede5b3d]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:49:27 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-cc84620a-91b3-4873-9fe9-52b7d9e10588 tempest-CreateVolumesFromSnapshotTest-383178896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8a964103-df4b-46bb-956e-99b87e969909 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:49:27 devstack sudo[103358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8a964103-df4b-46bb-956e-99b87e969909 Sep 23 14:49:27 devstack sudo[103358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:49:27 devstack sudo[103358]: pam_unix(sudo:session): session closed for user root Sep 23 14:49:27 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-cc84620a-91b3-4873-9fe9-52b7d9e10588 tempest-CreateVolumesFromSnapshotTest-383178896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8a964103-df4b-46bb-956e-99b87e969909" returned: 0 in 0.393s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:49:27 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-cc84620a-91b3-4873-9fe9-52b7d9e10588 tempest-CreateVolumesFromSnapshotTest-383178896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8a964103-df4b-46bb-956e-99b87e969909 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:49:27 devstack sudo[103397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8a964103-df4b-46bb-956e-99b87e969909 Sep 23 14:49:27 devstack sudo[103397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:49:27 devstack sudo[103397]: pam_unix(sudo:session): session closed for user root Sep 23 14:49:27 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-cc84620a-91b3-4873-9fe9-52b7d9e10588 tempest-CreateVolumesFromSnapshotTest-383178896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8a964103-df4b-46bb-956e-99b87e969909" returned: 0 in 0.252s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:49:27 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-cc84620a-91b3-4873-9fe9-52b7d9e10588 tempest-CreateVolumesFromSnapshotTest-383178896 None] Lock "cinder-quobyte-8a964103-df4b-46bb-956e-99b87e969909" released by "delete_volume" :: held 0.706s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:49:27 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-cc84620a-91b3-4873-9fe9-52b7d9e10588 tempest-CreateVolumesFromSnapshotTest-383178896 None] Created reservations ['e74ee41c-b3b0-4ec7-9401-d4b35cf24673', 'e6300f0d-cc0f-43b4-b51f-2d72026c4616', 'f4afa8ba-f561-4c53-ab72-6a592b9702df', '3cc85511-aef7-4ec6-9821-299346c6d4a3'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:49:27 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-cc84620a-91b3-4873-9fe9-52b7d9e10588 tempest-CreateVolumesFromSnapshotTest-383178896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:49:27 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-cc84620a-91b3-4873-9fe9-52b7d9e10588 tempest-CreateVolumesFromSnapshotTest-383178896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:49:27 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-cc84620a-91b3-4873-9fe9-52b7d9e10588 tempest-CreateVolumesFromSnapshotTest-383178896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:49:27 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-cc84620a-91b3-4873-9fe9-52b7d9e10588 tempest-CreateVolumesFromSnapshotTest-383178896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:49:27 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-cc84620a-91b3-4873-9fe9-52b7d9e10588 tempest-CreateVolumesFromSnapshotTest-383178896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:49:27 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-cc84620a-91b3-4873-9fe9-52b7d9e10588 tempest-CreateVolumesFromSnapshotTest-383178896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:49:27 devstack sudo[103402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:49:27 devstack sudo[103402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:49:28 devstack sudo[103402]: pam_unix(sudo:session): session closed for user root Sep 23 14:49:28 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-cc84620a-91b3-4873-9fe9-52b7d9e10588 tempest-CreateVolumesFromSnapshotTest-383178896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.243s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:49:28 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-cc84620a-91b3-4873-9fe9-52b7d9e10588 tempest-CreateVolumesFromSnapshotTest-383178896 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:49:28 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-cc84620a-91b3-4873-9fe9-52b7d9e10588 tempest-CreateVolumesFromSnapshotTest-383178896 None] Deleted volume successfully. Sep 23 14:49:28 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-cc84620a-91b3-4873-9fe9-52b7d9e10588 tempest-CreateVolumesFromSnapshotTest-383178896 None] Lock "cinder-8a964103-df4b-46bb-956e-99b87e969909-delete_volume" released by "delete_volume" :: held 1.142s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:49:32 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fb3c833-0ca0-4f40-a534-9eb4c628486d tempest-VolumeImageDependencyTests-2039293394 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:49:32 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-8fb3c833-0ca0-4f40-a534-9eb4c628486d tempest-VolumeImageDependencyTests-2039293394 None] Flow 'volume_create_manager' (e5ea4def-aa6d-4b05-a00b-45bcd544738b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:49:32 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-8fb3c833-0ca0-4f40-a534-9eb4c628486d tempest-VolumeImageDependencyTests-2039293394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97161bb2-f5a7-44ea-8e3a-496120b9b992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:49:32 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-8fb3c833-0ca0-4f40-a534-9eb4c628486d tempest-VolumeImageDependencyTests-2039293394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97161bb2-f5a7-44ea-8e3a-496120b9b992) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:49:33Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9172a8d-b73f-42f0-8f2a-cbefbb53a6df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da76135fae5d451fba2e4c9d5b8c0446',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:49:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:49:33Z,use_quota=True,user_id='2481c269a8dd4d5aa677e23fe5446ac6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:49:32 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-8fb3c833-0ca0-4f40-a534-9eb4c628486d tempest-VolumeImageDependencyTests-2039293394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e68d9e9-9153-4605-a791-c88b2ea2bcf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:49:32 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-8fb3c833-0ca0-4f40-a534-9eb4c628486d tempest-VolumeImageDependencyTests-2039293394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e68d9e9-9153-4605-a791-c88b2ea2bcf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:49:32 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-8fb3c833-0ca0-4f40-a534-9eb4c628486d tempest-VolumeImageDependencyTests-2039293394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (431d0a29-2d58-4cd7-ac1e-dbb8b14f7de9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:49:32 devstack cinder-volume[86310]: DEBUG cinder.image.glance [None req-8fb3c833-0ca0-4f40-a534-9eb4c628486d tempest-VolumeImageDependencyTests-2039293394 None] Creating Keystone auth plugin from conf {{(pid=86310) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 23 14:49:33 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-8fb3c833-0ca0-4f40-a534-9eb4c628486d tempest-VolumeImageDependencyTests-2039293394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (431d0a29-2d58-4cd7-ac1e-dbb8b14f7de9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f9172a8d-b73f-42f0-8f2a-cbefbb53a6df', 'volume_name': 'volume-f9172a8d-b73f-42f0-8f2a-cbefbb53a6df', 'volume_size': 1, 'image_id': '3ff3495b-4ed3-42d5-a25b-18cd8e71f5fd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3ff3495b-4ed3-42d5-a25b-18cd8e71f5fd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '53c731a7d1f77f0a857eb42280322884', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'da76135fae5d451fba2e4c9d5b8c0446', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c13b1b5dd72b751f3d24fc0e8cf4e52571614a1406100c94f301ce726a8a8718fb6fc5e9fce0c44e4b0966c8debb9b55a0dac4c1ceeaab751934b8bc86b671c3', 'id': '3ff3495b-4ed3-42d5-a25b-18cd8e71f5fd', 'created_at': datetime.datetime(2026, 9, 23, 12, 49, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 23, 12, 49, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3ff3495b-4ed3-42d5-a25b-18cd8e71f5fd/file', 'properties': {}}, 'image_service': }' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:49:33 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-8fb3c833-0ca0-4f40-a534-9eb4c628486d tempest-VolumeImageDependencyTests-2039293394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f8c52bc-f8d2-4b9e-9e80-9763938ec23a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:49:33 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-8fb3c833-0ca0-4f40-a534-9eb4c628486d tempest-VolumeImageDependencyTests-2039293394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f8c52bc-f8d2-4b9e-9e80-9763938ec23a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:49:33 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-8fb3c833-0ca0-4f40-a534-9eb4c628486d tempest-VolumeImageDependencyTests-2039293394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af61f796-5baf-4e8a-a146-d185448f8f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:49:33 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-8fb3c833-0ca0-4f40-a534-9eb4c628486d tempest-VolumeImageDependencyTests-2039293394 None] Volume f9172a8d-b73f-42f0-8f2a-cbefbb53a6df: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f9172a8d-b73f-42f0-8f2a-cbefbb53a6df', 'volume_size': 1, 'image_id': '3ff3495b-4ed3-42d5-a25b-18cd8e71f5fd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3ff3495b-4ed3-42d5-a25b-18cd8e71f5fd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '53c731a7d1f77f0a857eb42280322884', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'da76135fae5d451fba2e4c9d5b8c0446', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c13b1b5dd72b751f3d24fc0e8cf4e52571614a1406100c94f301ce726a8a8718fb6fc5e9fce0c44e4b0966c8debb9b55a0dac4c1ceeaab751934b8bc86b671c3', 'id': '3ff3495b-4ed3-42d5-a25b-18cd8e71f5fd', 'created_at': datetime.datetime(2026, 9, 23, 12, 49, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 23, 12, 49, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3ff3495b-4ed3-42d5-a25b-18cd8e71f5fd/file', 'properties': {}}, 'image_service': } Sep 23 14:49:33 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fb3c833-0ca0-4f40-a534-9eb4c628486d tempest-VolumeImageDependencyTests-2039293394 None] Trying to clone f9172a8d-b73f-42f0-8f2a-cbefbb53a6df from image 3ff3495b-4ed3-42d5-a25b-18cd8e71f5fd at location (None, [{'url': 'file:///opt/stack/data/glance/images/3ff3495b-4ed3-42d5-a25b-18cd8e71f5fd', 'metadata': {}}]). {{(pid=86310) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 23 14:49:33 devstack cinder-volume[86310]: DEBUG cinder.image.image_utils [None req-8fb3c833-0ca0-4f40-a534-9eb4c628486d tempest-VolumeImageDependencyTests-2039293394 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3ff3495b-4ed3-42d5-a25b-18cd8e71f5fd_dtcqdd5bdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86310) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 23 14:49:33 devstack cinder-volume[86310]: INFO cinder.image.image_utils [None req-8fb3c833-0ca0-4f40-a534-9eb4c628486d tempest-VolumeImageDependencyTests-2039293394 None] Image download 0.00 MB at 0.00 MB/s Sep 23 14:49:33 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed544b33-0351-4d14-bb79-b7c204bd73d3]: (4, 'raw') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:49:33 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8fb3c833-0ca0-4f40-a534-9eb4c628486d tempest-VolumeImageDependencyTests-2039293394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3ff3495b-4ed3-42d5-a25b-18cd8e71f5fd_dtcqdd5bdevstack@QuobyteHD {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:49:33 devstack sudo[103406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3ff3495b-4ed3-42d5-a25b-18cd8e71f5fd_dtcqdd5bdevstack@QuobyteHD Sep 23 14:49:33 devstack sudo[103406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:49:33 devstack sudo[103406]: pam_unix(sudo:session): session closed for user root Sep 23 14:49:33 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8fb3c833-0ca0-4f40-a534-9eb4c628486d tempest-VolumeImageDependencyTests-2039293394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3ff3495b-4ed3-42d5-a25b-18cd8e71f5fd_dtcqdd5bdevstack@QuobyteHD" returned: 0 in 0.319s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:49:33 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8fb3c833-0ca0-4f40-a534-9eb4c628486d tempest-VolumeImageDependencyTests-2039293394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3ff3495b-4ed3-42d5-a25b-18cd8e71f5fd_dtcqdd5bdevstack@QuobyteHD {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:49:33 devstack sudo[103410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3ff3495b-4ed3-42d5-a25b-18cd8e71f5fd_dtcqdd5bdevstack@QuobyteHD Sep 23 14:49:33 devstack sudo[103410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:49:33 devstack sudo[103410]: pam_unix(sudo:session): session closed for user root Sep 23 14:49:33 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8fb3c833-0ca0-4f40-a534-9eb4c628486d tempest-VolumeImageDependencyTests-2039293394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3ff3495b-4ed3-42d5-a25b-18cd8e71f5fd_dtcqdd5bdevstack@QuobyteHD" returned: 1 in 0.330s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:49:33 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8fb3c833-0ca0-4f40-a534-9eb4c628486d tempest-VolumeImageDependencyTests-2039293394 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3ff3495b-4ed3-42d5-a25b-18cd8e71f5fd_dtcqdd5bdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 14:49:33 devstack cinder-volume[86310]: DEBUG cinder.image.image_utils [None req-8fb3c833-0ca0-4f40-a534-9eb4c628486d tempest-VolumeImageDependencyTests-2039293394 None] Temporary image 3ff3495b-4ed3-42d5-a25b-18cd8e71f5fd is fetched for user 2481c269a8dd4d5aa677e23fe5446ac6. {{(pid=86310) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 23 14:49:34 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[601b7069-9440-45a8-92a1-265cadfb298f]: (4, 'raw') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:49:34 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8fb3c833-0ca0-4f40-a534-9eb4c628486d tempest-VolumeImageDependencyTests-2039293394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3ff3495b-4ed3-42d5-a25b-18cd8e71f5fd_dtcqdd5bdevstack@QuobyteHD {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:49:34 devstack sudo[103415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3ff3495b-4ed3-42d5-a25b-18cd8e71f5fd_dtcqdd5bdevstack@QuobyteHD Sep 23 14:49:34 devstack sudo[103415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:49:34 devstack sudo[103415]: pam_unix(sudo:session): session closed for user root Sep 23 14:49:34 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8fb3c833-0ca0-4f40-a534-9eb4c628486d tempest-VolumeImageDependencyTests-2039293394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3ff3495b-4ed3-42d5-a25b-18cd8e71f5fd_dtcqdd5bdevstack@QuobyteHD" returned: 0 in 0.335s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:49:34 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8fb3c833-0ca0-4f40-a534-9eb4c628486d tempest-VolumeImageDependencyTests-2039293394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3ff3495b-4ed3-42d5-a25b-18cd8e71f5fd_dtcqdd5bdevstack@QuobyteHD {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:49:34 devstack sudo[103425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3ff3495b-4ed3-42d5-a25b-18cd8e71f5fd_dtcqdd5bdevstack@QuobyteHD Sep 23 14:49:34 devstack sudo[103425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:49:34 devstack sudo[103425]: pam_unix(sudo:session): session closed for user root Sep 23 14:49:34 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8fb3c833-0ca0-4f40-a534-9eb4c628486d tempest-VolumeImageDependencyTests-2039293394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3ff3495b-4ed3-42d5-a25b-18cd8e71f5fd_dtcqdd5bdevstack@QuobyteHD" returned: 1 in 0.326s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:49:34 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8fb3c833-0ca0-4f40-a534-9eb4c628486d tempest-VolumeImageDependencyTests-2039293394 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3ff3495b-4ed3-42d5-a25b-18cd8e71f5fd_dtcqdd5bdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 14:49:34 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-8fb3c833-0ca0-4f40-a534-9eb4c628486d tempest-VolumeImageDependencyTests-2039293394 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:49:34 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-8fb3c833-0ca0-4f40-a534-9eb4c628486d tempest-VolumeImageDependencyTests-2039293394 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:49:34 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-8fb3c833-0ca0-4f40-a534-9eb4c628486d tempest-VolumeImageDependencyTests-2039293394 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:49:33Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9172a8d-b73f-42f0-8f2a-cbefbb53a6df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da76135fae5d451fba2e4c9d5b8c0446',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:49:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:49:33Z,use_quota=True,user_id='2481c269a8dd4d5aa677e23fe5446ac6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:49:34 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-8fb3c833-0ca0-4f40-a534-9eb4c628486d tempest-VolumeImageDependencyTests-2039293394 None] Creating volume f9172a8d-b73f-42f0-8f2a-cbefbb53a6df {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:49:34 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-8fb3c833-0ca0-4f40-a534-9eb4c628486d tempest-VolumeImageDependencyTests-2039293394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:49:34 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-8fb3c833-0ca0-4f40-a534-9eb4c628486d tempest-VolumeImageDependencyTests-2039293394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:49:34 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-8fb3c833-0ca0-4f40-a534-9eb4c628486d tempest-VolumeImageDependencyTests-2039293394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:49:34 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-8fb3c833-0ca0-4f40-a534-9eb4c628486d tempest-VolumeImageDependencyTests-2039293394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:49:34 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-8fb3c833-0ca0-4f40-a534-9eb4c628486d tempest-VolumeImageDependencyTests-2039293394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:49:34 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-8fb3c833-0ca0-4f40-a534-9eb4c628486d tempest-VolumeImageDependencyTests-2039293394 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:49:34 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-8fb3c833-0ca0-4f40-a534-9eb4c628486d tempest-VolumeImageDependencyTests-2039293394 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:49:34 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8fb3c833-0ca0-4f40-a534-9eb4c628486d tempest-VolumeImageDependencyTests-2039293394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-f9172a8d-b73f-42f0-8f2a-cbefbb53a6df 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:49:34 devstack sudo[103430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-f9172a8d-b73f-42f0-8f2a-cbefbb53a6df 1073741824 Sep 23 14:49:34 devstack sudo[103430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:49:35 devstack sudo[103430]: pam_unix(sudo:session): session closed for user root Sep 23 14:49:35 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8fb3c833-0ca0-4f40-a534-9eb4c628486d tempest-VolumeImageDependencyTests-2039293394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-f9172a8d-b73f-42f0-8f2a-cbefbb53a6df 1073741824" returned: 0 in 0.432s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:49:35 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8fb3c833-0ca0-4f40-a534-9eb4c628486d tempest-VolumeImageDependencyTests-2039293394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-f9172a8d-b73f-42f0-8f2a-cbefbb53a6df {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:49:35 devstack sudo[103436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-f9172a8d-b73f-42f0-8f2a-cbefbb53a6df Sep 23 14:49:35 devstack sudo[103436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:49:35 devstack sudo[103436]: pam_unix(sudo:session): session closed for user root Sep 23 14:49:35 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8fb3c833-0ca0-4f40-a534-9eb4c628486d tempest-VolumeImageDependencyTests-2039293394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-f9172a8d-b73f-42f0-8f2a-cbefbb53a6df" returned: 0 in 0.242s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:49:35 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-8fb3c833-0ca0-4f40-a534-9eb4c628486d tempest-VolumeImageDependencyTests-2039293394 None] <== create_volume: return (714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:49:35 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-8fb3c833-0ca0-4f40-a534-9eb4c628486d tempest-VolumeImageDependencyTests-2039293394 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.717s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:49:35 devstack cinder-volume[86310]: DEBUG cinder.volume.volume_utils [None req-8fb3c833-0ca0-4f40-a534-9eb4c628486d tempest-VolumeImageDependencyTests-2039293394 None] Attempting download of 3ff3495b-4ed3-42d5-a25b-18cd8e71f5fd ((None, [{'url': 'file:///opt/stack/data/glance/images/3ff3495b-4ed3-42d5-a25b-18cd8e71f5fd', 'metadata': {}}])) to volume f9172a8d-b73f-42f0-8f2a-cbefbb53a6df. {{(pid=86310) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 23 14:49:35 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae83e358-08f0-4dcb-bc88-00bab3d866af]: (4, 'raw') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:49:35 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8fb3c833-0ca0-4f40-a534-9eb4c628486d tempest-VolumeImageDependencyTests-2039293394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3ff3495b-4ed3-42d5-a25b-18cd8e71f5fd_09dji8br {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:49:35 devstack sudo[103439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3ff3495b-4ed3-42d5-a25b-18cd8e71f5fd_09dji8br Sep 23 14:49:35 devstack sudo[103439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:49:35 devstack sudo[103439]: pam_unix(sudo:session): session closed for user root Sep 23 14:49:35 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8fb3c833-0ca0-4f40-a534-9eb4c628486d tempest-VolumeImageDependencyTests-2039293394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3ff3495b-4ed3-42d5-a25b-18cd8e71f5fd_09dji8br" returned: 0 in 0.322s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:49:35 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8fb3c833-0ca0-4f40-a534-9eb4c628486d tempest-VolumeImageDependencyTests-2039293394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3ff3495b-4ed3-42d5-a25b-18cd8e71f5fd_09dji8br {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:49:35 devstack sudo[103443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3ff3495b-4ed3-42d5-a25b-18cd8e71f5fd_09dji8br Sep 23 14:49:35 devstack sudo[103443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:49:36 devstack sudo[103443]: pam_unix(sudo:session): session closed for user root Sep 23 14:49:36 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8fb3c833-0ca0-4f40-a534-9eb4c628486d tempest-VolumeImageDependencyTests-2039293394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3ff3495b-4ed3-42d5-a25b-18cd8e71f5fd_09dji8br" returned: 1 in 0.316s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:49:36 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8fb3c833-0ca0-4f40-a534-9eb4c628486d tempest-VolumeImageDependencyTests-2039293394 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3ff3495b-4ed3-42d5-a25b-18cd8e71f5fd_09dji8br' failed. Not Retrying. {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 14:49:36 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d37625d-88c9-489d-a9d1-0a23590756b9]: (4, 'raw') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:49:36 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8fb3c833-0ca0-4f40-a534-9eb4c628486d tempest-VolumeImageDependencyTests-2039293394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3ff3495b-4ed3-42d5-a25b-18cd8e71f5fd_dtcqdd5bdevstack@QuobyteHD {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:49:36 devstack sudo[103447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3ff3495b-4ed3-42d5-a25b-18cd8e71f5fd_dtcqdd5bdevstack@QuobyteHD Sep 23 14:49:36 devstack sudo[103447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:49:36 devstack sudo[103447]: pam_unix(sudo:session): session closed for user root Sep 23 14:49:36 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8fb3c833-0ca0-4f40-a534-9eb4c628486d tempest-VolumeImageDependencyTests-2039293394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3ff3495b-4ed3-42d5-a25b-18cd8e71f5fd_dtcqdd5bdevstack@QuobyteHD" returned: 0 in 0.326s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:49:36 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8fb3c833-0ca0-4f40-a534-9eb4c628486d tempest-VolumeImageDependencyTests-2039293394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3ff3495b-4ed3-42d5-a25b-18cd8e71f5fd_dtcqdd5bdevstack@QuobyteHD {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:49:36 devstack sudo[103451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3ff3495b-4ed3-42d5-a25b-18cd8e71f5fd_dtcqdd5bdevstack@QuobyteHD Sep 23 14:49:36 devstack sudo[103451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:49:36 devstack sudo[103451]: pam_unix(sudo:session): session closed for user root Sep 23 14:49:36 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8fb3c833-0ca0-4f40-a534-9eb4c628486d tempest-VolumeImageDependencyTests-2039293394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3ff3495b-4ed3-42d5-a25b-18cd8e71f5fd_dtcqdd5bdevstack@QuobyteHD" returned: 1 in 0.320s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:49:36 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8fb3c833-0ca0-4f40-a534-9eb4c628486d tempest-VolumeImageDependencyTests-2039293394 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3ff3495b-4ed3-42d5-a25b-18cd8e71f5fd_dtcqdd5bdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 14:49:36 devstack cinder-volume[86310]: DEBUG cinder.image.image_utils [None req-8fb3c833-0ca0-4f40-a534-9eb4c628486d tempest-VolumeImageDependencyTests-2039293394 None] 3ff3495b-4ed3-42d5-a25b-18cd8e71f5fd was raw, converting to qcow2 {{(pid=86310) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 23 14:49:36 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8fb3c833-0ca0-4f40-a534-9eb4c628486d tempest-VolumeImageDependencyTests-2039293394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_3ff3495b-4ed3-42d5-a25b-18cd8e71f5fd_dtcqdd5bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-f9172a8d-b73f-42f0-8f2a-cbefbb53a6df {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:49:36 devstack sudo[103456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_3ff3495b-4ed3-42d5-a25b-18cd8e71f5fd_dtcqdd5bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-f9172a8d-b73f-42f0-8f2a-cbefbb53a6df Sep 23 14:49:36 devstack sudo[103456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:49:37 devstack sudo[103456]: pam_unix(sudo:session): session closed for user root Sep 23 14:49:37 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8fb3c833-0ca0-4f40-a534-9eb4c628486d tempest-VolumeImageDependencyTests-2039293394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_3ff3495b-4ed3-42d5-a25b-18cd8e71f5fd_dtcqdd5bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-f9172a8d-b73f-42f0-8f2a-cbefbb53a6df" returned: 0 in 0.439s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:49:37 devstack cinder-volume[86310]: DEBUG cinder.image.image_utils [None req-8fb3c833-0ca0-4f40-a534-9eb4c628486d tempest-VolumeImageDependencyTests-2039293394 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3ff3495b-4ed3-42d5-a25b-18cd8e71f5fd_dtcqdd5bdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-f9172a8d-b73f-42f0-8f2a-cbefbb53a6df {{(pid=86310) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 14:49:37 devstack cinder-volume[86310]: INFO cinder.image.image_utils [None req-8fb3c833-0ca0-4f40-a534-9eb4c628486d tempest-VolumeImageDependencyTests-2039293394 None] Converted 0.00 MB image at 0.00 MB/s Sep 23 14:49:37 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8fb3c833-0ca0-4f40-a534-9eb4c628486d tempest-VolumeImageDependencyTests-2039293394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-f9172a8d-b73f-42f0-8f2a-cbefbb53a6df 1G {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:49:37 devstack sudo[103461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-f9172a8d-b73f-42f0-8f2a-cbefbb53a6df 1G Sep 23 14:49:37 devstack sudo[103461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:49:37 devstack sudo[103461]: pam_unix(sudo:session): session closed for user root Sep 23 14:49:37 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8fb3c833-0ca0-4f40-a534-9eb4c628486d tempest-VolumeImageDependencyTests-2039293394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-f9172a8d-b73f-42f0-8f2a-cbefbb53a6df 1G" returned: 0 in 0.301s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:49:37 devstack cinder-volume[86310]: DEBUG cinder.volume.volume_utils [None req-8fb3c833-0ca0-4f40-a534-9eb4c628486d tempest-VolumeImageDependencyTests-2039293394 None] Downloaded image 3ff3495b-4ed3-42d5-a25b-18cd8e71f5fd ((None, [{'url': 'file:///opt/stack/data/glance/images/3ff3495b-4ed3-42d5-a25b-18cd8e71f5fd', 'metadata': {}}])) to volume f9172a8d-b73f-42f0-8f2a-cbefbb53a6df successfully. {{(pid=86310) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 23 14:49:37 devstack cinder-volume[86310]: DEBUG cinder.image.image_utils [None req-8fb3c833-0ca0-4f40-a534-9eb4c628486d tempest-VolumeImageDependencyTests-2039293394 None] Temporary image 3ff3495b-4ed3-42d5-a25b-18cd8e71f5fd for user 2481c269a8dd4d5aa677e23fe5446ac6 is deleted. {{(pid=86310) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 23 14:49:37 devstack cinder-volume[86310]: DEBUG cinder.volume.volume_utils [None req-8fb3c833-0ca0-4f40-a534-9eb4c628486d tempest-VolumeImageDependencyTests-2039293394 None] Marking volume f9172a8d-b73f-42f0-8f2a-cbefbb53a6df as bootable. {{(pid=86310) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 23 14:49:37 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fb3c833-0ca0-4f40-a534-9eb4c628486d tempest-VolumeImageDependencyTests-2039293394 None] Copying metadata from image 3ff3495b-4ed3-42d5-a25b-18cd8e71f5fd to f9172a8d-b73f-42f0-8f2a-cbefbb53a6df. {{(pid=86310) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 23 14:49:37 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fb3c833-0ca0-4f40-a534-9eb4c628486d tempest-VolumeImageDependencyTests-2039293394 None] Creating volume glance metadata for volume f9172a8d-b73f-42f0-8f2a-cbefbb53a6df backed by image 3ff3495b-4ed3-42d5-a25b-18cd8e71f5fd with: {'image_id': '3ff3495b-4ed3-42d5-a25b-18cd8e71f5fd', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '53c731a7d1f77f0a857eb42280322884', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86310) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 23 14:49:37 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-8fb3c833-0ca0-4f40-a534-9eb4c628486d tempest-VolumeImageDependencyTests-2039293394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af61f796-5baf-4e8a-a146-d185448f8f65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9172a8d-b73f-42f0-8f2a-cbefbb53a6df', 'volume_size': 1, 'image_id': '3ff3495b-4ed3-42d5-a25b-18cd8e71f5fd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3ff3495b-4ed3-42d5-a25b-18cd8e71f5fd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '53c731a7d1f77f0a857eb42280322884', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'da76135fae5d451fba2e4c9d5b8c0446', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c13b1b5dd72b751f3d24fc0e8cf4e52571614a1406100c94f301ce726a8a8718fb6fc5e9fce0c44e4b0966c8debb9b55a0dac4c1ceeaab751934b8bc86b671c3', 'id': '3ff3495b-4ed3-42d5-a25b-18cd8e71f5fd', 'created_at': datetime.datetime(2026, 9, 23, 12, 49, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 23, 12, 49, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3ff3495b-4ed3-42d5-a25b-18cd8e71f5fd/file', 'properties': {}}, 'image_service': }' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:49:37 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-8fb3c833-0ca0-4f40-a534-9eb4c628486d tempest-VolumeImageDependencyTests-2039293394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b10dde9-ed7a-404c-acb4-cd09a446e65c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:49:37 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-8fb3c833-0ca0-4f40-a534-9eb4c628486d tempest-VolumeImageDependencyTests-2039293394 None] Volume volume-f9172a8d-b73f-42f0-8f2a-cbefbb53a6df (f9172a8d-b73f-42f0-8f2a-cbefbb53a6df): created successfully Sep 23 14:49:37 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-8fb3c833-0ca0-4f40-a534-9eb4c628486d tempest-VolumeImageDependencyTests-2039293394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b10dde9-ed7a-404c-acb4-cd09a446e65c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:49:37 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-8fb3c833-0ca0-4f40-a534-9eb4c628486d tempest-VolumeImageDependencyTests-2039293394 None] Flow 'volume_create_manager' (e5ea4def-aa6d-4b05-a00b-45bcd544738b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:49:37 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-8fb3c833-0ca0-4f40-a534-9eb4c628486d tempest-VolumeImageDependencyTests-2039293394 None] Created volume successfully. Sep 23 14:49:38 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-43128ea7-1cd5-4b6f-9fdc-a93f0a2aeff5 tempest-VolumeImageDependencyTests-2039293394 None] Acquiring lock "cinder-f9172a8d-b73f-42f0-8f2a-cbefbb53a6df-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:49:38 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-43128ea7-1cd5-4b6f-9fdc-a93f0a2aeff5 tempest-VolumeImageDependencyTests-2039293394 None] Lock "cinder-f9172a8d-b73f-42f0-8f2a-cbefbb53a6df-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:49:38 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-43128ea7-1cd5-4b6f-9fdc-a93f0a2aeff5 tempest-VolumeImageDependencyTests-2039293394 None] Acquiring lock "cinder-quobyte-f9172a8d-b73f-42f0-8f2a-cbefbb53a6df" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:49:38 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-43128ea7-1cd5-4b6f-9fdc-a93f0a2aeff5 tempest-VolumeImageDependencyTests-2039293394 None] Lock "cinder-quobyte-f9172a8d-b73f-42f0-8f2a-cbefbb53a6df" acquired by "delete_volume" :: waited 0.014s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:49:38 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a800ff-d0d8-4ad0-a60a-0864c4e4387b]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:49:38 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-43128ea7-1cd5-4b6f-9fdc-a93f0a2aeff5 tempest-VolumeImageDependencyTests-2039293394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-f9172a8d-b73f-42f0-8f2a-cbefbb53a6df {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:49:38 devstack sudo[103466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-f9172a8d-b73f-42f0-8f2a-cbefbb53a6df Sep 23 14:49:38 devstack sudo[103466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:49:38 devstack sudo[103466]: pam_unix(sudo:session): session closed for user root Sep 23 14:49:38 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-43128ea7-1cd5-4b6f-9fdc-a93f0a2aeff5 tempest-VolumeImageDependencyTests-2039293394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-f9172a8d-b73f-42f0-8f2a-cbefbb53a6df" returned: 0 in 0.353s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:49:38 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-43128ea7-1cd5-4b6f-9fdc-a93f0a2aeff5 tempest-VolumeImageDependencyTests-2039293394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-f9172a8d-b73f-42f0-8f2a-cbefbb53a6df {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:49:38 devstack sudo[103471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-f9172a8d-b73f-42f0-8f2a-cbefbb53a6df Sep 23 14:49:38 devstack sudo[103471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:49:38 devstack sudo[103471]: pam_unix(sudo:session): session closed for user root Sep 23 14:49:38 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-43128ea7-1cd5-4b6f-9fdc-a93f0a2aeff5 tempest-VolumeImageDependencyTests-2039293394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-f9172a8d-b73f-42f0-8f2a-cbefbb53a6df" returned: 0 in 0.242s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:49:38 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-43128ea7-1cd5-4b6f-9fdc-a93f0a2aeff5 tempest-VolumeImageDependencyTests-2039293394 None] Lock "cinder-quobyte-f9172a8d-b73f-42f0-8f2a-cbefbb53a6df" released by "delete_volume" :: held 0.635s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:49:38 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-43128ea7-1cd5-4b6f-9fdc-a93f0a2aeff5 tempest-VolumeImageDependencyTests-2039293394 None] Created reservations ['9d29557a-4b47-48af-ac3d-89f7b4d13cd9', 'c0946a66-80bf-4bc6-8964-d376437f2f82', 'b6351b46-a987-4207-ae08-faba378957c4', 'c4a023f6-1275-43f8-8d29-76bb92ab1c01'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:49:39 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-43128ea7-1cd5-4b6f-9fdc-a93f0a2aeff5 tempest-VolumeImageDependencyTests-2039293394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:49:39 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-43128ea7-1cd5-4b6f-9fdc-a93f0a2aeff5 tempest-VolumeImageDependencyTests-2039293394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:49:39 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-43128ea7-1cd5-4b6f-9fdc-a93f0a2aeff5 tempest-VolumeImageDependencyTests-2039293394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:49:39 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-43128ea7-1cd5-4b6f-9fdc-a93f0a2aeff5 tempest-VolumeImageDependencyTests-2039293394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:49:39 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-43128ea7-1cd5-4b6f-9fdc-a93f0a2aeff5 tempest-VolumeImageDependencyTests-2039293394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:49:39 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-43128ea7-1cd5-4b6f-9fdc-a93f0a2aeff5 tempest-VolumeImageDependencyTests-2039293394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:49:39 devstack sudo[103474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:49:39 devstack sudo[103474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:49:39 devstack sudo[103474]: pam_unix(sudo:session): session closed for user root Sep 23 14:49:39 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-43128ea7-1cd5-4b6f-9fdc-a93f0a2aeff5 tempest-VolumeImageDependencyTests-2039293394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.250s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:49:39 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-43128ea7-1cd5-4b6f-9fdc-a93f0a2aeff5 tempest-VolumeImageDependencyTests-2039293394 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:49:39 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-43128ea7-1cd5-4b6f-9fdc-a93f0a2aeff5 tempest-VolumeImageDependencyTests-2039293394 None] Deleted volume successfully. Sep 23 14:49:39 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-43128ea7-1cd5-4b6f-9fdc-a93f0a2aeff5 tempest-VolumeImageDependencyTests-2039293394 None] Lock "cinder-f9172a8d-b73f-42f0-8f2a-cbefbb53a6df-delete_volume" released by "delete_volume" :: held 1.099s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:49:42 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffbe2db3-b7ff-41ca-8150-89526b94e49f tempest-CinderUnicodeTest-1607104852 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:49:42 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-ffbe2db3-b7ff-41ca-8150-89526b94e49f tempest-CinderUnicodeTest-1607104852 None] Flow 'volume_create_manager' (46996d97-76be-4075-925b-c49ccb205dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:49:42 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-ffbe2db3-b7ff-41ca-8150-89526b94e49f tempest-CinderUnicodeTest-1607104852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2eb0be09-53e3-43cd-9d45-d654e2456b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:49:42 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-ffbe2db3-b7ff-41ca-8150-89526b94e49f tempest-CinderUnicodeTest-1607104852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2eb0be09-53e3-43cd-9d45-d654e2456b85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:49:42Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41787d26-c1e2-4e00-a91b-cb1134fbf0a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00953bbb8c6f44ac936d06e15bb72cec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:49:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:49:42Z,use_quota=True,user_id='d2ee24f8a0594a2fa57e5606bce4fb1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:49:42 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-ffbe2db3-b7ff-41ca-8150-89526b94e49f tempest-CinderUnicodeTest-1607104852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54a15d58-70f4-4f25-b1b6-e0c69a6070ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:49:42 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-ffbe2db3-b7ff-41ca-8150-89526b94e49f tempest-CinderUnicodeTest-1607104852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54a15d58-70f4-4f25-b1b6-e0c69a6070ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:49:42 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-ffbe2db3-b7ff-41ca-8150-89526b94e49f tempest-CinderUnicodeTest-1607104852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f2d1614-8327-4468-8a94-d8d0080f14db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:49:42 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-ffbe2db3-b7ff-41ca-8150-89526b94e49f tempest-CinderUnicodeTest-1607104852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f2d1614-8327-4468-8a94-d8d0080f14db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41787d26-c1e2-4e00-a91b-cb1134fbf0a0', 'volume_name': 'volume-41787d26-c1e2-4e00-a91b-cb1134fbf0a0', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:49:42 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-ffbe2db3-b7ff-41ca-8150-89526b94e49f tempest-CinderUnicodeTest-1607104852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33e71a17-53eb-4faf-a4ca-22f0cc2a49c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:49:42 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-ffbe2db3-b7ff-41ca-8150-89526b94e49f tempest-CinderUnicodeTest-1607104852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33e71a17-53eb-4faf-a4ca-22f0cc2a49c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:49:42 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-ffbe2db3-b7ff-41ca-8150-89526b94e49f tempest-CinderUnicodeTest-1607104852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1094e565-9325-4c1b-a9f7-86a6cce325dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:49:42 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-ffbe2db3-b7ff-41ca-8150-89526b94e49f tempest-CinderUnicodeTest-1607104852 None] Volume 41787d26-c1e2-4e00-a91b-cb1134fbf0a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41787d26-c1e2-4e00-a91b-cb1134fbf0a0', 'volume_size': 1} Sep 23 14:49:42 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-ffbe2db3-b7ff-41ca-8150-89526b94e49f tempest-CinderUnicodeTest-1607104852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:49:42 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-ffbe2db3-b7ff-41ca-8150-89526b94e49f tempest-CinderUnicodeTest-1607104852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:49:42 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-ffbe2db3-b7ff-41ca-8150-89526b94e49f tempest-CinderUnicodeTest-1607104852 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:49:42Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41787d26-c1e2-4e00-a91b-cb1134fbf0a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00953bbb8c6f44ac936d06e15bb72cec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:49:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:49:42Z,use_quota=True,user_id='d2ee24f8a0594a2fa57e5606bce4fb1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:49:42 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-ffbe2db3-b7ff-41ca-8150-89526b94e49f tempest-CinderUnicodeTest-1607104852 None] Creating volume 41787d26-c1e2-4e00-a91b-cb1134fbf0a0 {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:49:42 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-ffbe2db3-b7ff-41ca-8150-89526b94e49f tempest-CinderUnicodeTest-1607104852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:49:42 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-ffbe2db3-b7ff-41ca-8150-89526b94e49f tempest-CinderUnicodeTest-1607104852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:49:42 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-ffbe2db3-b7ff-41ca-8150-89526b94e49f tempest-CinderUnicodeTest-1607104852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:49:42 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-ffbe2db3-b7ff-41ca-8150-89526b94e49f tempest-CinderUnicodeTest-1607104852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:49:42 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-ffbe2db3-b7ff-41ca-8150-89526b94e49f tempest-CinderUnicodeTest-1607104852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:49:42 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-ffbe2db3-b7ff-41ca-8150-89526b94e49f tempest-CinderUnicodeTest-1607104852 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:49:42 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-ffbe2db3-b7ff-41ca-8150-89526b94e49f tempest-CinderUnicodeTest-1607104852 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:49:42 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ffbe2db3-b7ff-41ca-8150-89526b94e49f tempest-CinderUnicodeTest-1607104852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-41787d26-c1e2-4e00-a91b-cb1134fbf0a0 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:49:42 devstack sudo[103479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-41787d26-c1e2-4e00-a91b-cb1134fbf0a0 1073741824 Sep 23 14:49:42 devstack sudo[103479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:49:42 devstack sudo[103479]: pam_unix(sudo:session): session closed for user root Sep 23 14:49:42 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ffbe2db3-b7ff-41ca-8150-89526b94e49f tempest-CinderUnicodeTest-1607104852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-41787d26-c1e2-4e00-a91b-cb1134fbf0a0 1073741824" returned: 0 in 0.414s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:49:42 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ffbe2db3-b7ff-41ca-8150-89526b94e49f tempest-CinderUnicodeTest-1607104852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-41787d26-c1e2-4e00-a91b-cb1134fbf0a0 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:49:42 devstack sudo[103486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-41787d26-c1e2-4e00-a91b-cb1134fbf0a0 Sep 23 14:49:42 devstack sudo[103486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:49:43 devstack sudo[103486]: pam_unix(sudo:session): session closed for user root Sep 23 14:49:43 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ffbe2db3-b7ff-41ca-8150-89526b94e49f tempest-CinderUnicodeTest-1607104852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-41787d26-c1e2-4e00-a91b-cb1134fbf0a0" returned: 0 in 0.237s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:49:43 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-ffbe2db3-b7ff-41ca-8150-89526b94e49f tempest-CinderUnicodeTest-1607104852 None] <== create_volume: return (695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:49:43 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-ffbe2db3-b7ff-41ca-8150-89526b94e49f tempest-CinderUnicodeTest-1607104852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.698s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:49:43 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-ffbe2db3-b7ff-41ca-8150-89526b94e49f tempest-CinderUnicodeTest-1607104852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1094e565-9325-4c1b-a9f7-86a6cce325dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41787d26-c1e2-4e00-a91b-cb1134fbf0a0', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:49:43 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-ffbe2db3-b7ff-41ca-8150-89526b94e49f tempest-CinderUnicodeTest-1607104852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (937df8ac-a333-4217-a593-8477e7283670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:49:43 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-ffbe2db3-b7ff-41ca-8150-89526b94e49f tempest-CinderUnicodeTest-1607104852 None] Volume volume-41787d26-c1e2-4e00-a91b-cb1134fbf0a0 (41787d26-c1e2-4e00-a91b-cb1134fbf0a0): created successfully Sep 23 14:49:43 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-ffbe2db3-b7ff-41ca-8150-89526b94e49f tempest-CinderUnicodeTest-1607104852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (937df8ac-a333-4217-a593-8477e7283670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:49:43 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-ffbe2db3-b7ff-41ca-8150-89526b94e49f tempest-CinderUnicodeTest-1607104852 None] Flow 'volume_create_manager' (46996d97-76be-4075-925b-c49ccb205dae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:49:43 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-ffbe2db3-b7ff-41ca-8150-89526b94e49f tempest-CinderUnicodeTest-1607104852 None] Created volume successfully. Sep 23 14:49:43 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1d70ea7-03e2-4856-a629-b412b34a5ed7 tempest-CinderUnicodeTest-1607104852 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:49:43 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-f1d70ea7-03e2-4856-a629-b412b34a5ed7 tempest-CinderUnicodeTest-1607104852 None] Flow 'volume_create_manager' (36415aec-9eb5-4209-9265-d0f1b7d89d77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:49:43 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-f1d70ea7-03e2-4856-a629-b412b34a5ed7 tempest-CinderUnicodeTest-1607104852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59318453-9515-4e0a-897e-d9e6d964fbb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:49:43 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-f1d70ea7-03e2-4856-a629-b412b34a5ed7 tempest-CinderUnicodeTest-1607104852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59318453-9515-4e0a-897e-d9e6d964fbb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:49:44Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1662943105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6576a296-d30f-40c4-8ac7-5d6c6d99e269,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00953bbb8c6f44ac936d06e15bb72cec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:49:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:49:44Z,use_quota=True,user_id='d2ee24f8a0594a2fa57e5606bce4fb1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:49:43 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-f1d70ea7-03e2-4856-a629-b412b34a5ed7 tempest-CinderUnicodeTest-1607104852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65604074-29f0-4b02-a0c0-202c0ba9e976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:49:43 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-f1d70ea7-03e2-4856-a629-b412b34a5ed7 tempest-CinderUnicodeTest-1607104852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65604074-29f0-4b02-a0c0-202c0ba9e976) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:49:43 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-f1d70ea7-03e2-4856-a629-b412b34a5ed7 tempest-CinderUnicodeTest-1607104852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0a07319-b930-4280-aafb-405bd9842d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:49:43 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-f1d70ea7-03e2-4856-a629-b412b34a5ed7 tempest-CinderUnicodeTest-1607104852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0a07319-b930-4280-aafb-405bd9842d59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6576a296-d30f-40c4-8ac7-5d6c6d99e269', 'volume_name': 'volume-6576a296-d30f-40c4-8ac7-5d6c6d99e269', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:49:43 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-f1d70ea7-03e2-4856-a629-b412b34a5ed7 tempest-CinderUnicodeTest-1607104852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a7f319f-1dab-4deb-9267-7274dc44ee5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:49:43 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-f1d70ea7-03e2-4856-a629-b412b34a5ed7 tempest-CinderUnicodeTest-1607104852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a7f319f-1dab-4deb-9267-7274dc44ee5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:49:43 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-f1d70ea7-03e2-4856-a629-b412b34a5ed7 tempest-CinderUnicodeTest-1607104852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1665fd0c-caae-48be-ac30-4b29da403c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:49:43 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-f1d70ea7-03e2-4856-a629-b412b34a5ed7 tempest-CinderUnicodeTest-1607104852 None] Volume 6576a296-d30f-40c4-8ac7-5d6c6d99e269: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6576a296-d30f-40c4-8ac7-5d6c6d99e269', 'volume_size': 1} Sep 23 14:49:43 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-f1d70ea7-03e2-4856-a629-b412b34a5ed7 tempest-CinderUnicodeTest-1607104852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:49:43 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-f1d70ea7-03e2-4856-a629-b412b34a5ed7 tempest-CinderUnicodeTest-1607104852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:49:43 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-f1d70ea7-03e2-4856-a629-b412b34a5ed7 tempest-CinderUnicodeTest-1607104852 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:49:44Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1662943105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6576a296-d30f-40c4-8ac7-5d6c6d99e269,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00953bbb8c6f44ac936d06e15bb72cec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:49:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:49:44Z,use_quota=True,user_id='d2ee24f8a0594a2fa57e5606bce4fb1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:49:43 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-f1d70ea7-03e2-4856-a629-b412b34a5ed7 tempest-CinderUnicodeTest-1607104852 None] Creating volume 6576a296-d30f-40c4-8ac7-5d6c6d99e269 {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:49:43 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-f1d70ea7-03e2-4856-a629-b412b34a5ed7 tempest-CinderUnicodeTest-1607104852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:49:43 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-f1d70ea7-03e2-4856-a629-b412b34a5ed7 tempest-CinderUnicodeTest-1607104852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:49:43 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-f1d70ea7-03e2-4856-a629-b412b34a5ed7 tempest-CinderUnicodeTest-1607104852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:49:43 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-f1d70ea7-03e2-4856-a629-b412b34a5ed7 tempest-CinderUnicodeTest-1607104852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:49:43 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-f1d70ea7-03e2-4856-a629-b412b34a5ed7 tempest-CinderUnicodeTest-1607104852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:49:43 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-f1d70ea7-03e2-4856-a629-b412b34a5ed7 tempest-CinderUnicodeTest-1607104852 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:49:43 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-f1d70ea7-03e2-4856-a629-b412b34a5ed7 tempest-CinderUnicodeTest-1607104852 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:49:43 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-f1d70ea7-03e2-4856-a629-b412b34a5ed7 tempest-CinderUnicodeTest-1607104852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6576a296-d30f-40c4-8ac7-5d6c6d99e269 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:49:43 devstack sudo[103489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6576a296-d30f-40c4-8ac7-5d6c6d99e269 1073741824 Sep 23 14:49:43 devstack sudo[103489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:49:44 devstack sudo[103489]: pam_unix(sudo:session): session closed for user root Sep 23 14:49:44 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-f1d70ea7-03e2-4856-a629-b412b34a5ed7 tempest-CinderUnicodeTest-1607104852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6576a296-d30f-40c4-8ac7-5d6c6d99e269 1073741824" returned: 0 in 0.411s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:49:44 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-f1d70ea7-03e2-4856-a629-b412b34a5ed7 tempest-CinderUnicodeTest-1607104852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6576a296-d30f-40c4-8ac7-5d6c6d99e269 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:49:44 devstack sudo[103494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6576a296-d30f-40c4-8ac7-5d6c6d99e269 Sep 23 14:49:44 devstack sudo[103494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:49:44 devstack sudo[103494]: pam_unix(sudo:session): session closed for user root Sep 23 14:49:44 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-f1d70ea7-03e2-4856-a629-b412b34a5ed7 tempest-CinderUnicodeTest-1607104852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6576a296-d30f-40c4-8ac7-5d6c6d99e269" returned: 0 in 0.248s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:49:44 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-f1d70ea7-03e2-4856-a629-b412b34a5ed7 tempest-CinderUnicodeTest-1607104852 None] <== create_volume: return (699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:49:44 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-f1d70ea7-03e2-4856-a629-b412b34a5ed7 tempest-CinderUnicodeTest-1607104852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.702s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:49:44 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-f1d70ea7-03e2-4856-a629-b412b34a5ed7 tempest-CinderUnicodeTest-1607104852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1665fd0c-caae-48be-ac30-4b29da403c6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6576a296-d30f-40c4-8ac7-5d6c6d99e269', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:49:44 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-f1d70ea7-03e2-4856-a629-b412b34a5ed7 tempest-CinderUnicodeTest-1607104852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fa715c7-0fe6-479e-805b-eddac23d409b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:49:44 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-f1d70ea7-03e2-4856-a629-b412b34a5ed7 tempest-CinderUnicodeTest-1607104852 None] Volume volume-6576a296-d30f-40c4-8ac7-5d6c6d99e269 (6576a296-d30f-40c4-8ac7-5d6c6d99e269): created successfully Sep 23 14:49:44 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-f1d70ea7-03e2-4856-a629-b412b34a5ed7 tempest-CinderUnicodeTest-1607104852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fa715c7-0fe6-479e-805b-eddac23d409b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:49:44 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-f1d70ea7-03e2-4856-a629-b412b34a5ed7 tempest-CinderUnicodeTest-1607104852 None] Flow 'volume_create_manager' (36415aec-9eb5-4209-9265-d0f1b7d89d77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:49:44 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-f1d70ea7-03e2-4856-a629-b412b34a5ed7 tempest-CinderUnicodeTest-1607104852 None] Created volume successfully. Sep 23 14:49:45 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-778e0d72-7ddb-4dc2-9263-7b39f11d64b3 tempest-CinderUnicodeTest-1607104852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:49:45 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-778e0d72-7ddb-4dc2-9263-7b39f11d64b3 tempest-CinderUnicodeTest-1607104852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:49:45 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-778e0d72-7ddb-4dc2-9263-7b39f11d64b3 tempest-CinderUnicodeTest-1607104852 None] Creating offline snapshot 3f977947-3040-459d-8779-a5ec8b9439fb of volume 6576a296-d30f-40c4-8ac7-5d6c6d99e269 {{(pid=86310) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 14:49:45 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cb65c91-d27a-484f-b81f-dd00ff17dd05]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:49:45 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-778e0d72-7ddb-4dc2-9263-7b39f11d64b3 tempest-CinderUnicodeTest-1607104852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6576a296-d30f-40c4-8ac7-5d6c6d99e269 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:49:45 devstack sudo[103497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6576a296-d30f-40c4-8ac7-5d6c6d99e269 Sep 23 14:49:45 devstack sudo[103497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:49:45 devstack sudo[103497]: pam_unix(sudo:session): session closed for user root Sep 23 14:49:45 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-778e0d72-7ddb-4dc2-9263-7b39f11d64b3 tempest-CinderUnicodeTest-1607104852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6576a296-d30f-40c4-8ac7-5d6c6d99e269" returned: 0 in 0.351s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:49:45 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-778e0d72-7ddb-4dc2-9263-7b39f11d64b3 tempest-CinderUnicodeTest-1607104852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6576a296-d30f-40c4-8ac7-5d6c6d99e269,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6576a296-d30f-40c4-8ac7-5d6c6d99e269.3f977947-3040-459d-8779-a5ec8b9439fb 1G {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:49:45 devstack sudo[103502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6576a296-d30f-40c4-8ac7-5d6c6d99e269,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6576a296-d30f-40c4-8ac7-5d6c6d99e269.3f977947-3040-459d-8779-a5ec8b9439fb 1G Sep 23 14:49:45 devstack sudo[103502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:49:45 devstack sudo[103502]: pam_unix(sudo:session): session closed for user root Sep 23 14:49:45 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-778e0d72-7ddb-4dc2-9263-7b39f11d64b3 tempest-CinderUnicodeTest-1607104852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6576a296-d30f-40c4-8ac7-5d6c6d99e269,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6576a296-d30f-40c4-8ac7-5d6c6d99e269.3f977947-3040-459d-8779-a5ec8b9439fb 1G" returned: 0 in 0.366s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:49:45 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-778e0d72-7ddb-4dc2-9263-7b39f11d64b3 tempest-CinderUnicodeTest-1607104852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6576a296-d30f-40c4-8ac7-5d6c6d99e269 -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6576a296-d30f-40c4-8ac7-5d6c6d99e269.3f977947-3040-459d-8779-a5ec8b9439fb {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:49:45 devstack sudo[103508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6576a296-d30f-40c4-8ac7-5d6c6d99e269 -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6576a296-d30f-40c4-8ac7-5d6c6d99e269.3f977947-3040-459d-8779-a5ec8b9439fb Sep 23 14:49:45 devstack sudo[103508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:49:46 devstack sudo[103508]: pam_unix(sudo:session): session closed for user root Sep 23 14:49:46 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-778e0d72-7ddb-4dc2-9263-7b39f11d64b3 tempest-CinderUnicodeTest-1607104852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6576a296-d30f-40c4-8ac7-5d6c6d99e269 -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6576a296-d30f-40c4-8ac7-5d6c6d99e269.3f977947-3040-459d-8779-a5ec8b9439fb" returned: 0 in 0.277s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:49:46 devstack cinder-volume[86310]: WARNING cinder.volume.drivers.remotefs [None req-778e0d72-7ddb-4dc2-9263-7b39f11d64b3 tempest-CinderUnicodeTest-1607104852 None] /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6576a296-d30f-40c4-8ac7-5d6c6d99e269.3f977947-3040-459d-8779-a5ec8b9439fb is being set with open permissions: ugo+rw Sep 23 14:49:46 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-778e0d72-7ddb-4dc2-9263-7b39f11d64b3 tempest-CinderUnicodeTest-1607104852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6576a296-d30f-40c4-8ac7-5d6c6d99e269.3f977947-3040-459d-8779-a5ec8b9439fb {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:49:46 devstack sudo[103513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6576a296-d30f-40c4-8ac7-5d6c6d99e269.3f977947-3040-459d-8779-a5ec8b9439fb Sep 23 14:49:46 devstack sudo[103513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:49:46 devstack sudo[103513]: pam_unix(sudo:session): session closed for user root Sep 23 14:49:46 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-778e0d72-7ddb-4dc2-9263-7b39f11d64b3 tempest-CinderUnicodeTest-1607104852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6576a296-d30f-40c4-8ac7-5d6c6d99e269.3f977947-3040-459d-8779-a5ec8b9439fb" returned: 0 in 0.235s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:49:46 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-778e0d72-7ddb-4dc2-9263-7b39f11d64b3 tempest-CinderUnicodeTest-1607104852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6576a296-d30f-40c4-8ac7-5d6c6d99e269.info {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:49:46 devstack sudo[103516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6576a296-d30f-40c4-8ac7-5d6c6d99e269.info Sep 23 14:49:46 devstack sudo[103516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:49:46 devstack sudo[103516]: pam_unix(sudo:session): session closed for user root Sep 23 14:49:46 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-778e0d72-7ddb-4dc2-9263-7b39f11d64b3 tempest-CinderUnicodeTest-1607104852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6576a296-d30f-40c4-8ac7-5d6c6d99e269.info" returned: 0 in 0.240s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:49:46 devstack cinder-volume[86310]: WARNING cinder.volume.drivers.remotefs [None req-778e0d72-7ddb-4dc2-9263-7b39f11d64b3 tempest-CinderUnicodeTest-1607104852 None] /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6576a296-d30f-40c4-8ac7-5d6c6d99e269.info is being set with open permissions: ugo+rw Sep 23 14:49:46 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-778e0d72-7ddb-4dc2-9263-7b39f11d64b3 tempest-CinderUnicodeTest-1607104852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6576a296-d30f-40c4-8ac7-5d6c6d99e269.info {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:49:46 devstack sudo[103519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6576a296-d30f-40c4-8ac7-5d6c6d99e269.info Sep 23 14:49:46 devstack sudo[103519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:49:46 devstack sudo[103519]: pam_unix(sudo:session): session closed for user root Sep 23 14:49:46 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-778e0d72-7ddb-4dc2-9263-7b39f11d64b3 tempest-CinderUnicodeTest-1607104852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6576a296-d30f-40c4-8ac7-5d6c6d99e269.info" returned: 0 in 0.236s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:49:46 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-778e0d72-7ddb-4dc2-9263-7b39f11d64b3 tempest-CinderUnicodeTest-1607104852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.789s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:49:46 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-778e0d72-7ddb-4dc2-9263-7b39f11d64b3 tempest-CinderUnicodeTest-1607104852 None] Create snapshot completed successfully Sep 23 14:49:47 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-42642394-f949-4de4-877a-2d4c17673314 tempest-CinderUnicodeTest-1607104852 None] Acquiring lock "cinder-3f977947-3040-459d-8779-a5ec8b9439fb-delete_snapshot" by "delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:49:47 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-42642394-f949-4de4-877a-2d4c17673314 tempest-CinderUnicodeTest-1607104852 None] Lock "cinder-3f977947-3040-459d-8779-a5ec8b9439fb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:49:47 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-42642394-f949-4de4-877a-2d4c17673314 tempest-CinderUnicodeTest-1607104852 None] Acquiring lock "cinder-quobyte-6576a296-d30f-40c4-8ac7-5d6c6d99e269" by "delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:49:47 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-42642394-f949-4de4-877a-2d4c17673314 tempest-CinderUnicodeTest-1607104852 None] Lock "cinder-quobyte-6576a296-d30f-40c4-8ac7-5d6c6d99e269" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:49:47 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-42642394-f949-4de4-877a-2d4c17673314 tempest-CinderUnicodeTest-1607104852 None] Acquiring lock "cinder-quobyte-3f977947-3040-459d-8779-a5ec8b9439fb" by "_delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:49:47 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-42642394-f949-4de4-877a-2d4c17673314 tempest-CinderUnicodeTest-1607104852 None] Lock "cinder-quobyte-3f977947-3040-459d-8779-a5ec8b9439fb" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:49:47 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-42642394-f949-4de4-877a-2d4c17673314 tempest-CinderUnicodeTest-1607104852 None] Deleting offline snapshot 3f977947-3040-459d-8779-a5ec8b9439fb of volume 6576a296-d30f-40c4-8ac7-5d6c6d99e269 {{(pid=86310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 14:49:47 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-42642394-f949-4de4-877a-2d4c17673314 tempest-CinderUnicodeTest-1607104852 None] snapshot_file for this snap is: volume-6576a296-d30f-40c4-8ac7-5d6c6d99e269.3f977947-3040-459d-8779-a5ec8b9439fb {{(pid=86310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 14:49:47 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[52e887a2-d187-4317-908a-b4df492343f4]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:49:47 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-42642394-f949-4de4-877a-2d4c17673314 tempest-CinderUnicodeTest-1607104852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6576a296-d30f-40c4-8ac7-5d6c6d99e269.3f977947-3040-459d-8779-a5ec8b9439fb {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:49:47 devstack sudo[103522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6576a296-d30f-40c4-8ac7-5d6c6d99e269.3f977947-3040-459d-8779-a5ec8b9439fb Sep 23 14:49:47 devstack sudo[103522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:49:47 devstack sudo[103522]: pam_unix(sudo:session): session closed for user root Sep 23 14:49:47 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-42642394-f949-4de4-877a-2d4c17673314 tempest-CinderUnicodeTest-1607104852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6576a296-d30f-40c4-8ac7-5d6c6d99e269.3f977947-3040-459d-8779-a5ec8b9439fb" returned: 0 in 0.346s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:49:47 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-42642394-f949-4de4-877a-2d4c17673314 tempest-CinderUnicodeTest-1607104852 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6576a296-d30f-40c4-8ac7-5d6c6d99e269(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 14:49:47 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ba0b7e2-b9b9-4ff4-8889-f8554ea03c84]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:49:47 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-42642394-f949-4de4-877a-2d4c17673314 tempest-CinderUnicodeTest-1607104852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6576a296-d30f-40c4-8ac7-5d6c6d99e269 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:49:47 devstack sudo[103527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6576a296-d30f-40c4-8ac7-5d6c6d99e269 Sep 23 14:49:47 devstack sudo[103527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:49:47 devstack sudo[103527]: pam_unix(sudo:session): session closed for user root Sep 23 14:49:47 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-42642394-f949-4de4-877a-2d4c17673314 tempest-CinderUnicodeTest-1607104852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6576a296-d30f-40c4-8ac7-5d6c6d99e269" returned: 0 in 0.340s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:49:47 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-42642394-f949-4de4-877a-2d4c17673314 tempest-CinderUnicodeTest-1607104852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6576a296-d30f-40c4-8ac7-5d6c6d99e269.3f977947-3040-459d-8779-a5ec8b9439fb {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:49:47 devstack sudo[103532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6576a296-d30f-40c4-8ac7-5d6c6d99e269.3f977947-3040-459d-8779-a5ec8b9439fb Sep 23 14:49:47 devstack sudo[103532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:49:48 devstack sudo[103532]: pam_unix(sudo:session): session closed for user root Sep 23 14:49:48 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-42642394-f949-4de4-877a-2d4c17673314 tempest-CinderUnicodeTest-1607104852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6576a296-d30f-40c4-8ac7-5d6c6d99e269.3f977947-3040-459d-8779-a5ec8b9439fb" returned: 0 in 0.315s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:49:48 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-42642394-f949-4de4-877a-2d4c17673314 tempest-CinderUnicodeTest-1607104852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6576a296-d30f-40c4-8ac7-5d6c6d99e269.3f977947-3040-459d-8779-a5ec8b9439fb {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:49:48 devstack sudo[103537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6576a296-d30f-40c4-8ac7-5d6c6d99e269.3f977947-3040-459d-8779-a5ec8b9439fb Sep 23 14:49:48 devstack sudo[103537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:49:48 devstack sudo[103537]: pam_unix(sudo:session): session closed for user root Sep 23 14:49:48 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-42642394-f949-4de4-877a-2d4c17673314 tempest-CinderUnicodeTest-1607104852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6576a296-d30f-40c4-8ac7-5d6c6d99e269.3f977947-3040-459d-8779-a5ec8b9439fb" returned: 0 in 0.253s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:49:48 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-42642394-f949-4de4-877a-2d4c17673314 tempest-CinderUnicodeTest-1607104852 None] Lock "cinder-quobyte-3f977947-3040-459d-8779-a5ec8b9439fb" released by "_delete_snapshot" :: held 1.353s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:49:48 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-42642394-f949-4de4-877a-2d4c17673314 tempest-CinderUnicodeTest-1607104852 None] Lock "cinder-quobyte-6576a296-d30f-40c4-8ac7-5d6c6d99e269" released by "delete_snapshot" :: held 1.374s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:49:48 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-42642394-f949-4de4-877a-2d4c17673314 tempest-CinderUnicodeTest-1607104852 None] Created reservations ['583ca1af-060e-42e2-910f-b5f54eb574cc', '1b50fe7f-9e78-427c-bd34-ae6f149f872d', '440569d2-4b63-4f4f-be90-8dd4e9cf9b79', '1c6a7bd5-9905-408b-93f4-668fe6c3993b'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:49:48 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-42642394-f949-4de4-877a-2d4c17673314 tempest-CinderUnicodeTest-1607104852 None] Delete snapshot completed successfully. Sep 23 14:49:48 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-42642394-f949-4de4-877a-2d4c17673314 tempest-CinderUnicodeTest-1607104852 None] Lock "cinder-3f977947-3040-459d-8779-a5ec8b9439fb-delete_snapshot" released by "delete_snapshot" :: held 1.492s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:49:49 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-ee3d3b4f-3321-4ad1-ad8f-790873a825bb tempest-CinderUnicodeTest-1607104852 None] Acquiring lock "cinder-6576a296-d30f-40c4-8ac7-5d6c6d99e269-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:49:49 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-ee3d3b4f-3321-4ad1-ad8f-790873a825bb tempest-CinderUnicodeTest-1607104852 None] Lock "cinder-6576a296-d30f-40c4-8ac7-5d6c6d99e269-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:49:49 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-ee3d3b4f-3321-4ad1-ad8f-790873a825bb tempest-CinderUnicodeTest-1607104852 None] Acquiring lock "cinder-quobyte-6576a296-d30f-40c4-8ac7-5d6c6d99e269" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:49:49 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-ee3d3b4f-3321-4ad1-ad8f-790873a825bb tempest-CinderUnicodeTest-1607104852 None] Lock "cinder-quobyte-6576a296-d30f-40c4-8ac7-5d6c6d99e269" acquired by "delete_volume" :: waited 0.019s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:49:49 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8564dff-8f5d-4909-9add-4fdd10e80649]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:49:49 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ee3d3b4f-3321-4ad1-ad8f-790873a825bb tempest-CinderUnicodeTest-1607104852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6576a296-d30f-40c4-8ac7-5d6c6d99e269 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:49:49 devstack sudo[103541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6576a296-d30f-40c4-8ac7-5d6c6d99e269 Sep 23 14:49:49 devstack sudo[103541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:49:49 devstack sudo[103541]: pam_unix(sudo:session): session closed for user root Sep 23 14:49:49 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ee3d3b4f-3321-4ad1-ad8f-790873a825bb tempest-CinderUnicodeTest-1607104852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6576a296-d30f-40c4-8ac7-5d6c6d99e269" returned: 0 in 0.343s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:49:49 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ee3d3b4f-3321-4ad1-ad8f-790873a825bb tempest-CinderUnicodeTest-1607104852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6576a296-d30f-40c4-8ac7-5d6c6d99e269 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:49:49 devstack sudo[103546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6576a296-d30f-40c4-8ac7-5d6c6d99e269 Sep 23 14:49:49 devstack sudo[103546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:49:49 devstack sudo[103546]: pam_unix(sudo:session): session closed for user root Sep 23 14:49:49 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ee3d3b4f-3321-4ad1-ad8f-790873a825bb tempest-CinderUnicodeTest-1607104852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6576a296-d30f-40c4-8ac7-5d6c6d99e269" returned: 0 in 0.230s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:49:49 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-ee3d3b4f-3321-4ad1-ad8f-790873a825bb tempest-CinderUnicodeTest-1607104852 None] Lock "cinder-quobyte-6576a296-d30f-40c4-8ac7-5d6c6d99e269" released by "delete_volume" :: held 0.635s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:49:50 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-ee3d3b4f-3321-4ad1-ad8f-790873a825bb tempest-CinderUnicodeTest-1607104852 None] Created reservations ['2ff7d284-8b2a-4804-a185-a5706e4a6cd0', '1b0a3088-73a4-4568-8a4e-643c946013d3', 'ede0947e-45bd-4725-9ccc-b1938d6ab2c6', '933694f7-9df1-4be5-bc7d-bb973a2f9b39'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:49:50 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-ee3d3b4f-3321-4ad1-ad8f-790873a825bb tempest-CinderUnicodeTest-1607104852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:49:50 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-ee3d3b4f-3321-4ad1-ad8f-790873a825bb tempest-CinderUnicodeTest-1607104852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:49:50 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-ee3d3b4f-3321-4ad1-ad8f-790873a825bb tempest-CinderUnicodeTest-1607104852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:49:50 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-ee3d3b4f-3321-4ad1-ad8f-790873a825bb tempest-CinderUnicodeTest-1607104852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:49:50 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-ee3d3b4f-3321-4ad1-ad8f-790873a825bb tempest-CinderUnicodeTest-1607104852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:49:50 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ee3d3b4f-3321-4ad1-ad8f-790873a825bb tempest-CinderUnicodeTest-1607104852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:49:50 devstack sudo[103549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:49:50 devstack sudo[103549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:49:50 devstack sudo[103549]: pam_unix(sudo:session): session closed for user root Sep 23 14:49:50 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ee3d3b4f-3321-4ad1-ad8f-790873a825bb tempest-CinderUnicodeTest-1607104852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.239s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:49:50 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-ee3d3b4f-3321-4ad1-ad8f-790873a825bb tempest-CinderUnicodeTest-1607104852 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:49:50 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-ee3d3b4f-3321-4ad1-ad8f-790873a825bb tempest-CinderUnicodeTest-1607104852 None] Deleted volume successfully. Sep 23 14:49:50 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-ee3d3b4f-3321-4ad1-ad8f-790873a825bb tempest-CinderUnicodeTest-1607104852 None] Lock "cinder-6576a296-d30f-40c4-8ac7-5d6c6d99e269-delete_volume" released by "delete_volume" :: held 1.064s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:49:50 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-295a372e-8d8f-4d00-a63a-b85ea482bb5f tempest-CinderUnicodeTest-1607104852 None] Acquiring lock "cinder-41787d26-c1e2-4e00-a91b-cb1134fbf0a0-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:49:50 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-295a372e-8d8f-4d00-a63a-b85ea482bb5f tempest-CinderUnicodeTest-1607104852 None] Lock "cinder-41787d26-c1e2-4e00-a91b-cb1134fbf0a0-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:49:50 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-295a372e-8d8f-4d00-a63a-b85ea482bb5f tempest-CinderUnicodeTest-1607104852 None] Acquiring lock "cinder-quobyte-41787d26-c1e2-4e00-a91b-cb1134fbf0a0" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:49:50 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-295a372e-8d8f-4d00-a63a-b85ea482bb5f tempest-CinderUnicodeTest-1607104852 None] Lock "cinder-quobyte-41787d26-c1e2-4e00-a91b-cb1134fbf0a0" acquired by "delete_volume" :: waited 0.014s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:49:50 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecdd2d62-7207-4079-8ef7-00346a7e6d44]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:49:50 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-295a372e-8d8f-4d00-a63a-b85ea482bb5f tempest-CinderUnicodeTest-1607104852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-41787d26-c1e2-4e00-a91b-cb1134fbf0a0 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:49:50 devstack sudo[103552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-41787d26-c1e2-4e00-a91b-cb1134fbf0a0 Sep 23 14:49:50 devstack sudo[103552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:49:50 devstack sudo[103552]: pam_unix(sudo:session): session closed for user root Sep 23 14:49:50 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-295a372e-8d8f-4d00-a63a-b85ea482bb5f tempest-CinderUnicodeTest-1607104852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-41787d26-c1e2-4e00-a91b-cb1134fbf0a0" returned: 0 in 0.349s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:49:50 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-295a372e-8d8f-4d00-a63a-b85ea482bb5f tempest-CinderUnicodeTest-1607104852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-41787d26-c1e2-4e00-a91b-cb1134fbf0a0 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:49:50 devstack sudo[103557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-41787d26-c1e2-4e00-a91b-cb1134fbf0a0 Sep 23 14:49:50 devstack sudo[103557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:49:51 devstack sudo[103557]: pam_unix(sudo:session): session closed for user root Sep 23 14:49:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-295a372e-8d8f-4d00-a63a-b85ea482bb5f tempest-CinderUnicodeTest-1607104852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-41787d26-c1e2-4e00-a91b-cb1134fbf0a0" returned: 0 in 0.256s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:49:51 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-295a372e-8d8f-4d00-a63a-b85ea482bb5f tempest-CinderUnicodeTest-1607104852 None] Lock "cinder-quobyte-41787d26-c1e2-4e00-a91b-cb1134fbf0a0" released by "delete_volume" :: held 0.644s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:49:51 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-295a372e-8d8f-4d00-a63a-b85ea482bb5f tempest-CinderUnicodeTest-1607104852 None] Created reservations ['cb2b99da-8b15-4329-9172-fd0b5430776f', '1a9eac57-f93d-4373-a075-4603f042f20b', 'c188f2d3-a95c-4433-9ee3-97608e423742', '828c1f63-9ec2-43d9-9fab-ca380905b91b'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:49:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-295a372e-8d8f-4d00-a63a-b85ea482bb5f tempest-CinderUnicodeTest-1607104852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:49:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-295a372e-8d8f-4d00-a63a-b85ea482bb5f tempest-CinderUnicodeTest-1607104852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:49:51 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-295a372e-8d8f-4d00-a63a-b85ea482bb5f tempest-CinderUnicodeTest-1607104852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:49:51 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-295a372e-8d8f-4d00-a63a-b85ea482bb5f tempest-CinderUnicodeTest-1607104852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:49:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-295a372e-8d8f-4d00-a63a-b85ea482bb5f tempest-CinderUnicodeTest-1607104852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:49:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-295a372e-8d8f-4d00-a63a-b85ea482bb5f tempest-CinderUnicodeTest-1607104852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:49:51 devstack sudo[103560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:49:51 devstack sudo[103560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:49:51 devstack cinder-volume[86310]: DEBUG oslo_service.periodic_task [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86310) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 14:49:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:49:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:49:51 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:49:51 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:49:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:49:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:49:51 devstack sudo[103562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:49:51 devstack sudo[103562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:49:51 devstack sudo[103560]: pam_unix(sudo:session): session closed for user root Sep 23 14:49:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-295a372e-8d8f-4d00-a63a-b85ea482bb5f tempest-CinderUnicodeTest-1607104852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.247s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:49:51 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-295a372e-8d8f-4d00-a63a-b85ea482bb5f tempest-CinderUnicodeTest-1607104852 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:49:51 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-295a372e-8d8f-4d00-a63a-b85ea482bb5f tempest-CinderUnicodeTest-1607104852 None] Deleted volume successfully. Sep 23 14:49:51 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-295a372e-8d8f-4d00-a63a-b85ea482bb5f tempest-CinderUnicodeTest-1607104852 None] Lock "cinder-41787d26-c1e2-4e00-a91b-cb1134fbf0a0-delete_volume" released by "delete_volume" :: held 1.083s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:49:51 devstack sudo[103562]: pam_unix(sudo:session): session closed for user root Sep 23 14:49:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.253s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:49:51 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:49:51 devstack cinder-volume[86310]: DEBUG oslo_service.periodic_task [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Running periodic task VolumeManager._thread_info {{(pid=86310) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 14:49:51 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] thread count: 28 {{(pid=86310) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 14:49:51 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] thread info: [<_MainThread(MainThread, started 128854208852096)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86310) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 14:50:01 devstack cinder-volume[86310]: DEBUG dbcounter [-] [86310] Writing DB stats cinder:UPDATE=124,cinder:SELECT=103,cinder:INSERT=42,cinder:DELETE=11 {{(pid=86310) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 14:50:01 devstack cinder-volume[86310]: DEBUG dbcounter [-] [86310] Writing DB stats cinder:SELECT=96,cinder:UPDATE=130,cinder:INSERT=37,cinder:DELETE=11 {{(pid=86310) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 14:50:13 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c96a5ce-6019-4964-a9b3-b3ba3a72f217 tempest-SnapshotDependencyTests-565089579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:50:13 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-5c96a5ce-6019-4964-a9b3-b3ba3a72f217 tempest-SnapshotDependencyTests-565089579 None] Flow 'volume_create_manager' (7e7bc1a8-00fa-4e4f-aaf4-e562961f6844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:50:13 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-5c96a5ce-6019-4964-a9b3-b3ba3a72f217 tempest-SnapshotDependencyTests-565089579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4297601-025d-4dc6-811a-085645ba572c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:50:13 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-5c96a5ce-6019-4964-a9b3-b3ba3a72f217 tempest-SnapshotDependencyTests-565089579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4297601-025d-4dc6-811a-085645ba572c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:50:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1980197473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a014cdc-c993-4d6a-bcc2-261b6f2b357c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f52462e6dffb45048b5f9de66e88c48a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:50:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:50:13Z,use_quota=True,user_id='1747b88c9ea647e894b238e52b6e7cb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:50:13 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-5c96a5ce-6019-4964-a9b3-b3ba3a72f217 tempest-SnapshotDependencyTests-565089579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a26b429-51f7-4e81-bf17-8802c7114418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:50:13 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-5c96a5ce-6019-4964-a9b3-b3ba3a72f217 tempest-SnapshotDependencyTests-565089579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a26b429-51f7-4e81-bf17-8802c7114418) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:50:13 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-5c96a5ce-6019-4964-a9b3-b3ba3a72f217 tempest-SnapshotDependencyTests-565089579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (494f17c9-65f0-4e97-9da6-cd7604957c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:50:13 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-5c96a5ce-6019-4964-a9b3-b3ba3a72f217 tempest-SnapshotDependencyTests-565089579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (494f17c9-65f0-4e97-9da6-cd7604957c94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a014cdc-c993-4d6a-bcc2-261b6f2b357c', 'volume_name': 'volume-9a014cdc-c993-4d6a-bcc2-261b6f2b357c', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:50:13 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-5c96a5ce-6019-4964-a9b3-b3ba3a72f217 tempest-SnapshotDependencyTests-565089579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (224224c4-d730-49e7-879f-af5e5cb2088e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:50:13 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-5c96a5ce-6019-4964-a9b3-b3ba3a72f217 tempest-SnapshotDependencyTests-565089579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (224224c4-d730-49e7-879f-af5e5cb2088e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:50:13 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-5c96a5ce-6019-4964-a9b3-b3ba3a72f217 tempest-SnapshotDependencyTests-565089579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d841a05-50e2-4d27-91b0-bb89dfb2fdd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:50:13 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-5c96a5ce-6019-4964-a9b3-b3ba3a72f217 tempest-SnapshotDependencyTests-565089579 None] Volume 9a014cdc-c993-4d6a-bcc2-261b6f2b357c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a014cdc-c993-4d6a-bcc2-261b6f2b357c', 'volume_size': 1} Sep 23 14:50:13 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-5c96a5ce-6019-4964-a9b3-b3ba3a72f217 tempest-SnapshotDependencyTests-565089579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:50:13 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-5c96a5ce-6019-4964-a9b3-b3ba3a72f217 tempest-SnapshotDependencyTests-565089579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:50:13 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-5c96a5ce-6019-4964-a9b3-b3ba3a72f217 tempest-SnapshotDependencyTests-565089579 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:50:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1980197473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a014cdc-c993-4d6a-bcc2-261b6f2b357c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f52462e6dffb45048b5f9de66e88c48a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:50:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:50:13Z,use_quota=True,user_id='1747b88c9ea647e894b238e52b6e7cb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:50:13 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-5c96a5ce-6019-4964-a9b3-b3ba3a72f217 tempest-SnapshotDependencyTests-565089579 None] Creating volume 9a014cdc-c993-4d6a-bcc2-261b6f2b357c {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:50:13 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-5c96a5ce-6019-4964-a9b3-b3ba3a72f217 tempest-SnapshotDependencyTests-565089579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:50:13 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-5c96a5ce-6019-4964-a9b3-b3ba3a72f217 tempest-SnapshotDependencyTests-565089579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:50:13 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-5c96a5ce-6019-4964-a9b3-b3ba3a72f217 tempest-SnapshotDependencyTests-565089579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:50:13 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-5c96a5ce-6019-4964-a9b3-b3ba3a72f217 tempest-SnapshotDependencyTests-565089579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:50:13 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-5c96a5ce-6019-4964-a9b3-b3ba3a72f217 tempest-SnapshotDependencyTests-565089579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:50:13 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-5c96a5ce-6019-4964-a9b3-b3ba3a72f217 tempest-SnapshotDependencyTests-565089579 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:50:13 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-5c96a5ce-6019-4964-a9b3-b3ba3a72f217 tempest-SnapshotDependencyTests-565089579 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:50:13 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-5c96a5ce-6019-4964-a9b3-b3ba3a72f217 tempest-SnapshotDependencyTests-565089579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-9a014cdc-c993-4d6a-bcc2-261b6f2b357c 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:50:13 devstack sudo[103575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-9a014cdc-c993-4d6a-bcc2-261b6f2b357c 1073741824 Sep 23 14:50:13 devstack sudo[103575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:50:13 devstack sudo[103575]: pam_unix(sudo:session): session closed for user root Sep 23 14:50:13 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-5c96a5ce-6019-4964-a9b3-b3ba3a72f217 tempest-SnapshotDependencyTests-565089579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-9a014cdc-c993-4d6a-bcc2-261b6f2b357c 1073741824" returned: 0 in 0.431s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:50:13 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-5c96a5ce-6019-4964-a9b3-b3ba3a72f217 tempest-SnapshotDependencyTests-565089579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-9a014cdc-c993-4d6a-bcc2-261b6f2b357c {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:50:13 devstack sudo[103580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-9a014cdc-c993-4d6a-bcc2-261b6f2b357c Sep 23 14:50:13 devstack sudo[103580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:50:13 devstack sudo[103580]: pam_unix(sudo:session): session closed for user root Sep 23 14:50:13 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-5c96a5ce-6019-4964-a9b3-b3ba3a72f217 tempest-SnapshotDependencyTests-565089579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-9a014cdc-c993-4d6a-bcc2-261b6f2b357c" returned: 0 in 0.254s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:50:13 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-5c96a5ce-6019-4964-a9b3-b3ba3a72f217 tempest-SnapshotDependencyTests-565089579 None] <== create_volume: return (727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:50:13 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-5c96a5ce-6019-4964-a9b3-b3ba3a72f217 tempest-SnapshotDependencyTests-565089579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.729s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:50:13 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-5c96a5ce-6019-4964-a9b3-b3ba3a72f217 tempest-SnapshotDependencyTests-565089579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d841a05-50e2-4d27-91b0-bb89dfb2fdd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a014cdc-c993-4d6a-bcc2-261b6f2b357c', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:50:13 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-5c96a5ce-6019-4964-a9b3-b3ba3a72f217 tempest-SnapshotDependencyTests-565089579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e928432d-6afc-462e-abd1-94e31978075a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:50:13 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-5c96a5ce-6019-4964-a9b3-b3ba3a72f217 tempest-SnapshotDependencyTests-565089579 None] Volume volume-9a014cdc-c993-4d6a-bcc2-261b6f2b357c (9a014cdc-c993-4d6a-bcc2-261b6f2b357c): created successfully Sep 23 14:50:13 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-5c96a5ce-6019-4964-a9b3-b3ba3a72f217 tempest-SnapshotDependencyTests-565089579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e928432d-6afc-462e-abd1-94e31978075a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:50:13 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-5c96a5ce-6019-4964-a9b3-b3ba3a72f217 tempest-SnapshotDependencyTests-565089579 None] Flow 'volume_create_manager' (7e7bc1a8-00fa-4e4f-aaf4-e562961f6844) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:50:13 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-5c96a5ce-6019-4964-a9b3-b3ba3a72f217 tempest-SnapshotDependencyTests-565089579 None] Created volume successfully. Sep 23 14:50:14 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-3b36dbc6-140f-4724-a35a-2a71ac2a6cca tempest-SnapshotDependencyTests-565089579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:50:14 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-3b36dbc6-140f-4724-a35a-2a71ac2a6cca tempest-SnapshotDependencyTests-565089579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:50:14 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-3b36dbc6-140f-4724-a35a-2a71ac2a6cca tempest-SnapshotDependencyTests-565089579 None] Creating offline snapshot 07edd3ae-eb50-492a-ae15-89b3b97ece85 of volume 9a014cdc-c993-4d6a-bcc2-261b6f2b357c {{(pid=86310) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 14:50:14 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[82b9ff7f-cbb8-49ab-88c7-8e8f1963513e]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:50:14 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-3b36dbc6-140f-4724-a35a-2a71ac2a6cca tempest-SnapshotDependencyTests-565089579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-9a014cdc-c993-4d6a-bcc2-261b6f2b357c {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:50:14 devstack sudo[103583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-9a014cdc-c993-4d6a-bcc2-261b6f2b357c Sep 23 14:50:14 devstack sudo[103583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:50:14 devstack sudo[103583]: pam_unix(sudo:session): session closed for user root Sep 23 14:50:14 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-3b36dbc6-140f-4724-a35a-2a71ac2a6cca tempest-SnapshotDependencyTests-565089579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-9a014cdc-c993-4d6a-bcc2-261b6f2b357c" returned: 0 in 0.372s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:50:14 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-3b36dbc6-140f-4724-a35a-2a71ac2a6cca tempest-SnapshotDependencyTests-565089579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-9a014cdc-c993-4d6a-bcc2-261b6f2b357c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-9a014cdc-c993-4d6a-bcc2-261b6f2b357c.07edd3ae-eb50-492a-ae15-89b3b97ece85 1G {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:50:14 devstack sudo[103588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-9a014cdc-c993-4d6a-bcc2-261b6f2b357c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-9a014cdc-c993-4d6a-bcc2-261b6f2b357c.07edd3ae-eb50-492a-ae15-89b3b97ece85 1G Sep 23 14:50:14 devstack sudo[103588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:50:15 devstack sudo[103588]: pam_unix(sudo:session): session closed for user root Sep 23 14:50:15 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-3b36dbc6-140f-4724-a35a-2a71ac2a6cca tempest-SnapshotDependencyTests-565089579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-9a014cdc-c993-4d6a-bcc2-261b6f2b357c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-9a014cdc-c993-4d6a-bcc2-261b6f2b357c.07edd3ae-eb50-492a-ae15-89b3b97ece85 1G" returned: 0 in 0.397s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:50:15 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-3b36dbc6-140f-4724-a35a-2a71ac2a6cca tempest-SnapshotDependencyTests-565089579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a014cdc-c993-4d6a-bcc2-261b6f2b357c -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-9a014cdc-c993-4d6a-bcc2-261b6f2b357c.07edd3ae-eb50-492a-ae15-89b3b97ece85 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:50:15 devstack sudo[103593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a014cdc-c993-4d6a-bcc2-261b6f2b357c -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-9a014cdc-c993-4d6a-bcc2-261b6f2b357c.07edd3ae-eb50-492a-ae15-89b3b97ece85 Sep 23 14:50:15 devstack sudo[103593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:50:15 devstack sudo[103593]: pam_unix(sudo:session): session closed for user root Sep 23 14:50:15 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-3b36dbc6-140f-4724-a35a-2a71ac2a6cca tempest-SnapshotDependencyTests-565089579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a014cdc-c993-4d6a-bcc2-261b6f2b357c -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-9a014cdc-c993-4d6a-bcc2-261b6f2b357c.07edd3ae-eb50-492a-ae15-89b3b97ece85" returned: 0 in 0.301s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:50:15 devstack cinder-volume[86310]: WARNING cinder.volume.drivers.remotefs [None req-3b36dbc6-140f-4724-a35a-2a71ac2a6cca tempest-SnapshotDependencyTests-565089579 None] /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-9a014cdc-c993-4d6a-bcc2-261b6f2b357c.07edd3ae-eb50-492a-ae15-89b3b97ece85 is being set with open permissions: ugo+rw Sep 23 14:50:15 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-3b36dbc6-140f-4724-a35a-2a71ac2a6cca tempest-SnapshotDependencyTests-565089579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-9a014cdc-c993-4d6a-bcc2-261b6f2b357c.07edd3ae-eb50-492a-ae15-89b3b97ece85 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:50:15 devstack sudo[103598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-9a014cdc-c993-4d6a-bcc2-261b6f2b357c.07edd3ae-eb50-492a-ae15-89b3b97ece85 Sep 23 14:50:15 devstack sudo[103598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:50:15 devstack sudo[103598]: pam_unix(sudo:session): session closed for user root Sep 23 14:50:15 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-3b36dbc6-140f-4724-a35a-2a71ac2a6cca tempest-SnapshotDependencyTests-565089579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-9a014cdc-c993-4d6a-bcc2-261b6f2b357c.07edd3ae-eb50-492a-ae15-89b3b97ece85" returned: 0 in 0.272s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:50:15 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-3b36dbc6-140f-4724-a35a-2a71ac2a6cca tempest-SnapshotDependencyTests-565089579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-9a014cdc-c993-4d6a-bcc2-261b6f2b357c.info {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:50:15 devstack sudo[103601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-9a014cdc-c993-4d6a-bcc2-261b6f2b357c.info Sep 23 14:50:15 devstack sudo[103601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:50:15 devstack sudo[103601]: pam_unix(sudo:session): session closed for user root Sep 23 14:50:15 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-3b36dbc6-140f-4724-a35a-2a71ac2a6cca tempest-SnapshotDependencyTests-565089579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-9a014cdc-c993-4d6a-bcc2-261b6f2b357c.info" returned: 0 in 0.257s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:50:15 devstack cinder-volume[86310]: WARNING cinder.volume.drivers.remotefs [None req-3b36dbc6-140f-4724-a35a-2a71ac2a6cca tempest-SnapshotDependencyTests-565089579 None] /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-9a014cdc-c993-4d6a-bcc2-261b6f2b357c.info is being set with open permissions: ugo+rw Sep 23 14:50:15 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-3b36dbc6-140f-4724-a35a-2a71ac2a6cca tempest-SnapshotDependencyTests-565089579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-9a014cdc-c993-4d6a-bcc2-261b6f2b357c.info {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:50:15 devstack sudo[103604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-9a014cdc-c993-4d6a-bcc2-261b6f2b357c.info Sep 23 14:50:15 devstack sudo[103604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:50:16 devstack sudo[103604]: pam_unix(sudo:session): session closed for user root Sep 23 14:50:16 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-3b36dbc6-140f-4724-a35a-2a71ac2a6cca tempest-SnapshotDependencyTests-565089579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-9a014cdc-c993-4d6a-bcc2-261b6f2b357c.info" returned: 0 in 0.248s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:50:16 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-3b36dbc6-140f-4724-a35a-2a71ac2a6cca tempest-SnapshotDependencyTests-565089579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.938s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:50:16 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-3b36dbc6-140f-4724-a35a-2a71ac2a6cca tempest-SnapshotDependencyTests-565089579 None] Create snapshot completed successfully Sep 23 14:50:16 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2b5a4e2-e675-4eb4-b7d6-909a2201a3b0 tempest-SnapshotDependencyTests-565089579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:50:16 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-f2b5a4e2-e675-4eb4-b7d6-909a2201a3b0 tempest-SnapshotDependencyTests-565089579 None] Flow 'volume_create_manager' (6e0000a8-32d3-4118-b3e8-23a436cf9fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:50:16 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-f2b5a4e2-e675-4eb4-b7d6-909a2201a3b0 tempest-SnapshotDependencyTests-565089579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a79f1e2-dadb-4c51-8b91-e2a98f52c202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:50:16 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-f2b5a4e2-e675-4eb4-b7d6-909a2201a3b0 tempest-SnapshotDependencyTests-565089579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a79f1e2-dadb-4c51-8b91-e2a98f52c202) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:50:17Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfce6ce5-4bfc-4ce5-b0cb-9f55925f96f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f52462e6dffb45048b5f9de66e88c48a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:50:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=07edd3ae-eb50-492a-ae15-89b3b97ece85,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:50:17Z,use_quota=True,user_id='1747b88c9ea647e894b238e52b6e7cb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:50:16 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-f2b5a4e2-e675-4eb4-b7d6-909a2201a3b0 tempest-SnapshotDependencyTests-565089579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e5c47d3-878d-4bc2-99e7-be5d3c194bb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:50:16 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-f2b5a4e2-e675-4eb4-b7d6-909a2201a3b0 tempest-SnapshotDependencyTests-565089579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e5c47d3-878d-4bc2-99e7-be5d3c194bb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:50:16 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-f2b5a4e2-e675-4eb4-b7d6-909a2201a3b0 tempest-SnapshotDependencyTests-565089579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5da4a58-13a8-444a-825f-46e1afd69581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:50:17 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-f2b5a4e2-e675-4eb4-b7d6-909a2201a3b0 tempest-SnapshotDependencyTests-565089579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5da4a58-13a8-444a-825f-46e1afd69581) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'cfce6ce5-4bfc-4ce5-b0cb-9f55925f96f9', 'volume_name': 'volume-cfce6ce5-4bfc-4ce5-b0cb-9f55925f96f9', 'volume_size': 1, 'snapshot_id': '07edd3ae-eb50-492a-ae15-89b3b97ece85'}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:50:17 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-f2b5a4e2-e675-4eb4-b7d6-909a2201a3b0 tempest-SnapshotDependencyTests-565089579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2860a8c-c0fd-4f19-8cbc-a2429e6d9acc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:50:17 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-f2b5a4e2-e675-4eb4-b7d6-909a2201a3b0 tempest-SnapshotDependencyTests-565089579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2860a8c-c0fd-4f19-8cbc-a2429e6d9acc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:50:17 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-f2b5a4e2-e675-4eb4-b7d6-909a2201a3b0 tempest-SnapshotDependencyTests-565089579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dcd254f-0d22-4a25-bd88-238d0f466e2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:50:17 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-f2b5a4e2-e675-4eb4-b7d6-909a2201a3b0 tempest-SnapshotDependencyTests-565089579 None] Volume cfce6ce5-4bfc-4ce5-b0cb-9f55925f96f9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-cfce6ce5-4bfc-4ce5-b0cb-9f55925f96f9', 'volume_size': 1, 'snapshot_id': '07edd3ae-eb50-492a-ae15-89b3b97ece85'} Sep 23 14:50:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-f2b5a4e2-e675-4eb4-b7d6-909a2201a3b0 tempest-SnapshotDependencyTests-565089579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:50:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-f2b5a4e2-e675-4eb4-b7d6-909a2201a3b0 tempest-SnapshotDependencyTests-565089579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:50:17 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-f2b5a4e2-e675-4eb4-b7d6-909a2201a3b0 tempest-SnapshotDependencyTests-565089579 None] Acquiring lock "cinder-quobyte-07edd3ae-eb50-492a-ae15-89b3b97ece85-cfce6ce5-4bfc-4ce5-b0cb-9f55925f96f9" by "_create_volume_from_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:50:17 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-f2b5a4e2-e675-4eb4-b7d6-909a2201a3b0 tempest-SnapshotDependencyTests-565089579 None] Lock "cinder-quobyte-07edd3ae-eb50-492a-ae15-89b3b97ece85-cfce6ce5-4bfc-4ce5-b0cb-9f55925f96f9" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:50:17 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-f2b5a4e2-e675-4eb4-b7d6-909a2201a3b0 tempest-SnapshotDependencyTests-565089579 None] Creating volume cfce6ce5-4bfc-4ce5-b0cb-9f55925f96f9 from snapshot 07edd3ae-eb50-492a-ae15-89b3b97ece85 {{(pid=86310) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 23 14:50:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-f2b5a4e2-e675-4eb4-b7d6-909a2201a3b0 tempest-SnapshotDependencyTests-565089579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:50:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-f2b5a4e2-e675-4eb4-b7d6-909a2201a3b0 tempest-SnapshotDependencyTests-565089579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:50:17 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-f2b5a4e2-e675-4eb4-b7d6-909a2201a3b0 tempest-SnapshotDependencyTests-565089579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:50:17 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-f2b5a4e2-e675-4eb4-b7d6-909a2201a3b0 tempest-SnapshotDependencyTests-565089579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:50:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-f2b5a4e2-e675-4eb4-b7d6-909a2201a3b0 tempest-SnapshotDependencyTests-565089579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:50:17 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-f2b5a4e2-e675-4eb4-b7d6-909a2201a3b0 tempest-SnapshotDependencyTests-565089579 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:50:17 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-f2b5a4e2-e675-4eb4-b7d6-909a2201a3b0 tempest-SnapshotDependencyTests-565089579 None] Acquiring lock "cinder-quobyte-cfce6ce5-4bfc-4ce5-b0cb-9f55925f96f9" by "_copy_volume_from_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:50:17 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-f2b5a4e2-e675-4eb4-b7d6-909a2201a3b0 tempest-SnapshotDependencyTests-565089579 None] Lock "cinder-quobyte-cfce6ce5-4bfc-4ce5-b0cb-9f55925f96f9" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:50:17 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-f2b5a4e2-e675-4eb4-b7d6-909a2201a3b0 tempest-SnapshotDependencyTests-565089579 None] snapshot: 07edd3ae-eb50-492a-ae15-89b3b97ece85, volume: cfce6ce5-4bfc-4ce5-b0cb-9f55925f96f9, {{(pid=86310) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 23 14:50:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-f2b5a4e2-e675-4eb4-b7d6-909a2201a3b0 tempest-SnapshotDependencyTests-565089579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:50:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-f2b5a4e2-e675-4eb4-b7d6-909a2201a3b0 tempest-SnapshotDependencyTests-565089579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:50:17 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-f2b5a4e2-e675-4eb4-b7d6-909a2201a3b0 tempest-SnapshotDependencyTests-565089579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:50:17 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-f2b5a4e2-e675-4eb4-b7d6-909a2201a3b0 tempest-SnapshotDependencyTests-565089579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:50:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-f2b5a4e2-e675-4eb4-b7d6-909a2201a3b0 tempest-SnapshotDependencyTests-565089579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:50:17 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a5a9d29-f515-4bac-8a6a-fa6d558233cd]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:50:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-f2b5a4e2-e675-4eb4-b7d6-909a2201a3b0 tempest-SnapshotDependencyTests-565089579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-9a014cdc-c993-4d6a-bcc2-261b6f2b357c.07edd3ae-eb50-492a-ae15-89b3b97ece85 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:50:17 devstack sudo[103607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-9a014cdc-c993-4d6a-bcc2-261b6f2b357c.07edd3ae-eb50-492a-ae15-89b3b97ece85 Sep 23 14:50:17 devstack sudo[103607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:50:17 devstack sudo[103607]: pam_unix(sudo:session): session closed for user root Sep 23 14:50:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-f2b5a4e2-e675-4eb4-b7d6-909a2201a3b0 tempest-SnapshotDependencyTests-565089579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-9a014cdc-c993-4d6a-bcc2-261b6f2b357c.07edd3ae-eb50-492a-ae15-89b3b97ece85" returned: 0 in 0.354s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:50:17 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-f2b5a4e2-e675-4eb4-b7d6-909a2201a3b0 tempest-SnapshotDependencyTests-565089579 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9a014cdc-c993-4d6a-bcc2-261b6f2b357c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 14:50:17 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[39690388-240d-4b74-9690-b1930f4433af]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:50:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-f2b5a4e2-e675-4eb4-b7d6-909a2201a3b0 tempest-SnapshotDependencyTests-565089579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-9a014cdc-c993-4d6a-bcc2-261b6f2b357c {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:50:17 devstack sudo[103612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-9a014cdc-c993-4d6a-bcc2-261b6f2b357c Sep 23 14:50:17 devstack sudo[103612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:50:17 devstack sudo[103612]: pam_unix(sudo:session): session closed for user root Sep 23 14:50:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-f2b5a4e2-e675-4eb4-b7d6-909a2201a3b0 tempest-SnapshotDependencyTests-565089579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-9a014cdc-c993-4d6a-bcc2-261b6f2b357c" returned: 0 in 0.365s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:50:17 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-f2b5a4e2-e675-4eb4-b7d6-909a2201a3b0 tempest-SnapshotDependencyTests-565089579 None] will copy from snapshot at /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-9a014cdc-c993-4d6a-bcc2-261b6f2b357c {{(pid=86310) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 23 14:50:17 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-f2b5a4e2-e675-4eb4-b7d6-909a2201a3b0 tempest-SnapshotDependencyTests-565089579 None] Creating direct copy from snapshot {{(pid=86310) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 23 14:50:17 devstack cinder-volume[86310]: DEBUG cinder.utils [None req-f2b5a4e2-e675-4eb4-b7d6-909a2201a3b0 tempest-SnapshotDependencyTests-565089579 None] Path /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-cfce6ce5-4bfc-4ce5-b0cb-9f55925f96f9 not found in is_blk_device check {{(pid=86310) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 23 14:50:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-f2b5a4e2-e675-4eb4-b7d6-909a2201a3b0 tempest-SnapshotDependencyTests-565089579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-9a014cdc-c993-4d6a-bcc2-261b6f2b357c /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-cfce6ce5-4bfc-4ce5-b0cb-9f55925f96f9 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:50:17 devstack sudo[103617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-9a014cdc-c993-4d6a-bcc2-261b6f2b357c /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-cfce6ce5-4bfc-4ce5-b0cb-9f55925f96f9 Sep 23 14:50:17 devstack sudo[103617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:50:23 devstack sudo[103617]: pam_unix(sudo:session): session closed for user root Sep 23 14:50:23 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-f2b5a4e2-e675-4eb4-b7d6-909a2201a3b0 tempest-SnapshotDependencyTests-565089579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-9a014cdc-c993-4d6a-bcc2-261b6f2b357c /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-cfce6ce5-4bfc-4ce5-b0cb-9f55925f96f9" returned: 0 in 5.769s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:50:23 devstack cinder-volume[86310]: DEBUG cinder.image.image_utils [None req-f2b5a4e2-e675-4eb4-b7d6-909a2201a3b0 tempest-SnapshotDependencyTests-565089579 None] Image conversion details: src /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-9a014cdc-c993-4d6a-bcc2-261b6f2b357c, size 1024.00 MB, duration 5.77 sec, destination /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-cfce6ce5-4bfc-4ce5-b0cb-9f55925f96f9 {{(pid=86310) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 14:50:23 devstack cinder-volume[86310]: INFO cinder.image.image_utils [None req-f2b5a4e2-e675-4eb4-b7d6-909a2201a3b0 tempest-SnapshotDependencyTests-565089579 None] Converted 1024.00 MB image at 177.45 MB/s Sep 23 14:50:23 devstack cinder-volume[86310]: WARNING cinder.volume.drivers.remotefs [None req-f2b5a4e2-e675-4eb4-b7d6-909a2201a3b0 tempest-SnapshotDependencyTests-565089579 None] /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-cfce6ce5-4bfc-4ce5-b0cb-9f55925f96f9 is being set with open permissions: ugo+rw Sep 23 14:50:23 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-f2b5a4e2-e675-4eb4-b7d6-909a2201a3b0 tempest-SnapshotDependencyTests-565089579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-cfce6ce5-4bfc-4ce5-b0cb-9f55925f96f9 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:50:23 devstack sudo[103631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-cfce6ce5-4bfc-4ce5-b0cb-9f55925f96f9 Sep 23 14:50:23 devstack sudo[103631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:50:23 devstack sudo[103631]: pam_unix(sudo:session): session closed for user root Sep 23 14:50:23 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-f2b5a4e2-e675-4eb4-b7d6-909a2201a3b0 tempest-SnapshotDependencyTests-565089579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-cfce6ce5-4bfc-4ce5-b0cb-9f55925f96f9" returned: 0 in 0.247s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:50:23 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-f2b5a4e2-e675-4eb4-b7d6-909a2201a3b0 tempest-SnapshotDependencyTests-565089579 None] Lock "cinder-quobyte-cfce6ce5-4bfc-4ce5-b0cb-9f55925f96f9" released by "_copy_volume_from_snapshot" :: held 6.813s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:50:23 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-f2b5a4e2-e675-4eb4-b7d6-909a2201a3b0 tempest-SnapshotDependencyTests-565089579 None] Lock "cinder-quobyte-07edd3ae-eb50-492a-ae15-89b3b97ece85-cfce6ce5-4bfc-4ce5-b0cb-9f55925f96f9" released by "_create_volume_from_snapshot" :: held 6.881s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:50:23 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-f2b5a4e2-e675-4eb4-b7d6-909a2201a3b0 tempest-SnapshotDependencyTests-565089579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.901s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:50:23 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-f2b5a4e2-e675-4eb4-b7d6-909a2201a3b0 tempest-SnapshotDependencyTests-565089579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dcd254f-0d22-4a25-bd88-238d0f466e2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfce6ce5-4bfc-4ce5-b0cb-9f55925f96f9', 'volume_size': 1, 'snapshot_id': '07edd3ae-eb50-492a-ae15-89b3b97ece85'}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:50:23 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-f2b5a4e2-e675-4eb4-b7d6-909a2201a3b0 tempest-SnapshotDependencyTests-565089579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d5bf449-0b23-4206-86bb-4013aa36f08b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:50:23 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-f2b5a4e2-e675-4eb4-b7d6-909a2201a3b0 tempest-SnapshotDependencyTests-565089579 None] Volume volume-cfce6ce5-4bfc-4ce5-b0cb-9f55925f96f9 (cfce6ce5-4bfc-4ce5-b0cb-9f55925f96f9): created successfully Sep 23 14:50:23 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-f2b5a4e2-e675-4eb4-b7d6-909a2201a3b0 tempest-SnapshotDependencyTests-565089579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d5bf449-0b23-4206-86bb-4013aa36f08b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:50:23 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-f2b5a4e2-e675-4eb4-b7d6-909a2201a3b0 tempest-SnapshotDependencyTests-565089579 None] Flow 'volume_create_manager' (6e0000a8-32d3-4118-b3e8-23a436cf9fcb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:50:24 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-f2b5a4e2-e675-4eb4-b7d6-909a2201a3b0 tempest-SnapshotDependencyTests-565089579 None] Created volume successfully. Sep 23 14:50:24 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-0fcf6e49-a6d4-4f63-bff0-99692fb9b0c6 tempest-SnapshotDependencyTests-565089579 None] Acquiring lock "cinder-07edd3ae-eb50-492a-ae15-89b3b97ece85-delete_snapshot" by "delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:50:24 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-0fcf6e49-a6d4-4f63-bff0-99692fb9b0c6 tempest-SnapshotDependencyTests-565089579 None] Lock "cinder-07edd3ae-eb50-492a-ae15-89b3b97ece85-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:50:24 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-0fcf6e49-a6d4-4f63-bff0-99692fb9b0c6 tempest-SnapshotDependencyTests-565089579 None] Acquiring lock "cinder-quobyte-9a014cdc-c993-4d6a-bcc2-261b6f2b357c" by "delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:50:24 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-0fcf6e49-a6d4-4f63-bff0-99692fb9b0c6 tempest-SnapshotDependencyTests-565089579 None] Lock "cinder-quobyte-9a014cdc-c993-4d6a-bcc2-261b6f2b357c" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:50:24 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-0fcf6e49-a6d4-4f63-bff0-99692fb9b0c6 tempest-SnapshotDependencyTests-565089579 None] Acquiring lock "cinder-quobyte-07edd3ae-eb50-492a-ae15-89b3b97ece85" by "_delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:50:24 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-0fcf6e49-a6d4-4f63-bff0-99692fb9b0c6 tempest-SnapshotDependencyTests-565089579 None] Lock "cinder-quobyte-07edd3ae-eb50-492a-ae15-89b3b97ece85" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:50:24 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-0fcf6e49-a6d4-4f63-bff0-99692fb9b0c6 tempest-SnapshotDependencyTests-565089579 None] Deleting offline snapshot 07edd3ae-eb50-492a-ae15-89b3b97ece85 of volume 9a014cdc-c993-4d6a-bcc2-261b6f2b357c {{(pid=86310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 14:50:24 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-0fcf6e49-a6d4-4f63-bff0-99692fb9b0c6 tempest-SnapshotDependencyTests-565089579 None] snapshot_file for this snap is: volume-9a014cdc-c993-4d6a-bcc2-261b6f2b357c.07edd3ae-eb50-492a-ae15-89b3b97ece85 {{(pid=86310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 14:50:24 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d64b40b-bdcd-4c83-b704-11f624771456]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:50:24 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-0fcf6e49-a6d4-4f63-bff0-99692fb9b0c6 tempest-SnapshotDependencyTests-565089579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-9a014cdc-c993-4d6a-bcc2-261b6f2b357c.07edd3ae-eb50-492a-ae15-89b3b97ece85 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:50:24 devstack sudo[103634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-9a014cdc-c993-4d6a-bcc2-261b6f2b357c.07edd3ae-eb50-492a-ae15-89b3b97ece85 Sep 23 14:50:24 devstack sudo[103634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:50:24 devstack sudo[103634]: pam_unix(sudo:session): session closed for user root Sep 23 14:50:24 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-0fcf6e49-a6d4-4f63-bff0-99692fb9b0c6 tempest-SnapshotDependencyTests-565089579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-9a014cdc-c993-4d6a-bcc2-261b6f2b357c.07edd3ae-eb50-492a-ae15-89b3b97ece85" returned: 0 in 0.351s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:50:24 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-0fcf6e49-a6d4-4f63-bff0-99692fb9b0c6 tempest-SnapshotDependencyTests-565089579 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9a014cdc-c993-4d6a-bcc2-261b6f2b357c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 14:50:24 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[e64f449d-802c-43ac-9911-5297ad28f11c]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:50:24 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-0fcf6e49-a6d4-4f63-bff0-99692fb9b0c6 tempest-SnapshotDependencyTests-565089579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-9a014cdc-c993-4d6a-bcc2-261b6f2b357c {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:50:25 devstack sudo[103639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-9a014cdc-c993-4d6a-bcc2-261b6f2b357c Sep 23 14:50:25 devstack sudo[103639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:50:25 devstack sudo[103639]: pam_unix(sudo:session): session closed for user root Sep 23 14:50:25 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-0fcf6e49-a6d4-4f63-bff0-99692fb9b0c6 tempest-SnapshotDependencyTests-565089579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-9a014cdc-c993-4d6a-bcc2-261b6f2b357c" returned: 0 in 0.575s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:50:25 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-0fcf6e49-a6d4-4f63-bff0-99692fb9b0c6 tempest-SnapshotDependencyTests-565089579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-9a014cdc-c993-4d6a-bcc2-261b6f2b357c.07edd3ae-eb50-492a-ae15-89b3b97ece85 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:50:25 devstack sudo[103644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-9a014cdc-c993-4d6a-bcc2-261b6f2b357c.07edd3ae-eb50-492a-ae15-89b3b97ece85 Sep 23 14:50:25 devstack sudo[103644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:50:25 devstack sudo[103644]: pam_unix(sudo:session): session closed for user root Sep 23 14:50:25 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-0fcf6e49-a6d4-4f63-bff0-99692fb9b0c6 tempest-SnapshotDependencyTests-565089579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-9a014cdc-c993-4d6a-bcc2-261b6f2b357c.07edd3ae-eb50-492a-ae15-89b3b97ece85" returned: 0 in 0.336s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:50:25 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-0fcf6e49-a6d4-4f63-bff0-99692fb9b0c6 tempest-SnapshotDependencyTests-565089579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-9a014cdc-c993-4d6a-bcc2-261b6f2b357c.07edd3ae-eb50-492a-ae15-89b3b97ece85 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:50:25 devstack sudo[103650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-9a014cdc-c993-4d6a-bcc2-261b6f2b357c.07edd3ae-eb50-492a-ae15-89b3b97ece85 Sep 23 14:50:25 devstack sudo[103650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:50:26 devstack sudo[103650]: pam_unix(sudo:session): session closed for user root Sep 23 14:50:26 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-0fcf6e49-a6d4-4f63-bff0-99692fb9b0c6 tempest-SnapshotDependencyTests-565089579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-9a014cdc-c993-4d6a-bcc2-261b6f2b357c.07edd3ae-eb50-492a-ae15-89b3b97ece85" returned: 0 in 0.239s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:50:26 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-0fcf6e49-a6d4-4f63-bff0-99692fb9b0c6 tempest-SnapshotDependencyTests-565089579 None] Lock "cinder-quobyte-07edd3ae-eb50-492a-ae15-89b3b97ece85" released by "_delete_snapshot" :: held 1.598s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:50:26 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-0fcf6e49-a6d4-4f63-bff0-99692fb9b0c6 tempest-SnapshotDependencyTests-565089579 None] Lock "cinder-quobyte-9a014cdc-c993-4d6a-bcc2-261b6f2b357c" released by "delete_snapshot" :: held 1.619s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:50:26 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-0fcf6e49-a6d4-4f63-bff0-99692fb9b0c6 tempest-SnapshotDependencyTests-565089579 None] Created reservations ['53fa3955-b94e-4838-bef6-b0f55952e867', '0c644ed7-117b-44c8-8910-665c25a0a309', 'beb60243-ecc1-494f-bc9a-75bc18aa8784', 'c1033d50-c19d-4ee1-89de-9eba24882ed5'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:50:26 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-0fcf6e49-a6d4-4f63-bff0-99692fb9b0c6 tempest-SnapshotDependencyTests-565089579 None] Delete snapshot completed successfully. Sep 23 14:50:26 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-0fcf6e49-a6d4-4f63-bff0-99692fb9b0c6 tempest-SnapshotDependencyTests-565089579 None] Lock "cinder-07edd3ae-eb50-492a-ae15-89b3b97ece85-delete_snapshot" released by "delete_snapshot" :: held 1.744s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:50:26 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-3af1ceda-1489-451b-8e0c-1d25549e6c0e tempest-SnapshotDependencyTests-565089579 None] Acquiring lock "cinder-9a014cdc-c993-4d6a-bcc2-261b6f2b357c-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:50:26 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-3af1ceda-1489-451b-8e0c-1d25549e6c0e tempest-SnapshotDependencyTests-565089579 None] Lock "cinder-9a014cdc-c993-4d6a-bcc2-261b6f2b357c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:50:26 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-3af1ceda-1489-451b-8e0c-1d25549e6c0e tempest-SnapshotDependencyTests-565089579 None] Acquiring lock "cinder-quobyte-9a014cdc-c993-4d6a-bcc2-261b6f2b357c" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:50:26 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-3af1ceda-1489-451b-8e0c-1d25549e6c0e tempest-SnapshotDependencyTests-565089579 None] Lock "cinder-quobyte-9a014cdc-c993-4d6a-bcc2-261b6f2b357c" acquired by "delete_volume" :: waited 0.017s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:50:26 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[81b2e860-8ea0-4bc5-ae7e-63db0309d9a8]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:50:26 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-3af1ceda-1489-451b-8e0c-1d25549e6c0e tempest-SnapshotDependencyTests-565089579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-9a014cdc-c993-4d6a-bcc2-261b6f2b357c {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:50:26 devstack sudo[103655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-9a014cdc-c993-4d6a-bcc2-261b6f2b357c Sep 23 14:50:26 devstack sudo[103655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:50:27 devstack sudo[103655]: pam_unix(sudo:session): session closed for user root Sep 23 14:50:27 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-3af1ceda-1489-451b-8e0c-1d25549e6c0e tempest-SnapshotDependencyTests-565089579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-9a014cdc-c993-4d6a-bcc2-261b6f2b357c" returned: 0 in 0.359s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:50:27 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-3af1ceda-1489-451b-8e0c-1d25549e6c0e tempest-SnapshotDependencyTests-565089579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-9a014cdc-c993-4d6a-bcc2-261b6f2b357c {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:50:27 devstack sudo[103660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-9a014cdc-c993-4d6a-bcc2-261b6f2b357c Sep 23 14:50:27 devstack sudo[103660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:50:27 devstack sudo[103660]: pam_unix(sudo:session): session closed for user root Sep 23 14:50:27 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-3af1ceda-1489-451b-8e0c-1d25549e6c0e tempest-SnapshotDependencyTests-565089579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-9a014cdc-c993-4d6a-bcc2-261b6f2b357c" returned: 0 in 0.236s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:50:27 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-3af1ceda-1489-451b-8e0c-1d25549e6c0e tempest-SnapshotDependencyTests-565089579 None] Lock "cinder-quobyte-9a014cdc-c993-4d6a-bcc2-261b6f2b357c" released by "delete_volume" :: held 0.657s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:50:27 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-3af1ceda-1489-451b-8e0c-1d25549e6c0e tempest-SnapshotDependencyTests-565089579 None] Created reservations ['04ea7cf4-6dd9-4dc6-956b-97ad7847316c', '376cb2ef-a828-40ca-9154-102dad30dee3', '14d03c42-d618-4aeb-a226-35c84e01b2fa', '09469e37-44d6-4717-9e3f-8a1a9c8d2985'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:50:27 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-3af1ceda-1489-451b-8e0c-1d25549e6c0e tempest-SnapshotDependencyTests-565089579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:50:27 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-3af1ceda-1489-451b-8e0c-1d25549e6c0e tempest-SnapshotDependencyTests-565089579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:50:27 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-3af1ceda-1489-451b-8e0c-1d25549e6c0e tempest-SnapshotDependencyTests-565089579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:50:27 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-3af1ceda-1489-451b-8e0c-1d25549e6c0e tempest-SnapshotDependencyTests-565089579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:50:27 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-3af1ceda-1489-451b-8e0c-1d25549e6c0e tempest-SnapshotDependencyTests-565089579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:50:27 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-3af1ceda-1489-451b-8e0c-1d25549e6c0e tempest-SnapshotDependencyTests-565089579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:50:27 devstack sudo[103663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:50:27 devstack sudo[103663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:50:27 devstack sudo[103663]: pam_unix(sudo:session): session closed for user root Sep 23 14:50:27 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-3af1ceda-1489-451b-8e0c-1d25549e6c0e tempest-SnapshotDependencyTests-565089579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.254s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:50:27 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-3af1ceda-1489-451b-8e0c-1d25549e6c0e tempest-SnapshotDependencyTests-565089579 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:50:27 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-3af1ceda-1489-451b-8e0c-1d25549e6c0e tempest-SnapshotDependencyTests-565089579 None] Deleted volume successfully. Sep 23 14:50:27 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-3af1ceda-1489-451b-8e0c-1d25549e6c0e tempest-SnapshotDependencyTests-565089579 None] Lock "cinder-9a014cdc-c993-4d6a-bcc2-261b6f2b357c-delete_volume" released by "delete_volume" :: held 1.133s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:50:27 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-7921e6b4-0f56-4f4c-9739-c9eb27347f16 tempest-SnapshotDependencyTests-565089579 None] Acquiring lock "cinder-cfce6ce5-4bfc-4ce5-b0cb-9f55925f96f9-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:50:27 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-7921e6b4-0f56-4f4c-9739-c9eb27347f16 tempest-SnapshotDependencyTests-565089579 None] Lock "cinder-cfce6ce5-4bfc-4ce5-b0cb-9f55925f96f9-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:50:27 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-7921e6b4-0f56-4f4c-9739-c9eb27347f16 tempest-SnapshotDependencyTests-565089579 None] Acquiring lock "cinder-quobyte-cfce6ce5-4bfc-4ce5-b0cb-9f55925f96f9" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:50:27 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-7921e6b4-0f56-4f4c-9739-c9eb27347f16 tempest-SnapshotDependencyTests-565089579 None] Lock "cinder-quobyte-cfce6ce5-4bfc-4ce5-b0cb-9f55925f96f9" acquired by "delete_volume" :: waited 0.026s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:50:27 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[586593a9-6874-4fdd-89f2-ec7b00c913ea]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:50:27 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-7921e6b4-0f56-4f4c-9739-c9eb27347f16 tempest-SnapshotDependencyTests-565089579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-cfce6ce5-4bfc-4ce5-b0cb-9f55925f96f9 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:50:28 devstack sudo[103700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-cfce6ce5-4bfc-4ce5-b0cb-9f55925f96f9 Sep 23 14:50:28 devstack sudo[103700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:50:28 devstack sudo[103700]: pam_unix(sudo:session): session closed for user root Sep 23 14:50:28 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-7921e6b4-0f56-4f4c-9739-c9eb27347f16 tempest-SnapshotDependencyTests-565089579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-cfce6ce5-4bfc-4ce5-b0cb-9f55925f96f9" returned: 0 in 0.367s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:50:28 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-7921e6b4-0f56-4f4c-9739-c9eb27347f16 tempest-SnapshotDependencyTests-565089579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-cfce6ce5-4bfc-4ce5-b0cb-9f55925f96f9 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:50:28 devstack sudo[103707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-cfce6ce5-4bfc-4ce5-b0cb-9f55925f96f9 Sep 23 14:50:28 devstack sudo[103707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:50:28 devstack sudo[103707]: pam_unix(sudo:session): session closed for user root Sep 23 14:50:28 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-7921e6b4-0f56-4f4c-9739-c9eb27347f16 tempest-SnapshotDependencyTests-565089579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-cfce6ce5-4bfc-4ce5-b0cb-9f55925f96f9" returned: 0 in 0.249s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:50:28 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-7921e6b4-0f56-4f4c-9739-c9eb27347f16 tempest-SnapshotDependencyTests-565089579 None] Lock "cinder-quobyte-cfce6ce5-4bfc-4ce5-b0cb-9f55925f96f9" released by "delete_volume" :: held 0.658s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:50:28 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-7921e6b4-0f56-4f4c-9739-c9eb27347f16 tempest-SnapshotDependencyTests-565089579 None] Created reservations ['a7a45a4d-5212-4d69-98d3-b11efdec9ddd', '1ae4e9dc-233c-4a2b-ad0e-48fec3a0a392', '8838ff07-1597-4093-8cd1-5d205504b27a', 'abbf8f8d-184f-4564-b967-64af6111348d'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:50:28 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-7921e6b4-0f56-4f4c-9739-c9eb27347f16 tempest-SnapshotDependencyTests-565089579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:50:28 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-7921e6b4-0f56-4f4c-9739-c9eb27347f16 tempest-SnapshotDependencyTests-565089579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:50:28 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-7921e6b4-0f56-4f4c-9739-c9eb27347f16 tempest-SnapshotDependencyTests-565089579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:50:28 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-7921e6b4-0f56-4f4c-9739-c9eb27347f16 tempest-SnapshotDependencyTests-565089579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:50:28 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-7921e6b4-0f56-4f4c-9739-c9eb27347f16 tempest-SnapshotDependencyTests-565089579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:50:28 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-7921e6b4-0f56-4f4c-9739-c9eb27347f16 tempest-SnapshotDependencyTests-565089579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:50:28 devstack sudo[103710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:50:28 devstack sudo[103710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:50:28 devstack sudo[103710]: pam_unix(sudo:session): session closed for user root Sep 23 14:50:28 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-7921e6b4-0f56-4f4c-9739-c9eb27347f16 tempest-SnapshotDependencyTests-565089579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.234s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:50:28 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-7921e6b4-0f56-4f4c-9739-c9eb27347f16 tempest-SnapshotDependencyTests-565089579 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:50:28 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-7921e6b4-0f56-4f4c-9739-c9eb27347f16 tempest-SnapshotDependencyTests-565089579 None] Deleted volume successfully. Sep 23 14:50:28 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-7921e6b4-0f56-4f4c-9739-c9eb27347f16 tempest-SnapshotDependencyTests-565089579 None] Lock "cinder-cfce6ce5-4bfc-4ce5-b0cb-9f55925f96f9-delete_volume" released by "delete_volume" :: held 1.093s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:50:38 devstack cinder-volume[86310]: DEBUG dbcounter [-] [86310] Writing DB stats cinder:SELECT=23,cinder:INSERT=9,cinder:UPDATE=29,cinder:DELETE=3 {{(pid=86310) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 14:50:38 devstack cinder-volume[86310]: DEBUG dbcounter [-] [86310] Writing DB stats cinder:UPDATE=30,cinder:SELECT=27,cinder:DELETE=2,cinder:INSERT=6 {{(pid=86310) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 14:50:49 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a4da605-5d61-4883-80ba-0e14c99ee6ad tempest-CreateVolumesFromImageTest-455036596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:50:49 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-4a4da605-5d61-4883-80ba-0e14c99ee6ad tempest-CreateVolumesFromImageTest-455036596 None] Flow 'volume_create_manager' (b011dccb-0513-4c96-b9ff-d4593d2a2136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:50:49 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-4a4da605-5d61-4883-80ba-0e14c99ee6ad tempest-CreateVolumesFromImageTest-455036596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (455c648b-37e3-4861-a84c-f34de967be66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:50:49 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-4a4da605-5d61-4883-80ba-0e14c99ee6ad tempest-CreateVolumesFromImageTest-455036596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (455c648b-37e3-4861-a84c-f34de967be66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:50:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1898546341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6574c9df-c7ae-439e-bec7-29196bb81692,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5889541b922a4360a2d1ee283a32e936',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:50:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:50:49Z,use_quota=True,user_id='f42fbecebb704c9d8a3cade55dcde13c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:50:49 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-4a4da605-5d61-4883-80ba-0e14c99ee6ad tempest-CreateVolumesFromImageTest-455036596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93e5c174-d798-4183-bb9d-17560b416dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:50:49 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-4a4da605-5d61-4883-80ba-0e14c99ee6ad tempest-CreateVolumesFromImageTest-455036596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93e5c174-d798-4183-bb9d-17560b416dde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:50:49 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-4a4da605-5d61-4883-80ba-0e14c99ee6ad tempest-CreateVolumesFromImageTest-455036596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3098bfce-72a0-4ff4-86f2-80141aa9d954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:50:49 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-4a4da605-5d61-4883-80ba-0e14c99ee6ad tempest-CreateVolumesFromImageTest-455036596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3098bfce-72a0-4ff4-86f2-80141aa9d954) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6574c9df-c7ae-439e-bec7-29196bb81692', 'volume_name': 'volume-6574c9df-c7ae-439e-bec7-29196bb81692', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:50:49 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-4a4da605-5d61-4883-80ba-0e14c99ee6ad tempest-CreateVolumesFromImageTest-455036596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc5ecd75-77e2-4704-8db3-79fd6988e3b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:50:49 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-4a4da605-5d61-4883-80ba-0e14c99ee6ad tempest-CreateVolumesFromImageTest-455036596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc5ecd75-77e2-4704-8db3-79fd6988e3b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:50:49 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-4a4da605-5d61-4883-80ba-0e14c99ee6ad tempest-CreateVolumesFromImageTest-455036596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f56c3e51-b639-4229-97ad-ab2360c4b768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:50:49 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-4a4da605-5d61-4883-80ba-0e14c99ee6ad tempest-CreateVolumesFromImageTest-455036596 None] Volume 6574c9df-c7ae-439e-bec7-29196bb81692: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6574c9df-c7ae-439e-bec7-29196bb81692', 'volume_size': 1} Sep 23 14:50:49 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-4a4da605-5d61-4883-80ba-0e14c99ee6ad tempest-CreateVolumesFromImageTest-455036596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:50:49 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-4a4da605-5d61-4883-80ba-0e14c99ee6ad tempest-CreateVolumesFromImageTest-455036596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:50:49 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-4a4da605-5d61-4883-80ba-0e14c99ee6ad tempest-CreateVolumesFromImageTest-455036596 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:50:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1898546341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6574c9df-c7ae-439e-bec7-29196bb81692,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5889541b922a4360a2d1ee283a32e936',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:50:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:50:49Z,use_quota=True,user_id='f42fbecebb704c9d8a3cade55dcde13c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:50:49 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-4a4da605-5d61-4883-80ba-0e14c99ee6ad tempest-CreateVolumesFromImageTest-455036596 None] Creating volume 6574c9df-c7ae-439e-bec7-29196bb81692 {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:50:49 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-4a4da605-5d61-4883-80ba-0e14c99ee6ad tempest-CreateVolumesFromImageTest-455036596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:50:49 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-4a4da605-5d61-4883-80ba-0e14c99ee6ad tempest-CreateVolumesFromImageTest-455036596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:50:49 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-4a4da605-5d61-4883-80ba-0e14c99ee6ad tempest-CreateVolumesFromImageTest-455036596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:50:49 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-4a4da605-5d61-4883-80ba-0e14c99ee6ad tempest-CreateVolumesFromImageTest-455036596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:50:49 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-4a4da605-5d61-4883-80ba-0e14c99ee6ad tempest-CreateVolumesFromImageTest-455036596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:50:49 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-4a4da605-5d61-4883-80ba-0e14c99ee6ad tempest-CreateVolumesFromImageTest-455036596 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:50:49 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-4a4da605-5d61-4883-80ba-0e14c99ee6ad tempest-CreateVolumesFromImageTest-455036596 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:50:49 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-4a4da605-5d61-4883-80ba-0e14c99ee6ad tempest-CreateVolumesFromImageTest-455036596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6574c9df-c7ae-439e-bec7-29196bb81692 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:50:49 devstack sudo[103764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6574c9df-c7ae-439e-bec7-29196bb81692 1073741824 Sep 23 14:50:49 devstack sudo[103764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:50:49 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-35632725-ef0c-4e12-8320-b409abd5e07e tempest-CreateVolumesFromSnapshotTest-1218382436 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:50:49 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-35632725-ef0c-4e12-8320-b409abd5e07e tempest-CreateVolumesFromSnapshotTest-1218382436 None] Flow 'volume_create_manager' (5e1a9dc0-e5ee-468b-a10f-df8ab823440a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:50:49 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-35632725-ef0c-4e12-8320-b409abd5e07e tempest-CreateVolumesFromSnapshotTest-1218382436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a901efc-a198-4ef7-9e47-02472fdeda35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:50:49 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-35632725-ef0c-4e12-8320-b409abd5e07e tempest-CreateVolumesFromSnapshotTest-1218382436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a901efc-a198-4ef7-9e47-02472fdeda35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:50:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1637581819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82b47b51-3d87-4e7f-8a72-f9a37b938253,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbd117570db1461ba75ea39eb63c2847',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:50:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:50:50Z,use_quota=True,user_id='692103393e8f472e9c7edb18e5c97723',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:50:49 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-35632725-ef0c-4e12-8320-b409abd5e07e tempest-CreateVolumesFromSnapshotTest-1218382436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3310755e-2517-4794-9e54-4cef63f313c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:50:49 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-35632725-ef0c-4e12-8320-b409abd5e07e tempest-CreateVolumesFromSnapshotTest-1218382436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3310755e-2517-4794-9e54-4cef63f313c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:50:49 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-35632725-ef0c-4e12-8320-b409abd5e07e tempest-CreateVolumesFromSnapshotTest-1218382436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58f17f08-aa37-4c72-812e-1c160b5012fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:50:49 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-35632725-ef0c-4e12-8320-b409abd5e07e tempest-CreateVolumesFromSnapshotTest-1218382436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58f17f08-aa37-4c72-812e-1c160b5012fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82b47b51-3d87-4e7f-8a72-f9a37b938253', 'volume_name': 'volume-82b47b51-3d87-4e7f-8a72-f9a37b938253', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:50:49 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-35632725-ef0c-4e12-8320-b409abd5e07e tempest-CreateVolumesFromSnapshotTest-1218382436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (733362c7-5d85-47aa-8a55-cea8ec6dcee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:50:49 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-35632725-ef0c-4e12-8320-b409abd5e07e tempest-CreateVolumesFromSnapshotTest-1218382436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (733362c7-5d85-47aa-8a55-cea8ec6dcee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:50:49 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-35632725-ef0c-4e12-8320-b409abd5e07e tempest-CreateVolumesFromSnapshotTest-1218382436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe6b5057-0b8a-435f-bfe5-2d8ec275ee2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:50:49 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-35632725-ef0c-4e12-8320-b409abd5e07e tempest-CreateVolumesFromSnapshotTest-1218382436 None] Volume 82b47b51-3d87-4e7f-8a72-f9a37b938253: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82b47b51-3d87-4e7f-8a72-f9a37b938253', 'volume_size': 1} Sep 23 14:50:49 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-35632725-ef0c-4e12-8320-b409abd5e07e tempest-CreateVolumesFromSnapshotTest-1218382436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:50:50 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-578847e5-1ee9-4808-af14-b692da2fb53d tempest-CreateVolumesFromImageTest-455036596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:50:50 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-578847e5-1ee9-4808-af14-b692da2fb53d tempest-CreateVolumesFromImageTest-455036596 None] Flow 'volume_create_manager' (5e0506e1-63cc-489e-8fd5-31a4feae1fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:50:50 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-578847e5-1ee9-4808-af14-b692da2fb53d tempest-CreateVolumesFromImageTest-455036596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e150401-3039-48f3-87d2-a6fed285547d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:50:50 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-578847e5-1ee9-4808-af14-b692da2fb53d tempest-CreateVolumesFromImageTest-455036596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e150401-3039-48f3-87d2-a6fed285547d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:50:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-651495766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbaa066c-68ee-49d5-890d-ac727ff556b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5889541b922a4360a2d1ee283a32e936',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:50:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:50:50Z,use_quota=True,user_id='f42fbecebb704c9d8a3cade55dcde13c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:50:50 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-578847e5-1ee9-4808-af14-b692da2fb53d tempest-CreateVolumesFromImageTest-455036596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fecfcf8-5bfa-435e-ad81-3472c1f7ea7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:50:50 devstack sudo[103764]: pam_unix(sudo:session): session closed for user root Sep 23 14:50:50 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-578847e5-1ee9-4808-af14-b692da2fb53d tempest-CreateVolumesFromImageTest-455036596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fecfcf8-5bfa-435e-ad81-3472c1f7ea7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:50:50 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-578847e5-1ee9-4808-af14-b692da2fb53d tempest-CreateVolumesFromImageTest-455036596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a027fff3-582a-4775-a1df-e3b3a29d494d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:50:50 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-578847e5-1ee9-4808-af14-b692da2fb53d tempest-CreateVolumesFromImageTest-455036596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a027fff3-582a-4775-a1df-e3b3a29d494d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbaa066c-68ee-49d5-890d-ac727ff556b9', 'volume_name': 'volume-dbaa066c-68ee-49d5-890d-ac727ff556b9', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:50:50 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-578847e5-1ee9-4808-af14-b692da2fb53d tempest-CreateVolumesFromImageTest-455036596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cdedee0-cd86-4c25-8e7d-157fa49d3074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:50:50 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-578847e5-1ee9-4808-af14-b692da2fb53d tempest-CreateVolumesFromImageTest-455036596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cdedee0-cd86-4c25-8e7d-157fa49d3074) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:50:50 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-578847e5-1ee9-4808-af14-b692da2fb53d tempest-CreateVolumesFromImageTest-455036596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1711c5a-ced4-4b04-bcfe-18e0c24f9f33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:50:50 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-578847e5-1ee9-4808-af14-b692da2fb53d tempest-CreateVolumesFromImageTest-455036596 None] Volume dbaa066c-68ee-49d5-890d-ac727ff556b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbaa066c-68ee-49d5-890d-ac727ff556b9', 'volume_size': 1} Sep 23 14:50:50 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-578847e5-1ee9-4808-af14-b692da2fb53d tempest-CreateVolumesFromImageTest-455036596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:50:50 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-4a4da605-5d61-4883-80ba-0e14c99ee6ad tempest-CreateVolumesFromImageTest-455036596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6574c9df-c7ae-439e-bec7-29196bb81692 1073741824" returned: 0 in 0.842s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:50:50 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-4a4da605-5d61-4883-80ba-0e14c99ee6ad tempest-CreateVolumesFromImageTest-455036596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6574c9df-c7ae-439e-bec7-29196bb81692 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:50:50 devstack sudo[103770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6574c9df-c7ae-439e-bec7-29196bb81692 Sep 23 14:50:50 devstack sudo[103770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:50:50 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-09959770-0e1d-447c-ac52-a578de03b50a tempest-CreateVolumesFromImageTest-455036596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:50:50 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-09959770-0e1d-447c-ac52-a578de03b50a tempest-CreateVolumesFromImageTest-455036596 None] Flow 'volume_create_manager' (48267fc5-3e20-4844-adcd-94c172d69069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:50:50 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-09959770-0e1d-447c-ac52-a578de03b50a tempest-CreateVolumesFromImageTest-455036596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d419a7b-47a1-46f8-b276-122c37680cab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:50:50 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-09959770-0e1d-447c-ac52-a578de03b50a tempest-CreateVolumesFromImageTest-455036596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d419a7b-47a1-46f8-b276-122c37680cab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:50:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1028676674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f1f5166-1323-416a-966a-772c1b934d24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5889541b922a4360a2d1ee283a32e936',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:50:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:50:50Z,use_quota=True,user_id='f42fbecebb704c9d8a3cade55dcde13c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:50:50 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-09959770-0e1d-447c-ac52-a578de03b50a tempest-CreateVolumesFromImageTest-455036596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36b53559-4c4c-4a04-ab3c-291e240c6186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:50:50 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-09959770-0e1d-447c-ac52-a578de03b50a tempest-CreateVolumesFromImageTest-455036596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36b53559-4c4c-4a04-ab3c-291e240c6186) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:50:50 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-09959770-0e1d-447c-ac52-a578de03b50a tempest-CreateVolumesFromImageTest-455036596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8053c6ca-c0f6-4fb0-a276-2fbf3afb499b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:50:50 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-09959770-0e1d-447c-ac52-a578de03b50a tempest-CreateVolumesFromImageTest-455036596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8053c6ca-c0f6-4fb0-a276-2fbf3afb499b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f1f5166-1323-416a-966a-772c1b934d24', 'volume_name': 'volume-4f1f5166-1323-416a-966a-772c1b934d24', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:50:50 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-09959770-0e1d-447c-ac52-a578de03b50a tempest-CreateVolumesFromImageTest-455036596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f82895cf-c049-46f0-a7bf-9be2895466a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:50:50 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-09959770-0e1d-447c-ac52-a578de03b50a tempest-CreateVolumesFromImageTest-455036596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f82895cf-c049-46f0-a7bf-9be2895466a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:50:50 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-09959770-0e1d-447c-ac52-a578de03b50a tempest-CreateVolumesFromImageTest-455036596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94ed8004-1bfd-4376-a64d-d99c9aca524c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:50:50 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-09959770-0e1d-447c-ac52-a578de03b50a tempest-CreateVolumesFromImageTest-455036596 None] Volume 4f1f5166-1323-416a-966a-772c1b934d24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f1f5166-1323-416a-966a-772c1b934d24', 'volume_size': 1} Sep 23 14:50:50 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-09959770-0e1d-447c-ac52-a578de03b50a tempest-CreateVolumesFromImageTest-455036596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:50:50 devstack sudo[103770]: pam_unix(sudo:session): session closed for user root Sep 23 14:50:50 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-4a4da605-5d61-4883-80ba-0e14c99ee6ad tempest-CreateVolumesFromImageTest-455036596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6574c9df-c7ae-439e-bec7-29196bb81692" returned: 0 in 0.426s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:50:50 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-4a4da605-5d61-4883-80ba-0e14c99ee6ad tempest-CreateVolumesFromImageTest-455036596 None] <== create_volume: return (1347ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:50:50 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-4a4da605-5d61-4883-80ba-0e14c99ee6ad tempest-CreateVolumesFromImageTest-455036596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.354s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:50:50 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-35632725-ef0c-4e12-8320-b409abd5e07e tempest-CreateVolumesFromSnapshotTest-1218382436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.884s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:50:50 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-35632725-ef0c-4e12-8320-b409abd5e07e tempest-CreateVolumesFromSnapshotTest-1218382436 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:50:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1637581819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82b47b51-3d87-4e7f-8a72-f9a37b938253,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbd117570db1461ba75ea39eb63c2847',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:50:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:50:50Z,use_quota=True,user_id='692103393e8f472e9c7edb18e5c97723',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:50:50 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-35632725-ef0c-4e12-8320-b409abd5e07e tempest-CreateVolumesFromSnapshotTest-1218382436 None] Creating volume 82b47b51-3d87-4e7f-8a72-f9a37b938253 {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:50:50 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-35632725-ef0c-4e12-8320-b409abd5e07e tempest-CreateVolumesFromSnapshotTest-1218382436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:50:50 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-35632725-ef0c-4e12-8320-b409abd5e07e tempest-CreateVolumesFromSnapshotTest-1218382436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:50:50 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-35632725-ef0c-4e12-8320-b409abd5e07e tempest-CreateVolumesFromSnapshotTest-1218382436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:50:50 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-35632725-ef0c-4e12-8320-b409abd5e07e tempest-CreateVolumesFromSnapshotTest-1218382436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:50:50 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-35632725-ef0c-4e12-8320-b409abd5e07e tempest-CreateVolumesFromSnapshotTest-1218382436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:50:50 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-35632725-ef0c-4e12-8320-b409abd5e07e tempest-CreateVolumesFromSnapshotTest-1218382436 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:50:50 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-35632725-ef0c-4e12-8320-b409abd5e07e tempest-CreateVolumesFromSnapshotTest-1218382436 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:50:50 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-35632725-ef0c-4e12-8320-b409abd5e07e tempest-CreateVolumesFromSnapshotTest-1218382436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-82b47b51-3d87-4e7f-8a72-f9a37b938253 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:50:50 devstack sudo[103773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-82b47b51-3d87-4e7f-8a72-f9a37b938253 1073741824 Sep 23 14:50:50 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-4a4da605-5d61-4883-80ba-0e14c99ee6ad tempest-CreateVolumesFromImageTest-455036596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f56c3e51-b639-4229-97ad-ab2360c4b768) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6574c9df-c7ae-439e-bec7-29196bb81692', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:50:50 devstack sudo[103773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:50:50 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-4a4da605-5d61-4883-80ba-0e14c99ee6ad tempest-CreateVolumesFromImageTest-455036596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (515476ee-a20c-4524-a436-244911ec997d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:50:50 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ab12db4-a1c1-46f5-8085-3b3d00958fd7 tempest-CreateVolumesFromImageTest-455036596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:50:50 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-4ab12db4-a1c1-46f5-8085-3b3d00958fd7 tempest-CreateVolumesFromImageTest-455036596 None] Flow 'volume_create_manager' (57e4c4d1-ae63-4b4a-8e21-02c7ed08416e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:50:50 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-4ab12db4-a1c1-46f5-8085-3b3d00958fd7 tempest-CreateVolumesFromImageTest-455036596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88ee9331-0fc9-4364-9d2c-2a7e99ddbe42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:50:50 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-4a4da605-5d61-4883-80ba-0e14c99ee6ad tempest-CreateVolumesFromImageTest-455036596 None] Volume volume-6574c9df-c7ae-439e-bec7-29196bb81692 (6574c9df-c7ae-439e-bec7-29196bb81692): created successfully Sep 23 14:50:50 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-4a4da605-5d61-4883-80ba-0e14c99ee6ad tempest-CreateVolumesFromImageTest-455036596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (515476ee-a20c-4524-a436-244911ec997d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:50:50 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-4a4da605-5d61-4883-80ba-0e14c99ee6ad tempest-CreateVolumesFromImageTest-455036596 None] Flow 'volume_create_manager' (b011dccb-0513-4c96-b9ff-d4593d2a2136) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:50:50 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-4ab12db4-a1c1-46f5-8085-3b3d00958fd7 tempest-CreateVolumesFromImageTest-455036596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88ee9331-0fc9-4364-9d2c-2a7e99ddbe42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:50:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1778294292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dfe913b-8a89-4138-99ba-83ac82ae569e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5889541b922a4360a2d1ee283a32e936',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:50:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:50:51Z,use_quota=True,user_id='f42fbecebb704c9d8a3cade55dcde13c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:50:50 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-4ab12db4-a1c1-46f5-8085-3b3d00958fd7 tempest-CreateVolumesFromImageTest-455036596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80f9d9e8-4570-4a8e-b54c-2121892cc2be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:50:50 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-4ab12db4-a1c1-46f5-8085-3b3d00958fd7 tempest-CreateVolumesFromImageTest-455036596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80f9d9e8-4570-4a8e-b54c-2121892cc2be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:50:50 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-4ab12db4-a1c1-46f5-8085-3b3d00958fd7 tempest-CreateVolumesFromImageTest-455036596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b33577a-ce2d-43ed-b77b-13ed2f91b107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:50:50 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-4ab12db4-a1c1-46f5-8085-3b3d00958fd7 tempest-CreateVolumesFromImageTest-455036596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b33577a-ce2d-43ed-b77b-13ed2f91b107) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4dfe913b-8a89-4138-99ba-83ac82ae569e', 'volume_name': 'volume-4dfe913b-8a89-4138-99ba-83ac82ae569e', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:50:50 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-4ab12db4-a1c1-46f5-8085-3b3d00958fd7 tempest-CreateVolumesFromImageTest-455036596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1949b17a-5bae-4fb5-9686-debffba074f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:50:51 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-4ab12db4-a1c1-46f5-8085-3b3d00958fd7 tempest-CreateVolumesFromImageTest-455036596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1949b17a-5bae-4fb5-9686-debffba074f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:50:51 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-4ab12db4-a1c1-46f5-8085-3b3d00958fd7 tempest-CreateVolumesFromImageTest-455036596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f1432a3-ef24-47fb-83e8-01593b655c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:50:51 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-4ab12db4-a1c1-46f5-8085-3b3d00958fd7 tempest-CreateVolumesFromImageTest-455036596 None] Volume 4dfe913b-8a89-4138-99ba-83ac82ae569e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4dfe913b-8a89-4138-99ba-83ac82ae569e', 'volume_size': 1} Sep 23 14:50:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-4ab12db4-a1c1-46f5-8085-3b3d00958fd7 tempest-CreateVolumesFromImageTest-455036596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:50:51 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-4a4da605-5d61-4883-80ba-0e14c99ee6ad tempest-CreateVolumesFromImageTest-455036596 None] Created volume successfully. Sep 23 14:50:51 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee8da371-2740-498d-91d0-678cb7542409 tempest-CreateVolumesFromImageTest-455036596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:50:51 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-ee8da371-2740-498d-91d0-678cb7542409 tempest-CreateVolumesFromImageTest-455036596 None] Flow 'volume_create_manager' (f049ee4b-7600-448c-8606-951346e34a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:50:51 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-ee8da371-2740-498d-91d0-678cb7542409 tempest-CreateVolumesFromImageTest-455036596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4e024c0-a8fc-49d8-94f3-1c4d4d185278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:50:51 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-ee8da371-2740-498d-91d0-678cb7542409 tempest-CreateVolumesFromImageTest-455036596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4e024c0-a8fc-49d8-94f3-1c4d4d185278) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:50:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1337198643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f03f9087-a163-4669-8d93-cc34bead30cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5889541b922a4360a2d1ee283a32e936',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:50:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:50:51Z,use_quota=True,user_id='f42fbecebb704c9d8a3cade55dcde13c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:50:51 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-ee8da371-2740-498d-91d0-678cb7542409 tempest-CreateVolumesFromImageTest-455036596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12d70af7-b1b8-44d4-91f5-4e56a9d2ae91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:50:51 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-ee8da371-2740-498d-91d0-678cb7542409 tempest-CreateVolumesFromImageTest-455036596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12d70af7-b1b8-44d4-91f5-4e56a9d2ae91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:50:51 devstack sudo[103773]: pam_unix(sudo:session): session closed for user root Sep 23 14:50:51 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-ee8da371-2740-498d-91d0-678cb7542409 tempest-CreateVolumesFromImageTest-455036596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8eac5c65-5447-406a-9f07-71d9078f17e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:50:51 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-ee8da371-2740-498d-91d0-678cb7542409 tempest-CreateVolumesFromImageTest-455036596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8eac5c65-5447-406a-9f07-71d9078f17e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f03f9087-a163-4669-8d93-cc34bead30cd', 'volume_name': 'volume-f03f9087-a163-4669-8d93-cc34bead30cd', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:50:51 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-ee8da371-2740-498d-91d0-678cb7542409 tempest-CreateVolumesFromImageTest-455036596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d4fb3ee-dcb2-449b-8f4d-65b42d4adad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:50:51 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-ee8da371-2740-498d-91d0-678cb7542409 tempest-CreateVolumesFromImageTest-455036596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d4fb3ee-dcb2-449b-8f4d-65b42d4adad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:50:51 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-ee8da371-2740-498d-91d0-678cb7542409 tempest-CreateVolumesFromImageTest-455036596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8f2e1e3-061c-4524-8ef5-7fa9572748b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:50:51 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-ee8da371-2740-498d-91d0-678cb7542409 tempest-CreateVolumesFromImageTest-455036596 None] Volume f03f9087-a163-4669-8d93-cc34bead30cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f03f9087-a163-4669-8d93-cc34bead30cd', 'volume_size': 1} Sep 23 14:50:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-ee8da371-2740-498d-91d0-678cb7542409 tempest-CreateVolumesFromImageTest-455036596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:50:51 devstack cinder-volume[86310]: DEBUG oslo_service.periodic_task [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86310) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 14:50:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:50:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:50:51 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:50:51 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:50:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:50:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:50:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-35632725-ef0c-4e12-8320-b409abd5e07e tempest-CreateVolumesFromSnapshotTest-1218382436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-82b47b51-3d87-4e7f-8a72-f9a37b938253 1073741824" returned: 0 in 0.729s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:50:51 devstack sudo[103779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:50:51 devstack sudo[103779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:50:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-35632725-ef0c-4e12-8320-b409abd5e07e tempest-CreateVolumesFromSnapshotTest-1218382436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-82b47b51-3d87-4e7f-8a72-f9a37b938253 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:50:51 devstack sudo[103781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-82b47b51-3d87-4e7f-8a72-f9a37b938253 Sep 23 14:50:51 devstack sudo[103781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:50:51 devstack sudo[103781]: pam_unix(sudo:session): session closed for user root Sep 23 14:50:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-35632725-ef0c-4e12-8320-b409abd5e07e tempest-CreateVolumesFromSnapshotTest-1218382436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-82b47b51-3d87-4e7f-8a72-f9a37b938253" returned: 0 in 0.321s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:50:51 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-35632725-ef0c-4e12-8320-b409abd5e07e tempest-CreateVolumesFromSnapshotTest-1218382436 None] <== create_volume: return (1105ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:50:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-35632725-ef0c-4e12-8320-b409abd5e07e tempest-CreateVolumesFromSnapshotTest-1218382436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.111s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:50:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-578847e5-1ee9-4808-af14-b692da2fb53d tempest-CreateVolumesFromImageTest-455036596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.606s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:50:51 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-578847e5-1ee9-4808-af14-b692da2fb53d tempest-CreateVolumesFromImageTest-455036596 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:50:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-651495766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbaa066c-68ee-49d5-890d-ac727ff556b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5889541b922a4360a2d1ee283a32e936',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:50:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:50:50Z,use_quota=True,user_id='f42fbecebb704c9d8a3cade55dcde13c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:50:51 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-578847e5-1ee9-4808-af14-b692da2fb53d tempest-CreateVolumesFromImageTest-455036596 None] Creating volume dbaa066c-68ee-49d5-890d-ac727ff556b9 {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:50:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-578847e5-1ee9-4808-af14-b692da2fb53d tempest-CreateVolumesFromImageTest-455036596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:50:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-578847e5-1ee9-4808-af14-b692da2fb53d tempest-CreateVolumesFromImageTest-455036596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:50:51 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-578847e5-1ee9-4808-af14-b692da2fb53d tempest-CreateVolumesFromImageTest-455036596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:50:51 devstack sudo[103779]: pam_unix(sudo:session): session closed for user root Sep 23 14:50:51 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-578847e5-1ee9-4808-af14-b692da2fb53d tempest-CreateVolumesFromImageTest-455036596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:50:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-578847e5-1ee9-4808-af14-b692da2fb53d tempest-CreateVolumesFromImageTest-455036596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:50:51 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-578847e5-1ee9-4808-af14-b692da2fb53d tempest-CreateVolumesFromImageTest-455036596 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:50:51 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-578847e5-1ee9-4808-af14-b692da2fb53d tempest-CreateVolumesFromImageTest-455036596 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:50:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-578847e5-1ee9-4808-af14-b692da2fb53d tempest-CreateVolumesFromImageTest-455036596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-dbaa066c-68ee-49d5-890d-ac727ff556b9 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:50:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.415s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:50:51 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:50:51 devstack sudo[103785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-dbaa066c-68ee-49d5-890d-ac727ff556b9 1073741824 Sep 23 14:50:51 devstack sudo[103785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:50:51 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-35632725-ef0c-4e12-8320-b409abd5e07e tempest-CreateVolumesFromSnapshotTest-1218382436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe6b5057-0b8a-435f-bfe5-2d8ec275ee2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82b47b51-3d87-4e7f-8a72-f9a37b938253', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:50:51 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-35632725-ef0c-4e12-8320-b409abd5e07e tempest-CreateVolumesFromSnapshotTest-1218382436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da19441c-7cba-48c3-91ec-8e0a17c5c157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:50:51 devstack cinder-volume[86310]: DEBUG oslo_service.periodic_task [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Running periodic task VolumeManager._thread_info {{(pid=86310) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 14:50:51 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] thread count: 28 {{(pid=86310) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 14:50:51 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] thread info: [<_MainThread(MainThread, started 128854208852096)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86310) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 14:50:51 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-35632725-ef0c-4e12-8320-b409abd5e07e tempest-CreateVolumesFromSnapshotTest-1218382436 None] Volume volume-82b47b51-3d87-4e7f-8a72-f9a37b938253 (82b47b51-3d87-4e7f-8a72-f9a37b938253): created successfully Sep 23 14:50:51 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-35632725-ef0c-4e12-8320-b409abd5e07e tempest-CreateVolumesFromSnapshotTest-1218382436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da19441c-7cba-48c3-91ec-8e0a17c5c157) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:50:51 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-35632725-ef0c-4e12-8320-b409abd5e07e tempest-CreateVolumesFromSnapshotTest-1218382436 None] Flow 'volume_create_manager' (5e1a9dc0-e5ee-468b-a10f-df8ab823440a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:50:51 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-35632725-ef0c-4e12-8320-b409abd5e07e tempest-CreateVolumesFromSnapshotTest-1218382436 None] Created volume successfully. Sep 23 14:50:52 devstack sudo[103785]: pam_unix(sudo:session): session closed for user root Sep 23 14:50:52 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-578847e5-1ee9-4808-af14-b692da2fb53d tempest-CreateVolumesFromImageTest-455036596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-dbaa066c-68ee-49d5-890d-ac727ff556b9 1073741824" returned: 0 in 0.577s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:50:52 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-578847e5-1ee9-4808-af14-b692da2fb53d tempest-CreateVolumesFromImageTest-455036596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-dbaa066c-68ee-49d5-890d-ac727ff556b9 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:50:52 devstack sudo[103792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-dbaa066c-68ee-49d5-890d-ac727ff556b9 Sep 23 14:50:52 devstack sudo[103792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:50:52 devstack sudo[103792]: pam_unix(sudo:session): session closed for user root Sep 23 14:50:52 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-578847e5-1ee9-4808-af14-b692da2fb53d tempest-CreateVolumesFromImageTest-455036596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-dbaa066c-68ee-49d5-890d-ac727ff556b9" returned: 0 in 0.286s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:50:52 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-578847e5-1ee9-4808-af14-b692da2fb53d tempest-CreateVolumesFromImageTest-455036596 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:50:52 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-578847e5-1ee9-4808-af14-b692da2fb53d tempest-CreateVolumesFromImageTest-455036596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:50:52 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-09959770-0e1d-447c-ac52-a578de03b50a tempest-CreateVolumesFromImageTest-455036596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.323s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:50:52 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-09959770-0e1d-447c-ac52-a578de03b50a tempest-CreateVolumesFromImageTest-455036596 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:50:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1028676674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f1f5166-1323-416a-966a-772c1b934d24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5889541b922a4360a2d1ee283a32e936',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:50:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:50:50Z,use_quota=True,user_id='f42fbecebb704c9d8a3cade55dcde13c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:50:52 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-09959770-0e1d-447c-ac52-a578de03b50a tempest-CreateVolumesFromImageTest-455036596 None] Creating volume 4f1f5166-1323-416a-966a-772c1b934d24 {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:50:52 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-09959770-0e1d-447c-ac52-a578de03b50a tempest-CreateVolumesFromImageTest-455036596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:50:52 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-09959770-0e1d-447c-ac52-a578de03b50a tempest-CreateVolumesFromImageTest-455036596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:50:52 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-09959770-0e1d-447c-ac52-a578de03b50a tempest-CreateVolumesFromImageTest-455036596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:50:52 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-09959770-0e1d-447c-ac52-a578de03b50a tempest-CreateVolumesFromImageTest-455036596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:50:52 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-09959770-0e1d-447c-ac52-a578de03b50a tempest-CreateVolumesFromImageTest-455036596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:50:52 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-09959770-0e1d-447c-ac52-a578de03b50a tempest-CreateVolumesFromImageTest-455036596 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:50:52 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-09959770-0e1d-447c-ac52-a578de03b50a tempest-CreateVolumesFromImageTest-455036596 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:50:52 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-09959770-0e1d-447c-ac52-a578de03b50a tempest-CreateVolumesFromImageTest-455036596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4f1f5166-1323-416a-966a-772c1b934d24 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:50:52 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-578847e5-1ee9-4808-af14-b692da2fb53d tempest-CreateVolumesFromImageTest-455036596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1711c5a-ced4-4b04-bcfe-18e0c24f9f33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbaa066c-68ee-49d5-890d-ac727ff556b9', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:50:52 devstack sudo[103796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4f1f5166-1323-416a-966a-772c1b934d24 1073741824 Sep 23 14:50:52 devstack sudo[103796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:50:52 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-578847e5-1ee9-4808-af14-b692da2fb53d tempest-CreateVolumesFromImageTest-455036596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2a3bec2-5b98-42f7-9f59-d2934cfd94af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:50:52 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-578847e5-1ee9-4808-af14-b692da2fb53d tempest-CreateVolumesFromImageTest-455036596 None] Volume volume-dbaa066c-68ee-49d5-890d-ac727ff556b9 (dbaa066c-68ee-49d5-890d-ac727ff556b9): created successfully Sep 23 14:50:52 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-578847e5-1ee9-4808-af14-b692da2fb53d tempest-CreateVolumesFromImageTest-455036596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2a3bec2-5b98-42f7-9f59-d2934cfd94af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:50:52 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-578847e5-1ee9-4808-af14-b692da2fb53d tempest-CreateVolumesFromImageTest-455036596 None] Flow 'volume_create_manager' (5e0506e1-63cc-489e-8fd5-31a4feae1fae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:50:52 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-578847e5-1ee9-4808-af14-b692da2fb53d tempest-CreateVolumesFromImageTest-455036596 None] Created volume successfully. Sep 23 14:50:53 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-95e24daa-1d57-435f-af3a-958994c7680a tempest-CreateVolumesFromSnapshotTest-1218382436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:50:53 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a37e2b1-3ad9-4c7e-ad70-218fdbbcb03e tempest-VolumeImageDependencyTests-1226023076 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:50:53 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-0a37e2b1-3ad9-4c7e-ad70-218fdbbcb03e tempest-VolumeImageDependencyTests-1226023076 None] Flow 'volume_create_manager' (bdf66033-cf6c-4668-a1cf-41ff119a54b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:50:53 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-0a37e2b1-3ad9-4c7e-ad70-218fdbbcb03e tempest-VolumeImageDependencyTests-1226023076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7be15001-7f48-4462-b5e1-cf65bb829312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:50:53 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-0a37e2b1-3ad9-4c7e-ad70-218fdbbcb03e tempest-VolumeImageDependencyTests-1226023076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7be15001-7f48-4462-b5e1-cf65bb829312) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:50:53Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95f0a8da-3ea9-4392-ac79-0d9f8079286e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd35946751604d9cacf5a706240a4609',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:50:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:50:53Z,use_quota=True,user_id='7a83628165694ca79d9acf7e29cf8c50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:50:53 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-0a37e2b1-3ad9-4c7e-ad70-218fdbbcb03e tempest-VolumeImageDependencyTests-1226023076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81a055b3-bba3-4fdb-bb16-b9e4ddf2c76f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:50:53 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-0a37e2b1-3ad9-4c7e-ad70-218fdbbcb03e tempest-VolumeImageDependencyTests-1226023076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81a055b3-bba3-4fdb-bb16-b9e4ddf2c76f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:50:53 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-0a37e2b1-3ad9-4c7e-ad70-218fdbbcb03e tempest-VolumeImageDependencyTests-1226023076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (506b1283-6e24-4a0c-aca5-62ff978ffd31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:50:53 devstack cinder-volume[86310]: DEBUG cinder.image.glance [None req-0a37e2b1-3ad9-4c7e-ad70-218fdbbcb03e tempest-VolumeImageDependencyTests-1226023076 None] Creating Keystone auth plugin from conf {{(pid=86310) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 23 14:50:53 devstack sudo[103796]: pam_unix(sudo:session): session closed for user root Sep 23 14:50:53 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-09959770-0e1d-447c-ac52-a578de03b50a tempest-CreateVolumesFromImageTest-455036596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4f1f5166-1323-416a-966a-772c1b934d24 1073741824" returned: 0 in 0.732s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:50:53 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-09959770-0e1d-447c-ac52-a578de03b50a tempest-CreateVolumesFromImageTest-455036596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4f1f5166-1323-416a-966a-772c1b934d24 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:50:53 devstack sudo[103803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4f1f5166-1323-416a-966a-772c1b934d24 Sep 23 14:50:53 devstack sudo[103803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:50:53 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-0a37e2b1-3ad9-4c7e-ad70-218fdbbcb03e tempest-VolumeImageDependencyTests-1226023076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (506b1283-6e24-4a0c-aca5-62ff978ffd31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '95f0a8da-3ea9-4392-ac79-0d9f8079286e', 'volume_name': 'volume-95f0a8da-3ea9-4392-ac79-0d9f8079286e', 'volume_size': 1, 'image_id': '1f10d4dd-83ef-43af-bc3f-6615cd0a31e9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1f10d4dd-83ef-43af-bc3f-6615cd0a31e9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4e81c7bf56380eaa3122695002457f06', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'bd35946751604d9cacf5a706240a4609', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '22f9f2ff3ff4cbbc763feb1b9331cb91fa1e614bae7e17956982c20d5e42687537380a02de79e0d0da9d61d03788b51e5dddf4f006602959b4165dce066d51e4', 'id': '1f10d4dd-83ef-43af-bc3f-6615cd0a31e9', 'created_at': datetime.datetime(2026, 9, 23, 12, 50, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 23, 12, 50, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1f10d4dd-83ef-43af-bc3f-6615cd0a31e9/file', 'properties': {}}, 'image_service': }' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:50:53 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-0a37e2b1-3ad9-4c7e-ad70-218fdbbcb03e tempest-VolumeImageDependencyTests-1226023076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b39ca45-b259-41fc-b4f7-bdedafa225d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:50:53 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-0a37e2b1-3ad9-4c7e-ad70-218fdbbcb03e tempest-VolumeImageDependencyTests-1226023076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b39ca45-b259-41fc-b4f7-bdedafa225d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:50:53 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-0a37e2b1-3ad9-4c7e-ad70-218fdbbcb03e tempest-VolumeImageDependencyTests-1226023076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83e23967-9070-4d78-b81d-9e01c831f881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:50:53 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-0a37e2b1-3ad9-4c7e-ad70-218fdbbcb03e tempest-VolumeImageDependencyTests-1226023076 None] Volume 95f0a8da-3ea9-4392-ac79-0d9f8079286e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-95f0a8da-3ea9-4392-ac79-0d9f8079286e', 'volume_size': 1, 'image_id': '1f10d4dd-83ef-43af-bc3f-6615cd0a31e9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1f10d4dd-83ef-43af-bc3f-6615cd0a31e9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4e81c7bf56380eaa3122695002457f06', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'bd35946751604d9cacf5a706240a4609', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '22f9f2ff3ff4cbbc763feb1b9331cb91fa1e614bae7e17956982c20d5e42687537380a02de79e0d0da9d61d03788b51e5dddf4f006602959b4165dce066d51e4', 'id': '1f10d4dd-83ef-43af-bc3f-6615cd0a31e9', 'created_at': datetime.datetime(2026, 9, 23, 12, 50, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 23, 12, 50, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1f10d4dd-83ef-43af-bc3f-6615cd0a31e9/file', 'properties': {}}, 'image_service': } Sep 23 14:50:53 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a37e2b1-3ad9-4c7e-ad70-218fdbbcb03e tempest-VolumeImageDependencyTests-1226023076 None] Trying to clone 95f0a8da-3ea9-4392-ac79-0d9f8079286e from image 1f10d4dd-83ef-43af-bc3f-6615cd0a31e9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/1f10d4dd-83ef-43af-bc3f-6615cd0a31e9', 'metadata': {}}]). {{(pid=86310) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 23 14:50:53 devstack sudo[103803]: pam_unix(sudo:session): session closed for user root Sep 23 14:50:53 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-09959770-0e1d-447c-ac52-a578de03b50a tempest-CreateVolumesFromImageTest-455036596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4f1f5166-1323-416a-966a-772c1b934d24" returned: 0 in 0.252s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:50:53 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-09959770-0e1d-447c-ac52-a578de03b50a tempest-CreateVolumesFromImageTest-455036596 None] <== create_volume: return (1051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:50:53 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-09959770-0e1d-447c-ac52-a578de03b50a tempest-CreateVolumesFromImageTest-455036596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.060s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:50:53 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-4ab12db4-a1c1-46f5-8085-3b3d00958fd7 tempest-CreateVolumesFromImageTest-455036596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.863s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:50:53 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-4ab12db4-a1c1-46f5-8085-3b3d00958fd7 tempest-CreateVolumesFromImageTest-455036596 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:50:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1778294292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dfe913b-8a89-4138-99ba-83ac82ae569e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5889541b922a4360a2d1ee283a32e936',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:50:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:50:51Z,use_quota=True,user_id='f42fbecebb704c9d8a3cade55dcde13c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:50:53 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-4ab12db4-a1c1-46f5-8085-3b3d00958fd7 tempest-CreateVolumesFromImageTest-455036596 None] Creating volume 4dfe913b-8a89-4138-99ba-83ac82ae569e {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:50:53 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-4ab12db4-a1c1-46f5-8085-3b3d00958fd7 tempest-CreateVolumesFromImageTest-455036596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:50:53 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-4ab12db4-a1c1-46f5-8085-3b3d00958fd7 tempest-CreateVolumesFromImageTest-455036596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:50:53 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-4ab12db4-a1c1-46f5-8085-3b3d00958fd7 tempest-CreateVolumesFromImageTest-455036596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:50:53 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-4ab12db4-a1c1-46f5-8085-3b3d00958fd7 tempest-CreateVolumesFromImageTest-455036596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:50:53 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-4ab12db4-a1c1-46f5-8085-3b3d00958fd7 tempest-CreateVolumesFromImageTest-455036596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:50:53 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-4ab12db4-a1c1-46f5-8085-3b3d00958fd7 tempest-CreateVolumesFromImageTest-455036596 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:50:53 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-4ab12db4-a1c1-46f5-8085-3b3d00958fd7 tempest-CreateVolumesFromImageTest-455036596 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:50:53 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-4ab12db4-a1c1-46f5-8085-3b3d00958fd7 tempest-CreateVolumesFromImageTest-455036596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4dfe913b-8a89-4138-99ba-83ac82ae569e 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:50:53 devstack sudo[103806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4dfe913b-8a89-4138-99ba-83ac82ae569e 1073741824 Sep 23 14:50:53 devstack sudo[103806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:50:53 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-09959770-0e1d-447c-ac52-a578de03b50a tempest-CreateVolumesFromImageTest-455036596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94ed8004-1bfd-4376-a64d-d99c9aca524c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f1f5166-1323-416a-966a-772c1b934d24', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:50:53 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-09959770-0e1d-447c-ac52-a578de03b50a tempest-CreateVolumesFromImageTest-455036596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53c9e8c3-d133-402d-b3c9-13ba7a2bdbb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:50:53 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-09959770-0e1d-447c-ac52-a578de03b50a tempest-CreateVolumesFromImageTest-455036596 None] Volume volume-4f1f5166-1323-416a-966a-772c1b934d24 (4f1f5166-1323-416a-966a-772c1b934d24): created successfully Sep 23 14:50:53 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-09959770-0e1d-447c-ac52-a578de03b50a tempest-CreateVolumesFromImageTest-455036596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53c9e8c3-d133-402d-b3c9-13ba7a2bdbb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:50:53 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-09959770-0e1d-447c-ac52-a578de03b50a tempest-CreateVolumesFromImageTest-455036596 None] Flow 'volume_create_manager' (48267fc5-3e20-4844-adcd-94c172d69069) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:50:53 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-09959770-0e1d-447c-ac52-a578de03b50a tempest-CreateVolumesFromImageTest-455036596 None] Created volume successfully. Sep 23 14:50:54 devstack cinder-volume[86310]: DEBUG cinder.image.image_utils [None req-0a37e2b1-3ad9-4c7e-ad70-218fdbbcb03e tempest-VolumeImageDependencyTests-1226023076 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1f10d4dd-83ef-43af-bc3f-6615cd0a31e9_0oslt00ydevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86310) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 23 14:50:54 devstack cinder-volume[86310]: INFO cinder.image.image_utils [None req-0a37e2b1-3ad9-4c7e-ad70-218fdbbcb03e tempest-VolumeImageDependencyTests-1226023076 None] Image download 0.00 MB at 0.00 MB/s Sep 23 14:50:54 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[d69da5ea-7ea6-4e37-a9fe-84b07c4a50ec]: (4, 'raw') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:50:54 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-0a37e2b1-3ad9-4c7e-ad70-218fdbbcb03e tempest-VolumeImageDependencyTests-1226023076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1f10d4dd-83ef-43af-bc3f-6615cd0a31e9_0oslt00ydevstack@QuobyteHD {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:50:54 devstack sudo[103808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1f10d4dd-83ef-43af-bc3f-6615cd0a31e9_0oslt00ydevstack@QuobyteHD Sep 23 14:50:54 devstack sudo[103808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:50:54 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a9d06c4-6a59-4d76-947a-02a5282fac09 tempest-VolumeAndVolumeTypeFromImageTest-496239476 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:50:54 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-6a9d06c4-6a59-4d76-947a-02a5282fac09 tempest-VolumeAndVolumeTypeFromImageTest-496239476 None] Flow 'volume_create_manager' (3239ce19-f4cf-424e-b469-ff5344c49b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:50:54 devstack sudo[103806]: pam_unix(sudo:session): session closed for user root Sep 23 14:50:54 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-6a9d06c4-6a59-4d76-947a-02a5282fac09 tempest-VolumeAndVolumeTypeFromImageTest-496239476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c52301c-1d15-420c-a130-73c8099e9f8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:50:54 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-4ab12db4-a1c1-46f5-8085-3b3d00958fd7 tempest-CreateVolumesFromImageTest-455036596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4dfe913b-8a89-4138-99ba-83ac82ae569e 1073741824" returned: 0 in 0.508s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:50:54 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-6a9d06c4-6a59-4d76-947a-02a5282fac09 tempest-VolumeAndVolumeTypeFromImageTest-496239476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c52301c-1d15-420c-a130-73c8099e9f8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:50:54Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c358676-b7ab-4d1e-b220-44587b8a782c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f633351771e34e5c88b9f16e1219e995',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:50:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:50:54Z,use_quota=True,user_id='7fcf8c6294fd4c8f97bece3114c04369',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a63fa93-2bdf-41ae-bcd0-b4c615f6f7ed),volume_type_id=4a63fa93-2bdf-41ae-bcd0-b4c615f6f7ed)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:50:54 devstack sudo[103808]: pam_unix(sudo:session): session closed for user root Sep 23 14:50:54 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-6a9d06c4-6a59-4d76-947a-02a5282fac09 tempest-VolumeAndVolumeTypeFromImageTest-496239476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a4fb692-8084-40cc-8f61-dc2712eda9fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:50:54 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-6a9d06c4-6a59-4d76-947a-02a5282fac09 tempest-VolumeAndVolumeTypeFromImageTest-496239476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a4fb692-8084-40cc-8f61-dc2712eda9fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:50:54 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-6a9d06c4-6a59-4d76-947a-02a5282fac09 tempest-VolumeAndVolumeTypeFromImageTest-496239476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c4384bc-c9ee-4a50-bd7b-23d087484cc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:50:54 devstack cinder-volume[86310]: DEBUG cinder.image.glance [None req-6a9d06c4-6a59-4d76-947a-02a5282fac09 tempest-VolumeAndVolumeTypeFromImageTest-496239476 None] Creating Keystone auth plugin from conf {{(pid=86310) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 23 14:50:54 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-0a37e2b1-3ad9-4c7e-ad70-218fdbbcb03e tempest-VolumeImageDependencyTests-1226023076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1f10d4dd-83ef-43af-bc3f-6615cd0a31e9_0oslt00ydevstack@QuobyteHD" returned: 0 in 0.375s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:50:54 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-0a37e2b1-3ad9-4c7e-ad70-218fdbbcb03e tempest-VolumeImageDependencyTests-1226023076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1f10d4dd-83ef-43af-bc3f-6615cd0a31e9_0oslt00ydevstack@QuobyteHD {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:50:54 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-4ab12db4-a1c1-46f5-8085-3b3d00958fd7 tempest-CreateVolumesFromImageTest-455036596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4dfe913b-8a89-4138-99ba-83ac82ae569e {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:50:54 devstack sudo[103817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4dfe913b-8a89-4138-99ba-83ac82ae569e Sep 23 14:50:54 devstack sudo[103817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:50:54 devstack sudo[103816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1f10d4dd-83ef-43af-bc3f-6615cd0a31e9_0oslt00ydevstack@QuobyteHD Sep 23 14:50:54 devstack sudo[103816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:50:54 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-6a9d06c4-6a59-4d76-947a-02a5282fac09 tempest-VolumeAndVolumeTypeFromImageTest-496239476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c4384bc-c9ee-4a50-bd7b-23d087484cc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0c358676-b7ab-4d1e-b220-44587b8a782c', 'volume_name': 'volume-0c358676-b7ab-4d1e-b220-44587b8a782c', 'volume_size': 1, 'image_id': '9f44576d-755d-478e-a551-fc801411de2a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9f44576d-755d-478e-a551-fc801411de2a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5ec323b9201f1378ff8b7b453d48e7f2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f633351771e34e5c88b9f16e1219e995', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0e225bcc57a204ca5a9c8e57857a1a5e770be0c456fbd109b2e713806d846fb6509630a61784885962c073ed650a562acb604a4289555b5f0f959de79f6a651b', 'id': '9f44576d-755d-478e-a551-fc801411de2a', 'created_at': datetime.datetime(2026, 9, 23, 12, 50, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 23, 12, 50, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9f44576d-755d-478e-a551-fc801411de2a/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:50:54 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-6a9d06c4-6a59-4d76-947a-02a5282fac09 tempest-VolumeAndVolumeTypeFromImageTest-496239476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db830b81-b29e-4bd7-b58d-d417b081436d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:50:54 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-6a9d06c4-6a59-4d76-947a-02a5282fac09 tempest-VolumeAndVolumeTypeFromImageTest-496239476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db830b81-b29e-4bd7-b58d-d417b081436d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:50:54 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-6a9d06c4-6a59-4d76-947a-02a5282fac09 tempest-VolumeAndVolumeTypeFromImageTest-496239476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49e4d77a-4327-4534-a3c8-d2f7d46ca876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:50:54 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-6a9d06c4-6a59-4d76-947a-02a5282fac09 tempest-VolumeAndVolumeTypeFromImageTest-496239476 None] Volume 0c358676-b7ab-4d1e-b220-44587b8a782c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0c358676-b7ab-4d1e-b220-44587b8a782c', 'volume_size': 1, 'image_id': '9f44576d-755d-478e-a551-fc801411de2a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9f44576d-755d-478e-a551-fc801411de2a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5ec323b9201f1378ff8b7b453d48e7f2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f633351771e34e5c88b9f16e1219e995', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0e225bcc57a204ca5a9c8e57857a1a5e770be0c456fbd109b2e713806d846fb6509630a61784885962c073ed650a562acb604a4289555b5f0f959de79f6a651b', 'id': '9f44576d-755d-478e-a551-fc801411de2a', 'created_at': datetime.datetime(2026, 9, 23, 12, 50, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 23, 12, 50, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9f44576d-755d-478e-a551-fc801411de2a/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 23 14:50:54 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a9d06c4-6a59-4d76-947a-02a5282fac09 tempest-VolumeAndVolumeTypeFromImageTest-496239476 None] Trying to clone 0c358676-b7ab-4d1e-b220-44587b8a782c from image 9f44576d-755d-478e-a551-fc801411de2a at location (None, [{'url': 'file:///opt/stack/data/glance/images/9f44576d-755d-478e-a551-fc801411de2a', 'metadata': {}}]). {{(pid=86310) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 23 14:50:54 devstack sudo[103817]: pam_unix(sudo:session): session closed for user root Sep 23 14:50:54 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-4ab12db4-a1c1-46f5-8085-3b3d00958fd7 tempest-CreateVolumesFromImageTest-455036596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4dfe913b-8a89-4138-99ba-83ac82ae569e" returned: 0 in 0.274s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:50:54 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-4ab12db4-a1c1-46f5-8085-3b3d00958fd7 tempest-CreateVolumesFromImageTest-455036596 None] <== create_volume: return (868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:50:54 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-4ab12db4-a1c1-46f5-8085-3b3d00958fd7 tempest-CreateVolumesFromImageTest-455036596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:50:54 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-ee8da371-2740-498d-91d0-678cb7542409 tempest-CreateVolumesFromImageTest-455036596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.278s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:50:54 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-ee8da371-2740-498d-91d0-678cb7542409 tempest-CreateVolumesFromImageTest-455036596 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:50:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1337198643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f03f9087-a163-4669-8d93-cc34bead30cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5889541b922a4360a2d1ee283a32e936',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:50:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:50:51Z,use_quota=True,user_id='f42fbecebb704c9d8a3cade55dcde13c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:50:54 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-ee8da371-2740-498d-91d0-678cb7542409 tempest-CreateVolumesFromImageTest-455036596 None] Creating volume f03f9087-a163-4669-8d93-cc34bead30cd {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:50:54 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-ee8da371-2740-498d-91d0-678cb7542409 tempest-CreateVolumesFromImageTest-455036596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:50:54 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-ee8da371-2740-498d-91d0-678cb7542409 tempest-CreateVolumesFromImageTest-455036596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:50:54 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-ee8da371-2740-498d-91d0-678cb7542409 tempest-CreateVolumesFromImageTest-455036596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:50:54 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-ee8da371-2740-498d-91d0-678cb7542409 tempest-CreateVolumesFromImageTest-455036596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:50:54 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-ee8da371-2740-498d-91d0-678cb7542409 tempest-CreateVolumesFromImageTest-455036596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:50:54 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-ee8da371-2740-498d-91d0-678cb7542409 tempest-CreateVolumesFromImageTest-455036596 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:50:54 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-ee8da371-2740-498d-91d0-678cb7542409 tempest-CreateVolumesFromImageTest-455036596 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:50:54 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ee8da371-2740-498d-91d0-678cb7542409 tempest-CreateVolumesFromImageTest-455036596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-f03f9087-a163-4669-8d93-cc34bead30cd 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:50:54 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-4ab12db4-a1c1-46f5-8085-3b3d00958fd7 tempest-CreateVolumesFromImageTest-455036596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f1432a3-ef24-47fb-83e8-01593b655c5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4dfe913b-8a89-4138-99ba-83ac82ae569e', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:50:54 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-4ab12db4-a1c1-46f5-8085-3b3d00958fd7 tempest-CreateVolumesFromImageTest-455036596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ded0cad-3d33-413e-86ea-6411693b33c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:50:54 devstack sudo[103822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-f03f9087-a163-4669-8d93-cc34bead30cd 1073741824 Sep 23 14:50:54 devstack sudo[103822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:50:54 devstack cinder-volume[86310]: DEBUG cinder.image.image_utils [None req-6a9d06c4-6a59-4d76-947a-02a5282fac09 tempest-VolumeAndVolumeTypeFromImageTest-496239476 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9f44576d-755d-478e-a551-fc801411de2a_jnxuacfedevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86310) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 23 14:50:54 devstack cinder-volume[86310]: INFO cinder.image.image_utils [None req-6a9d06c4-6a59-4d76-947a-02a5282fac09 tempest-VolumeAndVolumeTypeFromImageTest-496239476 None] Image download 0.00 MB at 0.00 MB/s Sep 23 14:50:54 devstack sudo[103816]: pam_unix(sudo:session): session closed for user root Sep 23 14:50:54 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-0a37e2b1-3ad9-4c7e-ad70-218fdbbcb03e tempest-VolumeImageDependencyTests-1226023076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1f10d4dd-83ef-43af-bc3f-6615cd0a31e9_0oslt00ydevstack@QuobyteHD" returned: 1 in 0.381s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:50:54 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-0a37e2b1-3ad9-4c7e-ad70-218fdbbcb03e tempest-VolumeImageDependencyTests-1226023076 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1f10d4dd-83ef-43af-bc3f-6615cd0a31e9_0oslt00ydevstack@QuobyteHD' failed. Not Retrying. {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 14:50:54 devstack cinder-volume[86310]: DEBUG cinder.image.image_utils [None req-0a37e2b1-3ad9-4c7e-ad70-218fdbbcb03e tempest-VolumeImageDependencyTests-1226023076 None] Temporary image 1f10d4dd-83ef-43af-bc3f-6615cd0a31e9 is fetched for user 7a83628165694ca79d9acf7e29cf8c50. {{(pid=86310) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 23 14:50:54 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-4ab12db4-a1c1-46f5-8085-3b3d00958fd7 tempest-CreateVolumesFromImageTest-455036596 None] Volume volume-4dfe913b-8a89-4138-99ba-83ac82ae569e (4dfe913b-8a89-4138-99ba-83ac82ae569e): created successfully Sep 23 14:50:54 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-4ab12db4-a1c1-46f5-8085-3b3d00958fd7 tempest-CreateVolumesFromImageTest-455036596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ded0cad-3d33-413e-86ea-6411693b33c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:50:54 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-4ab12db4-a1c1-46f5-8085-3b3d00958fd7 tempest-CreateVolumesFromImageTest-455036596 None] Flow 'volume_create_manager' (57e4c4d1-ae63-4b4a-8e21-02c7ed08416e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:50:54 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-4ab12db4-a1c1-46f5-8085-3b3d00958fd7 tempest-CreateVolumesFromImageTest-455036596 None] Created volume successfully. Sep 23 14:50:54 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f1f0bf2-1392-46f6-91ae-ff404a7b934e]: (4, 'raw') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:50:54 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-6a9d06c4-6a59-4d76-947a-02a5282fac09 tempest-VolumeAndVolumeTypeFromImageTest-496239476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9f44576d-755d-478e-a551-fc801411de2a_jnxuacfedevstack@QuobyteHD {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:50:54 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[c53a1943-376f-4eda-b088-206bec65ef79]: (4, 'raw') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:50:54 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-0a37e2b1-3ad9-4c7e-ad70-218fdbbcb03e tempest-VolumeImageDependencyTests-1226023076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1f10d4dd-83ef-43af-bc3f-6615cd0a31e9_0oslt00ydevstack@QuobyteHD {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:50:55 devstack sudo[103826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9f44576d-755d-478e-a551-fc801411de2a_jnxuacfedevstack@QuobyteHD Sep 23 14:50:55 devstack sudo[103826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:50:55 devstack sudo[103827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1f10d4dd-83ef-43af-bc3f-6615cd0a31e9_0oslt00ydevstack@QuobyteHD Sep 23 14:50:55 devstack sudo[103827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:50:55 devstack sudo[103822]: pam_unix(sudo:session): session closed for user root Sep 23 14:50:55 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ee8da371-2740-498d-91d0-678cb7542409 tempest-CreateVolumesFromImageTest-455036596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-f03f9087-a163-4669-8d93-cc34bead30cd 1073741824" returned: 0 in 0.487s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:50:55 devstack sudo[103826]: pam_unix(sudo:session): session closed for user root Sep 23 14:50:55 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-6a9d06c4-6a59-4d76-947a-02a5282fac09 tempest-VolumeAndVolumeTypeFromImageTest-496239476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9f44576d-755d-478e-a551-fc801411de2a_jnxuacfedevstack@QuobyteHD" returned: 0 in 0.398s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:50:55 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-6a9d06c4-6a59-4d76-947a-02a5282fac09 tempest-VolumeAndVolumeTypeFromImageTest-496239476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9f44576d-755d-478e-a551-fc801411de2a_jnxuacfedevstack@QuobyteHD {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:50:55 devstack sudo[103827]: pam_unix(sudo:session): session closed for user root Sep 23 14:50:55 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-0a37e2b1-3ad9-4c7e-ad70-218fdbbcb03e tempest-VolumeImageDependencyTests-1226023076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1f10d4dd-83ef-43af-bc3f-6615cd0a31e9_0oslt00ydevstack@QuobyteHD" returned: 0 in 0.387s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:50:55 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-0a37e2b1-3ad9-4c7e-ad70-218fdbbcb03e tempest-VolumeImageDependencyTests-1226023076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1f10d4dd-83ef-43af-bc3f-6615cd0a31e9_0oslt00ydevstack@QuobyteHD {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:50:55 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ee8da371-2740-498d-91d0-678cb7542409 tempest-CreateVolumesFromImageTest-455036596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-f03f9087-a163-4669-8d93-cc34bead30cd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:50:55 devstack sudo[103837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9f44576d-755d-478e-a551-fc801411de2a_jnxuacfedevstack@QuobyteHD Sep 23 14:50:55 devstack sudo[103837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:50:55 devstack sudo[103839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-f03f9087-a163-4669-8d93-cc34bead30cd Sep 23 14:50:55 devstack sudo[103839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:50:55 devstack sudo[103838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1f10d4dd-83ef-43af-bc3f-6615cd0a31e9_0oslt00ydevstack@QuobyteHD Sep 23 14:50:55 devstack sudo[103838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:50:55 devstack sudo[103837]: pam_unix(sudo:session): session closed for user root Sep 23 14:50:55 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-6a9d06c4-6a59-4d76-947a-02a5282fac09 tempest-VolumeAndVolumeTypeFromImageTest-496239476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9f44576d-755d-478e-a551-fc801411de2a_jnxuacfedevstack@QuobyteHD" returned: 1 in 0.341s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:50:55 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-6a9d06c4-6a59-4d76-947a-02a5282fac09 tempest-VolumeAndVolumeTypeFromImageTest-496239476 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9f44576d-755d-478e-a551-fc801411de2a_jnxuacfedevstack@QuobyteHD' failed. Not Retrying. {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 14:50:55 devstack cinder-volume[86310]: DEBUG cinder.image.image_utils [None req-6a9d06c4-6a59-4d76-947a-02a5282fac09 tempest-VolumeAndVolumeTypeFromImageTest-496239476 None] Temporary image 9f44576d-755d-478e-a551-fc801411de2a is fetched for user 7fcf8c6294fd4c8f97bece3114c04369. {{(pid=86310) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 23 14:50:55 devstack sudo[103839]: pam_unix(sudo:session): session closed for user root Sep 23 14:50:55 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ee8da371-2740-498d-91d0-678cb7542409 tempest-CreateVolumesFromImageTest-455036596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-f03f9087-a163-4669-8d93-cc34bead30cd" returned: 0 in 0.273s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:50:55 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-ee8da371-2740-498d-91d0-678cb7542409 tempest-CreateVolumesFromImageTest-455036596 None] <== create_volume: return (868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:50:55 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-ee8da371-2740-498d-91d0-678cb7542409 tempest-CreateVolumesFromImageTest-455036596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.873s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:50:55 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-95e24daa-1d57-435f-af3a-958994c7680a tempest-CreateVolumesFromSnapshotTest-1218382436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.233s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:50:55 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-ee8da371-2740-498d-91d0-678cb7542409 tempest-CreateVolumesFromImageTest-455036596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8f2e1e3-061c-4524-8ef5-7fa9572748b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f03f9087-a163-4669-8d93-cc34bead30cd', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:50:55 devstack sudo[103838]: pam_unix(sudo:session): session closed for user root Sep 23 14:50:55 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-ee8da371-2740-498d-91d0-678cb7542409 tempest-CreateVolumesFromImageTest-455036596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1c00340-84fc-4429-a883-4e2959686ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:50:55 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-95e24daa-1d57-435f-af3a-958994c7680a tempest-CreateVolumesFromSnapshotTest-1218382436 None] Creating offline snapshot 210b7ae8-df5c-42ae-bb76-1f146faceebd of volume 82b47b51-3d87-4e7f-8a72-f9a37b938253 {{(pid=86310) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 14:50:55 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-0a37e2b1-3ad9-4c7e-ad70-218fdbbcb03e tempest-VolumeImageDependencyTests-1226023076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1f10d4dd-83ef-43af-bc3f-6615cd0a31e9_0oslt00ydevstack@QuobyteHD" returned: 1 in 0.366s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:50:55 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-0a37e2b1-3ad9-4c7e-ad70-218fdbbcb03e tempest-VolumeImageDependencyTests-1226023076 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1f10d4dd-83ef-43af-bc3f-6615cd0a31e9_0oslt00ydevstack@QuobyteHD' failed. Not Retrying. {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 14:50:55 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-0a37e2b1-3ad9-4c7e-ad70-218fdbbcb03e tempest-VolumeImageDependencyTests-1226023076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:50:55 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-ee8da371-2740-498d-91d0-678cb7542409 tempest-CreateVolumesFromImageTest-455036596 None] Volume volume-f03f9087-a163-4669-8d93-cc34bead30cd (f03f9087-a163-4669-8d93-cc34bead30cd): created successfully Sep 23 14:50:55 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-ee8da371-2740-498d-91d0-678cb7542409 tempest-CreateVolumesFromImageTest-455036596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1c00340-84fc-4429-a883-4e2959686ad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:50:55 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-ee8da371-2740-498d-91d0-678cb7542409 tempest-CreateVolumesFromImageTest-455036596 None] Flow 'volume_create_manager' (f049ee4b-7600-448c-8606-951346e34a1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:50:55 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[b784067a-b5ef-4649-b5c4-b8ea1ab7e4fc]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:50:55 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-95e24daa-1d57-435f-af3a-958994c7680a tempest-CreateVolumesFromSnapshotTest-1218382436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-82b47b51-3d87-4e7f-8a72-f9a37b938253 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:50:55 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-ee8da371-2740-498d-91d0-678cb7542409 tempest-CreateVolumesFromImageTest-455036596 None] Created volume successfully. Sep 23 14:50:55 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[baec10f2-089d-4ab9-ad47-1f0e82a5ecc0]: (4, 'raw') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:50:55 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-6a9d06c4-6a59-4d76-947a-02a5282fac09 tempest-VolumeAndVolumeTypeFromImageTest-496239476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9f44576d-755d-478e-a551-fc801411de2a_jnxuacfedevstack@QuobyteHD {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:50:55 devstack sudo[103850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-82b47b51-3d87-4e7f-8a72-f9a37b938253 Sep 23 14:50:55 devstack sudo[103850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:50:55 devstack sudo[103851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9f44576d-755d-478e-a551-fc801411de2a_jnxuacfedevstack@QuobyteHD Sep 23 14:50:55 devstack sudo[103851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:50:55 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-02d29aa3-6cc8-4b4d-bf62-f5ead101ed28 tempest-CreateVolumesFromImageTest-455036596 None] Acquiring lock "cinder-f03f9087-a163-4669-8d93-cc34bead30cd-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:50:55 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-02d29aa3-6cc8-4b4d-bf62-f5ead101ed28 tempest-CreateVolumesFromImageTest-455036596 None] Lock "cinder-f03f9087-a163-4669-8d93-cc34bead30cd-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:50:56 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-02d29aa3-6cc8-4b4d-bf62-f5ead101ed28 tempest-CreateVolumesFromImageTest-455036596 None] Acquiring lock "cinder-quobyte-f03f9087-a163-4669-8d93-cc34bead30cd" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:50:56 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-02d29aa3-6cc8-4b4d-bf62-f5ead101ed28 tempest-CreateVolumesFromImageTest-455036596 None] Lock "cinder-quobyte-f03f9087-a163-4669-8d93-cc34bead30cd" acquired by "delete_volume" :: waited 0.019s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:50:56 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bd0c749-7cc6-4c7b-b893-b281647061ba]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:50:56 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-02d29aa3-6cc8-4b4d-bf62-f5ead101ed28 tempest-CreateVolumesFromImageTest-455036596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-f03f9087-a163-4669-8d93-cc34bead30cd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:50:56 devstack sudo[103851]: pam_unix(sudo:session): session closed for user root Sep 23 14:50:56 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-6a9d06c4-6a59-4d76-947a-02a5282fac09 tempest-VolumeAndVolumeTypeFromImageTest-496239476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9f44576d-755d-478e-a551-fc801411de2a_jnxuacfedevstack@QuobyteHD" returned: 0 in 0.356s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:50:56 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-6a9d06c4-6a59-4d76-947a-02a5282fac09 tempest-VolumeAndVolumeTypeFromImageTest-496239476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9f44576d-755d-478e-a551-fc801411de2a_jnxuacfedevstack@QuobyteHD {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:50:56 devstack sudo[103850]: pam_unix(sudo:session): session closed for user root Sep 23 14:50:56 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-95e24daa-1d57-435f-af3a-958994c7680a tempest-CreateVolumesFromSnapshotTest-1218382436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-82b47b51-3d87-4e7f-8a72-f9a37b938253" returned: 0 in 0.429s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:50:56 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-95e24daa-1d57-435f-af3a-958994c7680a tempest-CreateVolumesFromSnapshotTest-1218382436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-82b47b51-3d87-4e7f-8a72-f9a37b938253,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-82b47b51-3d87-4e7f-8a72-f9a37b938253.210b7ae8-df5c-42ae-bb76-1f146faceebd 1G {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:50:56 devstack sudo[103861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-82b47b51-3d87-4e7f-8a72-f9a37b938253,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-82b47b51-3d87-4e7f-8a72-f9a37b938253.210b7ae8-df5c-42ae-bb76-1f146faceebd 1G Sep 23 14:50:56 devstack sudo[103861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:50:56 devstack sudo[103859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-f03f9087-a163-4669-8d93-cc34bead30cd Sep 23 14:50:56 devstack sudo[103859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:50:56 devstack sudo[103860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9f44576d-755d-478e-a551-fc801411de2a_jnxuacfedevstack@QuobyteHD Sep 23 14:50:56 devstack sudo[103860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:50:56 devstack sudo[103859]: pam_unix(sudo:session): session closed for user root Sep 23 14:50:56 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-02d29aa3-6cc8-4b4d-bf62-f5ead101ed28 tempest-CreateVolumesFromImageTest-455036596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-f03f9087-a163-4669-8d93-cc34bead30cd" returned: 0 in 0.386s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:50:56 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-02d29aa3-6cc8-4b4d-bf62-f5ead101ed28 tempest-CreateVolumesFromImageTest-455036596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-f03f9087-a163-4669-8d93-cc34bead30cd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:50:56 devstack sudo[103860]: pam_unix(sudo:session): session closed for user root Sep 23 14:50:56 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-6a9d06c4-6a59-4d76-947a-02a5282fac09 tempest-VolumeAndVolumeTypeFromImageTest-496239476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9f44576d-755d-478e-a551-fc801411de2a_jnxuacfedevstack@QuobyteHD" returned: 1 in 0.383s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:50:56 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-6a9d06c4-6a59-4d76-947a-02a5282fac09 tempest-VolumeAndVolumeTypeFromImageTest-496239476 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9f44576d-755d-478e-a551-fc801411de2a_jnxuacfedevstack@QuobyteHD' failed. Not Retrying. {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 14:50:56 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-6a9d06c4-6a59-4d76-947a-02a5282fac09 tempest-VolumeAndVolumeTypeFromImageTest-496239476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:50:56 devstack sudo[103874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-f03f9087-a163-4669-8d93-cc34bead30cd Sep 23 14:50:56 devstack sudo[103874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:50:56 devstack sudo[103861]: pam_unix(sudo:session): session closed for user root Sep 23 14:50:56 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-95e24daa-1d57-435f-af3a-958994c7680a tempest-CreateVolumesFromSnapshotTest-1218382436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-82b47b51-3d87-4e7f-8a72-f9a37b938253,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-82b47b51-3d87-4e7f-8a72-f9a37b938253.210b7ae8-df5c-42ae-bb76-1f146faceebd 1G" returned: 0 in 0.466s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:50:56 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-95e24daa-1d57-435f-af3a-958994c7680a tempest-CreateVolumesFromSnapshotTest-1218382436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82b47b51-3d87-4e7f-8a72-f9a37b938253 -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-82b47b51-3d87-4e7f-8a72-f9a37b938253.210b7ae8-df5c-42ae-bb76-1f146faceebd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:50:56 devstack sudo[103876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82b47b51-3d87-4e7f-8a72-f9a37b938253 -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-82b47b51-3d87-4e7f-8a72-f9a37b938253.210b7ae8-df5c-42ae-bb76-1f146faceebd Sep 23 14:50:56 devstack sudo[103876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:50:56 devstack sudo[103874]: pam_unix(sudo:session): session closed for user root Sep 23 14:50:56 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-02d29aa3-6cc8-4b4d-bf62-f5ead101ed28 tempest-CreateVolumesFromImageTest-455036596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-f03f9087-a163-4669-8d93-cc34bead30cd" returned: 0 in 0.264s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:50:56 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-02d29aa3-6cc8-4b4d-bf62-f5ead101ed28 tempest-CreateVolumesFromImageTest-455036596 None] Lock "cinder-quobyte-f03f9087-a163-4669-8d93-cc34bead30cd" released by "delete_volume" :: held 0.697s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:50:56 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-02d29aa3-6cc8-4b4d-bf62-f5ead101ed28 tempest-CreateVolumesFromImageTest-455036596 None] Created reservations ['ba9847da-1776-4f29-9e11-a23effe93cc1', '6e4dce50-060c-4fc9-a1f9-d8b65458cad6', '92c5fafe-0cd0-4560-8bf1-b7c2f0672229', '1101e7fd-57f1-4aa1-bc64-be0213991281'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:50:56 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-02d29aa3-6cc8-4b4d-bf62-f5ead101ed28 tempest-CreateVolumesFromImageTest-455036596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:50:56 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-02d29aa3-6cc8-4b4d-bf62-f5ead101ed28 tempest-CreateVolumesFromImageTest-455036596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:50:56 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-02d29aa3-6cc8-4b4d-bf62-f5ead101ed28 tempest-CreateVolumesFromImageTest-455036596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:50:56 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-02d29aa3-6cc8-4b4d-bf62-f5ead101ed28 tempest-CreateVolumesFromImageTest-455036596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:50:56 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-02d29aa3-6cc8-4b4d-bf62-f5ead101ed28 tempest-CreateVolumesFromImageTest-455036596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:50:56 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-02d29aa3-6cc8-4b4d-bf62-f5ead101ed28 tempest-CreateVolumesFromImageTest-455036596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:50:56 devstack sudo[103882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:50:56 devstack sudo[103876]: pam_unix(sudo:session): session closed for user root Sep 23 14:50:56 devstack sudo[103882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:50:56 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-95e24daa-1d57-435f-af3a-958994c7680a tempest-CreateVolumesFromSnapshotTest-1218382436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82b47b51-3d87-4e7f-8a72-f9a37b938253 -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-82b47b51-3d87-4e7f-8a72-f9a37b938253.210b7ae8-df5c-42ae-bb76-1f146faceebd" returned: 0 in 0.303s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:50:56 devstack cinder-volume[86310]: WARNING cinder.volume.drivers.remotefs [None req-95e24daa-1d57-435f-af3a-958994c7680a tempest-CreateVolumesFromSnapshotTest-1218382436 None] /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-82b47b51-3d87-4e7f-8a72-f9a37b938253.210b7ae8-df5c-42ae-bb76-1f146faceebd is being set with open permissions: ugo+rw Sep 23 14:50:56 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-95e24daa-1d57-435f-af3a-958994c7680a tempest-CreateVolumesFromSnapshotTest-1218382436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-82b47b51-3d87-4e7f-8a72-f9a37b938253.210b7ae8-df5c-42ae-bb76-1f146faceebd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:50:56 devstack sudo[103884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-82b47b51-3d87-4e7f-8a72-f9a37b938253.210b7ae8-df5c-42ae-bb76-1f146faceebd Sep 23 14:50:56 devstack sudo[103884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:50:57 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-c3af82da-344b-4272-a977-fffb263cd6ea tempest-CreateVolumesFromImageTest-455036596 None] Acquiring lock "cinder-4dfe913b-8a89-4138-99ba-83ac82ae569e-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:50:57 devstack sudo[103882]: pam_unix(sudo:session): session closed for user root Sep 23 14:50:57 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-02d29aa3-6cc8-4b4d-bf62-f5ead101ed28 tempest-CreateVolumesFromImageTest-455036596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.287s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:50:57 devstack sudo[103884]: pam_unix(sudo:session): session closed for user root Sep 23 14:50:57 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-02d29aa3-6cc8-4b4d-bf62-f5ead101ed28 tempest-CreateVolumesFromImageTest-455036596 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:50:57 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-95e24daa-1d57-435f-af3a-958994c7680a tempest-CreateVolumesFromSnapshotTest-1218382436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-82b47b51-3d87-4e7f-8a72-f9a37b938253.210b7ae8-df5c-42ae-bb76-1f146faceebd" returned: 0 in 0.256s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:50:57 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-c3af82da-344b-4272-a977-fffb263cd6ea tempest-CreateVolumesFromImageTest-455036596 None] Lock "cinder-4dfe913b-8a89-4138-99ba-83ac82ae569e-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:50:57 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-02d29aa3-6cc8-4b4d-bf62-f5ead101ed28 tempest-CreateVolumesFromImageTest-455036596 None] Deleted volume successfully. Sep 23 14:50:57 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-02d29aa3-6cc8-4b4d-bf62-f5ead101ed28 tempest-CreateVolumesFromImageTest-455036596 None] Lock "cinder-f03f9087-a163-4669-8d93-cc34bead30cd-delete_volume" released by "delete_volume" :: held 1.229s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:50:57 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-95e24daa-1d57-435f-af3a-958994c7680a tempest-CreateVolumesFromSnapshotTest-1218382436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-82b47b51-3d87-4e7f-8a72-f9a37b938253.info {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:50:57 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-c3af82da-344b-4272-a977-fffb263cd6ea tempest-CreateVolumesFromImageTest-455036596 None] Acquiring lock "cinder-quobyte-4dfe913b-8a89-4138-99ba-83ac82ae569e" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:50:57 devstack sudo[103888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-82b47b51-3d87-4e7f-8a72-f9a37b938253.info Sep 23 14:50:57 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-c3af82da-344b-4272-a977-fffb263cd6ea tempest-CreateVolumesFromImageTest-455036596 None] Lock "cinder-quobyte-4dfe913b-8a89-4138-99ba-83ac82ae569e" acquired by "delete_volume" :: waited 0.018s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:50:57 devstack sudo[103888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:50:57 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[092c8891-b01b-438f-bcc0-8225be629635]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:50:57 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-c3af82da-344b-4272-a977-fffb263cd6ea tempest-CreateVolumesFromImageTest-455036596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4dfe913b-8a89-4138-99ba-83ac82ae569e {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:50:57 devstack sudo[103890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4dfe913b-8a89-4138-99ba-83ac82ae569e Sep 23 14:50:57 devstack sudo[103890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:50:57 devstack sudo[103888]: pam_unix(sudo:session): session closed for user root Sep 23 14:50:57 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-95e24daa-1d57-435f-af3a-958994c7680a tempest-CreateVolumesFromSnapshotTest-1218382436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-82b47b51-3d87-4e7f-8a72-f9a37b938253.info" returned: 0 in 0.278s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:50:57 devstack cinder-volume[86310]: WARNING cinder.volume.drivers.remotefs [None req-95e24daa-1d57-435f-af3a-958994c7680a tempest-CreateVolumesFromSnapshotTest-1218382436 None] /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-82b47b51-3d87-4e7f-8a72-f9a37b938253.info is being set with open permissions: ugo+rw Sep 23 14:50:57 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-95e24daa-1d57-435f-af3a-958994c7680a tempest-CreateVolumesFromSnapshotTest-1218382436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-82b47b51-3d87-4e7f-8a72-f9a37b938253.info {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:50:57 devstack sudo[103893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-82b47b51-3d87-4e7f-8a72-f9a37b938253.info Sep 23 14:50:57 devstack sudo[103893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:50:57 devstack sudo[103890]: pam_unix(sudo:session): session closed for user root Sep 23 14:50:57 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-c3af82da-344b-4272-a977-fffb263cd6ea tempest-CreateVolumesFromImageTest-455036596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4dfe913b-8a89-4138-99ba-83ac82ae569e" returned: 0 in 0.419s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:50:57 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-c3af82da-344b-4272-a977-fffb263cd6ea tempest-CreateVolumesFromImageTest-455036596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4dfe913b-8a89-4138-99ba-83ac82ae569e {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:50:57 devstack sudo[103899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4dfe913b-8a89-4138-99ba-83ac82ae569e Sep 23 14:50:57 devstack sudo[103899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:50:57 devstack sudo[103893]: pam_unix(sudo:session): session closed for user root Sep 23 14:50:57 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-95e24daa-1d57-435f-af3a-958994c7680a tempest-CreateVolumesFromSnapshotTest-1218382436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-82b47b51-3d87-4e7f-8a72-f9a37b938253.info" returned: 0 in 0.250s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:50:57 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-95e24daa-1d57-435f-af3a-958994c7680a tempest-CreateVolumesFromSnapshotTest-1218382436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.142s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:50:57 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-0a37e2b1-3ad9-4c7e-ad70-218fdbbcb03e tempest-VolumeImageDependencyTests-1226023076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.093s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:50:57 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-0a37e2b1-3ad9-4c7e-ad70-218fdbbcb03e tempest-VolumeImageDependencyTests-1226023076 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:50:53Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95f0a8da-3ea9-4392-ac79-0d9f8079286e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd35946751604d9cacf5a706240a4609',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:50:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:50:53Z,use_quota=True,user_id='7a83628165694ca79d9acf7e29cf8c50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:50:57 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-0a37e2b1-3ad9-4c7e-ad70-218fdbbcb03e tempest-VolumeImageDependencyTests-1226023076 None] Creating volume 95f0a8da-3ea9-4392-ac79-0d9f8079286e {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:50:57 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-0a37e2b1-3ad9-4c7e-ad70-218fdbbcb03e tempest-VolumeImageDependencyTests-1226023076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:50:57 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-0a37e2b1-3ad9-4c7e-ad70-218fdbbcb03e tempest-VolumeImageDependencyTests-1226023076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:50:57 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-0a37e2b1-3ad9-4c7e-ad70-218fdbbcb03e tempest-VolumeImageDependencyTests-1226023076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:50:57 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-0a37e2b1-3ad9-4c7e-ad70-218fdbbcb03e tempest-VolumeImageDependencyTests-1226023076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:50:57 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-0a37e2b1-3ad9-4c7e-ad70-218fdbbcb03e tempest-VolumeImageDependencyTests-1226023076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:50:57 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-0a37e2b1-3ad9-4c7e-ad70-218fdbbcb03e tempest-VolumeImageDependencyTests-1226023076 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:50:57 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-0a37e2b1-3ad9-4c7e-ad70-218fdbbcb03e tempest-VolumeImageDependencyTests-1226023076 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:50:57 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-0a37e2b1-3ad9-4c7e-ad70-218fdbbcb03e tempest-VolumeImageDependencyTests-1226023076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-95f0a8da-3ea9-4392-ac79-0d9f8079286e 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:50:57 devstack sudo[103901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-95f0a8da-3ea9-4392-ac79-0d9f8079286e 1073741824 Sep 23 14:50:57 devstack sudo[103901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:50:57 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-95e24daa-1d57-435f-af3a-958994c7680a tempest-CreateVolumesFromSnapshotTest-1218382436 None] Create snapshot completed successfully Sep 23 14:50:57 devstack sudo[103899]: pam_unix(sudo:session): session closed for user root Sep 23 14:50:57 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-c3af82da-344b-4272-a977-fffb263cd6ea tempest-CreateVolumesFromImageTest-455036596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4dfe913b-8a89-4138-99ba-83ac82ae569e" returned: 0 in 0.251s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:50:57 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-c3af82da-344b-4272-a977-fffb263cd6ea tempest-CreateVolumesFromImageTest-455036596 None] Lock "cinder-quobyte-4dfe913b-8a89-4138-99ba-83ac82ae569e" released by "delete_volume" :: held 0.718s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:50:58 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-c3af82da-344b-4272-a977-fffb263cd6ea tempest-CreateVolumesFromImageTest-455036596 None] Created reservations ['5ff96b4d-fa53-49fc-a61b-b85db1f400c7', '8a60309d-e6f7-4a26-9b79-97c8151295c3', '9314b493-c1c2-462c-9fe7-d5d7e5b3b903', '5bedfc61-03dc-4ebb-a37d-ecdfb49259f1'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:50:58 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-c3af82da-344b-4272-a977-fffb263cd6ea tempest-CreateVolumesFromImageTest-455036596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:50:58 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-c3af82da-344b-4272-a977-fffb263cd6ea tempest-CreateVolumesFromImageTest-455036596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:50:58 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-c3af82da-344b-4272-a977-fffb263cd6ea tempest-CreateVolumesFromImageTest-455036596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:50:58 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-c3af82da-344b-4272-a977-fffb263cd6ea tempest-CreateVolumesFromImageTest-455036596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:50:58 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-c3af82da-344b-4272-a977-fffb263cd6ea tempest-CreateVolumesFromImageTest-455036596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:50:58 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-c3af82da-344b-4272-a977-fffb263cd6ea tempest-CreateVolumesFromImageTest-455036596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:50:58 devstack sudo[103907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:50:58 devstack sudo[103907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:50:58 devstack sudo[103901]: pam_unix(sudo:session): session closed for user root Sep 23 14:50:58 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-0a37e2b1-3ad9-4c7e-ad70-218fdbbcb03e tempest-VolumeImageDependencyTests-1226023076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-95f0a8da-3ea9-4392-ac79-0d9f8079286e 1073741824" returned: 0 in 0.522s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:50:58 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-5691fa78-5dba-4ac0-a07b-b6e5b9119acf tempest-CreateVolumesFromImageTest-455036596 None] Acquiring lock "cinder-4f1f5166-1323-416a-966a-772c1b934d24-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:50:58 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-0a37e2b1-3ad9-4c7e-ad70-218fdbbcb03e tempest-VolumeImageDependencyTests-1226023076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-95f0a8da-3ea9-4392-ac79-0d9f8079286e {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:50:58 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-5691fa78-5dba-4ac0-a07b-b6e5b9119acf tempest-CreateVolumesFromImageTest-455036596 None] Lock "cinder-4f1f5166-1323-416a-966a-772c1b934d24-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:50:58 devstack sudo[103909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-95f0a8da-3ea9-4392-ac79-0d9f8079286e Sep 23 14:50:58 devstack sudo[103909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:50:58 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-5691fa78-5dba-4ac0-a07b-b6e5b9119acf tempest-CreateVolumesFromImageTest-455036596 None] Acquiring lock "cinder-quobyte-4f1f5166-1323-416a-966a-772c1b934d24" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:50:58 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-5691fa78-5dba-4ac0-a07b-b6e5b9119acf tempest-CreateVolumesFromImageTest-455036596 None] Lock "cinder-quobyte-4f1f5166-1323-416a-966a-772c1b934d24" acquired by "delete_volume" :: waited 0.017s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:50:58 devstack sudo[103907]: pam_unix(sudo:session): session closed for user root Sep 23 14:50:58 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-c3af82da-344b-4272-a977-fffb263cd6ea tempest-CreateVolumesFromImageTest-455036596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.331s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:50:58 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-c3af82da-344b-4272-a977-fffb263cd6ea tempest-CreateVolumesFromImageTest-455036596 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:50:58 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-c3af82da-344b-4272-a977-fffb263cd6ea tempest-CreateVolumesFromImageTest-455036596 None] Deleted volume successfully. Sep 23 14:50:58 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d77a5d-fbe8-4ac9-90d6-6d84cb6870c5]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:50:58 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-5691fa78-5dba-4ac0-a07b-b6e5b9119acf tempest-CreateVolumesFromImageTest-455036596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4f1f5166-1323-416a-966a-772c1b934d24 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:50:58 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-c3af82da-344b-4272-a977-fffb263cd6ea tempest-CreateVolumesFromImageTest-455036596 None] Lock "cinder-4dfe913b-8a89-4138-99ba-83ac82ae569e-delete_volume" released by "delete_volume" :: held 1.391s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:50:58 devstack sudo[103912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4f1f5166-1323-416a-966a-772c1b934d24 Sep 23 14:50:58 devstack sudo[103912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:50:58 devstack sudo[103909]: pam_unix(sudo:session): session closed for user root Sep 23 14:50:58 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-0a37e2b1-3ad9-4c7e-ad70-218fdbbcb03e tempest-VolumeImageDependencyTests-1226023076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-95f0a8da-3ea9-4392-ac79-0d9f8079286e" returned: 0 in 0.341s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:50:58 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-0a37e2b1-3ad9-4c7e-ad70-218fdbbcb03e tempest-VolumeImageDependencyTests-1226023076 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:50:58 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-0a37e2b1-3ad9-4c7e-ad70-218fdbbcb03e tempest-VolumeImageDependencyTests-1226023076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:50:58 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-6a9d06c4-6a59-4d76-947a-02a5282fac09 tempest-VolumeAndVolumeTypeFromImageTest-496239476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.226s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:50:58 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-6a9d06c4-6a59-4d76-947a-02a5282fac09 tempest-VolumeAndVolumeTypeFromImageTest-496239476 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:50:54Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c358676-b7ab-4d1e-b220-44587b8a782c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f633351771e34e5c88b9f16e1219e995',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:50:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:50:54Z,use_quota=True,user_id='7fcf8c6294fd4c8f97bece3114c04369',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a63fa93-2bdf-41ae-bcd0-b4c615f6f7ed),volume_type_id=4a63fa93-2bdf-41ae-bcd0-b4c615f6f7ed)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:50:58 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-6a9d06c4-6a59-4d76-947a-02a5282fac09 tempest-VolumeAndVolumeTypeFromImageTest-496239476 None] Creating volume 0c358676-b7ab-4d1e-b220-44587b8a782c {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:50:58 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-6a9d06c4-6a59-4d76-947a-02a5282fac09 tempest-VolumeAndVolumeTypeFromImageTest-496239476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:50:58 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-6a9d06c4-6a59-4d76-947a-02a5282fac09 tempest-VolumeAndVolumeTypeFromImageTest-496239476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:50:58 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-6a9d06c4-6a59-4d76-947a-02a5282fac09 tempest-VolumeAndVolumeTypeFromImageTest-496239476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:50:58 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-6a9d06c4-6a59-4d76-947a-02a5282fac09 tempest-VolumeAndVolumeTypeFromImageTest-496239476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:50:58 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-6a9d06c4-6a59-4d76-947a-02a5282fac09 tempest-VolumeAndVolumeTypeFromImageTest-496239476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:50:58 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-6a9d06c4-6a59-4d76-947a-02a5282fac09 tempest-VolumeAndVolumeTypeFromImageTest-496239476 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:50:58 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-6a9d06c4-6a59-4d76-947a-02a5282fac09 tempest-VolumeAndVolumeTypeFromImageTest-496239476 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:50:58 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-6a9d06c4-6a59-4d76-947a-02a5282fac09 tempest-VolumeAndVolumeTypeFromImageTest-496239476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-0c358676-b7ab-4d1e-b220-44587b8a782c 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:50:58 devstack sudo[103915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-0c358676-b7ab-4d1e-b220-44587b8a782c 1073741824 Sep 23 14:50:58 devstack sudo[103915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:50:58 devstack cinder-volume[86310]: DEBUG cinder.volume.volume_utils [None req-0a37e2b1-3ad9-4c7e-ad70-218fdbbcb03e tempest-VolumeImageDependencyTests-1226023076 None] Attempting download of 1f10d4dd-83ef-43af-bc3f-6615cd0a31e9 ((None, [{'url': 'file:///opt/stack/data/glance/images/1f10d4dd-83ef-43af-bc3f-6615cd0a31e9', 'metadata': {}}])) to volume 95f0a8da-3ea9-4392-ac79-0d9f8079286e. {{(pid=86310) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 23 14:50:58 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eaa55f4-83ba-4e24-bc83-c9505b665a72]: (4, 'raw') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:50:58 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-0a37e2b1-3ad9-4c7e-ad70-218fdbbcb03e tempest-VolumeImageDependencyTests-1226023076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1f10d4dd-83ef-43af-bc3f-6615cd0a31e9_snui58_2 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:50:59 devstack sudo[103917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1f10d4dd-83ef-43af-bc3f-6615cd0a31e9_snui58_2 Sep 23 14:50:59 devstack sudo[103917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:50:59 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbafc6fe-5b7b-4a9e-869a-9b53fe98f17a tempest-CreateVolumesFromSnapshotTest-1218382436 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:50:59 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-dbafc6fe-5b7b-4a9e-869a-9b53fe98f17a tempest-CreateVolumesFromSnapshotTest-1218382436 None] Flow 'volume_create_manager' (eaf9a304-8f56-450d-94f9-4e2f4dde529f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:50:59 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-dbafc6fe-5b7b-4a9e-869a-9b53fe98f17a tempest-CreateVolumesFromSnapshotTest-1218382436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2d295d3-f541-4a4f-825c-08936aa4487b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:50:59 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-dbafc6fe-5b7b-4a9e-869a-9b53fe98f17a tempest-CreateVolumesFromSnapshotTest-1218382436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2d295d3-f541-4a4f-825c-08936aa4487b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:50:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1815559661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ebc4750-29cf-4ab4-8dca-e5e9692faef0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbd117570db1461ba75ea39eb63c2847',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:50:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:50:59Z,use_quota=True,user_id='692103393e8f472e9c7edb18e5c97723',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:50:59 devstack sudo[103912]: pam_unix(sudo:session): session closed for user root Sep 23 14:50:59 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-dbafc6fe-5b7b-4a9e-869a-9b53fe98f17a tempest-CreateVolumesFromSnapshotTest-1218382436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e1e6e0e-e7d7-4d8a-a49e-d1a8c4fbc1c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:50:59 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-dbafc6fe-5b7b-4a9e-869a-9b53fe98f17a tempest-CreateVolumesFromSnapshotTest-1218382436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e1e6e0e-e7d7-4d8a-a49e-d1a8c4fbc1c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:50:59 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-dbafc6fe-5b7b-4a9e-869a-9b53fe98f17a tempest-CreateVolumesFromSnapshotTest-1218382436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a416a39e-2dd8-4421-956e-8a70e41d0a8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:50:59 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-dbafc6fe-5b7b-4a9e-869a-9b53fe98f17a tempest-CreateVolumesFromSnapshotTest-1218382436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a416a39e-2dd8-4421-956e-8a70e41d0a8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ebc4750-29cf-4ab4-8dca-e5e9692faef0', 'volume_name': 'volume-2ebc4750-29cf-4ab4-8dca-e5e9692faef0', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:50:59 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-dbafc6fe-5b7b-4a9e-869a-9b53fe98f17a tempest-CreateVolumesFromSnapshotTest-1218382436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4879d380-bead-4b48-a0a2-7b1aa0c96d9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:50:59 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-dbafc6fe-5b7b-4a9e-869a-9b53fe98f17a tempest-CreateVolumesFromSnapshotTest-1218382436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4879d380-bead-4b48-a0a2-7b1aa0c96d9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:50:59 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-dbafc6fe-5b7b-4a9e-869a-9b53fe98f17a tempest-CreateVolumesFromSnapshotTest-1218382436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (184088ac-8912-402f-bf8c-53cbf9bf04ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:50:59 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-dbafc6fe-5b7b-4a9e-869a-9b53fe98f17a tempest-CreateVolumesFromSnapshotTest-1218382436 None] Volume 2ebc4750-29cf-4ab4-8dca-e5e9692faef0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ebc4750-29cf-4ab4-8dca-e5e9692faef0', 'volume_size': 1} Sep 23 14:50:59 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-dbafc6fe-5b7b-4a9e-869a-9b53fe98f17a tempest-CreateVolumesFromSnapshotTest-1218382436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:50:59 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-5691fa78-5dba-4ac0-a07b-b6e5b9119acf tempest-CreateVolumesFromImageTest-455036596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4f1f5166-1323-416a-966a-772c1b934d24" returned: 0 in 0.811s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:50:59 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-5691fa78-5dba-4ac0-a07b-b6e5b9119acf tempest-CreateVolumesFromImageTest-455036596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4f1f5166-1323-416a-966a-772c1b934d24 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:50:59 devstack sudo[103926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4f1f5166-1323-416a-966a-772c1b934d24 Sep 23 14:50:59 devstack sudo[103926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:50:59 devstack sudo[103917]: pam_unix(sudo:session): session closed for user root Sep 23 14:50:59 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-0a37e2b1-3ad9-4c7e-ad70-218fdbbcb03e tempest-VolumeImageDependencyTests-1226023076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1f10d4dd-83ef-43af-bc3f-6615cd0a31e9_snui58_2" returned: 0 in 0.481s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:50:59 devstack sudo[103915]: pam_unix(sudo:session): session closed for user root Sep 23 14:50:59 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-0a37e2b1-3ad9-4c7e-ad70-218fdbbcb03e tempest-VolumeImageDependencyTests-1226023076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1f10d4dd-83ef-43af-bc3f-6615cd0a31e9_snui58_2 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:50:59 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-6a9d06c4-6a59-4d76-947a-02a5282fac09 tempest-VolumeAndVolumeTypeFromImageTest-496239476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-0c358676-b7ab-4d1e-b220-44587b8a782c 1073741824" returned: 0 in 0.712s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:50:59 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6a33d4d-3a4e-4b50-a20a-0618805cc4f0 tempest-CreateVolumesFromSnapshotTest-1218382436 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:50:59 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-e6a33d4d-3a4e-4b50-a20a-0618805cc4f0 tempest-CreateVolumesFromSnapshotTest-1218382436 None] Flow 'volume_create_manager' (e7cae4fb-fc9e-49c0-9309-2996473d397f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:50:59 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-e6a33d4d-3a4e-4b50-a20a-0618805cc4f0 tempest-CreateVolumesFromSnapshotTest-1218382436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d92e469-c968-4d24-8f40-b15493201d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:50:59 devstack sudo[103930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1f10d4dd-83ef-43af-bc3f-6615cd0a31e9_snui58_2 Sep 23 14:50:59 devstack sudo[103930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:50:59 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-e6a33d4d-3a4e-4b50-a20a-0618805cc4f0 tempest-CreateVolumesFromSnapshotTest-1218382436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d92e469-c968-4d24-8f40-b15493201d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:50:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-696302112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab2afe57-c4c8-4903-939b-f212406f686f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbd117570db1461ba75ea39eb63c2847',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:50:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:50:59Z,use_quota=True,user_id='692103393e8f472e9c7edb18e5c97723',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:50:59 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-e6a33d4d-3a4e-4b50-a20a-0618805cc4f0 tempest-CreateVolumesFromSnapshotTest-1218382436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dce3436f-9ea4-46f0-bec8-8fdb3eab899c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:50:59 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-e6a33d4d-3a4e-4b50-a20a-0618805cc4f0 tempest-CreateVolumesFromSnapshotTest-1218382436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dce3436f-9ea4-46f0-bec8-8fdb3eab899c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:50:59 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-e6a33d4d-3a4e-4b50-a20a-0618805cc4f0 tempest-CreateVolumesFromSnapshotTest-1218382436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f755fcb-3384-464a-b94d-c4b9e6e3b5ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:50:59 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-e6a33d4d-3a4e-4b50-a20a-0618805cc4f0 tempest-CreateVolumesFromSnapshotTest-1218382436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f755fcb-3384-464a-b94d-c4b9e6e3b5ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab2afe57-c4c8-4903-939b-f212406f686f', 'volume_name': 'volume-ab2afe57-c4c8-4903-939b-f212406f686f', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:50:59 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-e6a33d4d-3a4e-4b50-a20a-0618805cc4f0 tempest-CreateVolumesFromSnapshotTest-1218382436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f3ddc23-9f6f-489d-b184-697d89d0098a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:50:59 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-e6a33d4d-3a4e-4b50-a20a-0618805cc4f0 tempest-CreateVolumesFromSnapshotTest-1218382436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f3ddc23-9f6f-489d-b184-697d89d0098a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:50:59 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-e6a33d4d-3a4e-4b50-a20a-0618805cc4f0 tempest-CreateVolumesFromSnapshotTest-1218382436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0ee73bf-8c7f-4e08-97c4-1863e1b0cbbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:50:59 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-e6a33d4d-3a4e-4b50-a20a-0618805cc4f0 tempest-CreateVolumesFromSnapshotTest-1218382436 None] Volume ab2afe57-c4c8-4903-939b-f212406f686f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab2afe57-c4c8-4903-939b-f212406f686f', 'volume_size': 1} Sep 23 14:50:59 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-e6a33d4d-3a4e-4b50-a20a-0618805cc4f0 tempest-CreateVolumesFromSnapshotTest-1218382436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:50:59 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-6a9d06c4-6a59-4d76-947a-02a5282fac09 tempest-VolumeAndVolumeTypeFromImageTest-496239476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-0c358676-b7ab-4d1e-b220-44587b8a782c {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:50:59 devstack sudo[103933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-0c358676-b7ab-4d1e-b220-44587b8a782c Sep 23 14:50:59 devstack sudo[103933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:50:59 devstack sudo[103926]: pam_unix(sudo:session): session closed for user root Sep 23 14:50:59 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-5691fa78-5dba-4ac0-a07b-b6e5b9119acf tempest-CreateVolumesFromImageTest-455036596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4f1f5166-1323-416a-966a-772c1b934d24" returned: 0 in 0.382s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:50:59 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-5691fa78-5dba-4ac0-a07b-b6e5b9119acf tempest-CreateVolumesFromImageTest-455036596 None] Lock "cinder-quobyte-4f1f5166-1323-416a-966a-772c1b934d24" released by "delete_volume" :: held 1.274s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:50:59 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-5691fa78-5dba-4ac0-a07b-b6e5b9119acf tempest-CreateVolumesFromImageTest-455036596 None] Created reservations ['dcdfba7e-b151-47bb-bbec-20d81f74d0f1', '95cef05e-afd5-44d3-9cda-f149ff4323ba', 'dfb70536-0ea5-4c30-a5c5-b18477df9325', '0713546d-6977-4e72-a371-16c83b22d73b'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:50:59 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-5691fa78-5dba-4ac0-a07b-b6e5b9119acf tempest-CreateVolumesFromImageTest-455036596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:50:59 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-5691fa78-5dba-4ac0-a07b-b6e5b9119acf tempest-CreateVolumesFromImageTest-455036596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:50:59 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-5691fa78-5dba-4ac0-a07b-b6e5b9119acf tempest-CreateVolumesFromImageTest-455036596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:50:59 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-5691fa78-5dba-4ac0-a07b-b6e5b9119acf tempest-CreateVolumesFromImageTest-455036596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:50:59 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-5691fa78-5dba-4ac0-a07b-b6e5b9119acf tempest-CreateVolumesFromImageTest-455036596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:50:59 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-5691fa78-5dba-4ac0-a07b-b6e5b9119acf tempest-CreateVolumesFromImageTest-455036596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:50:59 devstack sudo[103935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:50:59 devstack sudo[103935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:50:59 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-b106d679-35cb-42fc-91fe-8254ccc5867c tempest-CreateVolumesFromSnapshotTest-1218382436 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:50:59 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-b106d679-35cb-42fc-91fe-8254ccc5867c tempest-CreateVolumesFromSnapshotTest-1218382436 None] Flow 'volume_create_manager' (1d875ac6-fc47-4727-b464-851641ef47e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:50:59 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-b106d679-35cb-42fc-91fe-8254ccc5867c tempest-CreateVolumesFromSnapshotTest-1218382436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13edf0fc-c51c-4e56-8ce3-f87bfb7928dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:50:59 devstack sudo[103930]: pam_unix(sudo:session): session closed for user root Sep 23 14:50:59 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-0a37e2b1-3ad9-4c7e-ad70-218fdbbcb03e tempest-VolumeImageDependencyTests-1226023076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1f10d4dd-83ef-43af-bc3f-6615cd0a31e9_snui58_2" returned: 1 in 0.580s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:50:59 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-0a37e2b1-3ad9-4c7e-ad70-218fdbbcb03e tempest-VolumeImageDependencyTests-1226023076 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1f10d4dd-83ef-43af-bc3f-6615cd0a31e9_snui58_2' failed. Not Retrying. {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 14:51:00 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-b106d679-35cb-42fc-91fe-8254ccc5867c tempest-CreateVolumesFromSnapshotTest-1218382436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13edf0fc-c51c-4e56-8ce3-f87bfb7928dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:51:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-635274774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=090a2019-2f89-4b0d-8fd1-94de747e1842,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbd117570db1461ba75ea39eb63c2847',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:51:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:51:00Z,use_quota=True,user_id='692103393e8f472e9c7edb18e5c97723',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:00 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-b106d679-35cb-42fc-91fe-8254ccc5867c tempest-CreateVolumesFromSnapshotTest-1218382436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b2dde3e-f0c3-449a-ac33-684b10ee5460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:00 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-b106d679-35cb-42fc-91fe-8254ccc5867c tempest-CreateVolumesFromSnapshotTest-1218382436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b2dde3e-f0c3-449a-ac33-684b10ee5460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:00 devstack sudo[103933]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:00 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-b106d679-35cb-42fc-91fe-8254ccc5867c tempest-CreateVolumesFromSnapshotTest-1218382436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f3ebee7-f388-4620-9534-494aafc7b10c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:00 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-b106d679-35cb-42fc-91fe-8254ccc5867c tempest-CreateVolumesFromSnapshotTest-1218382436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f3ebee7-f388-4620-9534-494aafc7b10c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '090a2019-2f89-4b0d-8fd1-94de747e1842', 'volume_name': 'volume-090a2019-2f89-4b0d-8fd1-94de747e1842', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:00 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-b106d679-35cb-42fc-91fe-8254ccc5867c tempest-CreateVolumesFromSnapshotTest-1218382436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d8338da-e893-4c6f-989c-8df404c5e20d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:00 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-b106d679-35cb-42fc-91fe-8254ccc5867c tempest-CreateVolumesFromSnapshotTest-1218382436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d8338da-e893-4c6f-989c-8df404c5e20d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:00 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-b106d679-35cb-42fc-91fe-8254ccc5867c tempest-CreateVolumesFromSnapshotTest-1218382436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e2e7a78-075b-4c43-b05f-66b1e93eec46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:00 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-b106d679-35cb-42fc-91fe-8254ccc5867c tempest-CreateVolumesFromSnapshotTest-1218382436 None] Volume 090a2019-2f89-4b0d-8fd1-94de747e1842: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-090a2019-2f89-4b0d-8fd1-94de747e1842', 'volume_size': 1} Sep 23 14:51:00 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-b106d679-35cb-42fc-91fe-8254ccc5867c tempest-CreateVolumesFromSnapshotTest-1218382436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:51:00 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[886d6a00-fccb-4ced-a076-be9c2bea0851]: (4, 'raw') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:51:00 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-0a37e2b1-3ad9-4c7e-ad70-218fdbbcb03e tempest-VolumeImageDependencyTests-1226023076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1f10d4dd-83ef-43af-bc3f-6615cd0a31e9_0oslt00ydevstack@QuobyteHD {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:00 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-6a9d06c4-6a59-4d76-947a-02a5282fac09 tempest-VolumeAndVolumeTypeFromImageTest-496239476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-0c358676-b7ab-4d1e-b220-44587b8a782c" returned: 0 in 0.421s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:00 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-6a9d06c4-6a59-4d76-947a-02a5282fac09 tempest-VolumeAndVolumeTypeFromImageTest-496239476 None] <== create_volume: return (1345ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:51:00 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-6a9d06c4-6a59-4d76-947a-02a5282fac09 tempest-VolumeAndVolumeTypeFromImageTest-496239476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.348s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:51:00 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-dbafc6fe-5b7b-4a9e-869a-9b53fe98f17a tempest-CreateVolumesFromSnapshotTest-1218382436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.746s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:51:00 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-dbafc6fe-5b7b-4a9e-869a-9b53fe98f17a tempest-CreateVolumesFromSnapshotTest-1218382436 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:50:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1815559661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ebc4750-29cf-4ab4-8dca-e5e9692faef0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbd117570db1461ba75ea39eb63c2847',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:50:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:50:59Z,use_quota=True,user_id='692103393e8f472e9c7edb18e5c97723',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:51:00 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-dbafc6fe-5b7b-4a9e-869a-9b53fe98f17a tempest-CreateVolumesFromSnapshotTest-1218382436 None] Creating volume 2ebc4750-29cf-4ab4-8dca-e5e9692faef0 {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:51:00 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-dbafc6fe-5b7b-4a9e-869a-9b53fe98f17a tempest-CreateVolumesFromSnapshotTest-1218382436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:51:00 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-dbafc6fe-5b7b-4a9e-869a-9b53fe98f17a tempest-CreateVolumesFromSnapshotTest-1218382436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:51:00 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-dbafc6fe-5b7b-4a9e-869a-9b53fe98f17a tempest-CreateVolumesFromSnapshotTest-1218382436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:51:00 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-dbafc6fe-5b7b-4a9e-869a-9b53fe98f17a tempest-CreateVolumesFromSnapshotTest-1218382436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:51:00 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-dbafc6fe-5b7b-4a9e-869a-9b53fe98f17a tempest-CreateVolumesFromSnapshotTest-1218382436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:51:00 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-dbafc6fe-5b7b-4a9e-869a-9b53fe98f17a tempest-CreateVolumesFromSnapshotTest-1218382436 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:51:00 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-dbafc6fe-5b7b-4a9e-869a-9b53fe98f17a tempest-CreateVolumesFromSnapshotTest-1218382436 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:51:00 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-dbafc6fe-5b7b-4a9e-869a-9b53fe98f17a tempest-CreateVolumesFromSnapshotTest-1218382436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2ebc4750-29cf-4ab4-8dca-e5e9692faef0 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:00 devstack sudo[103941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2ebc4750-29cf-4ab4-8dca-e5e9692faef0 1073741824 Sep 23 14:51:00 devstack sudo[103941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:00 devstack cinder-volume[86310]: DEBUG cinder.volume.volume_utils [None req-6a9d06c4-6a59-4d76-947a-02a5282fac09 tempest-VolumeAndVolumeTypeFromImageTest-496239476 None] Attempting download of 9f44576d-755d-478e-a551-fc801411de2a ((None, [{'url': 'file:///opt/stack/data/glance/images/9f44576d-755d-478e-a551-fc801411de2a', 'metadata': {}}])) to volume 0c358676-b7ab-4d1e-b220-44587b8a782c. {{(pid=86310) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 23 14:51:00 devstack sudo[103935]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:00 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-5691fa78-5dba-4ac0-a07b-b6e5b9119acf tempest-CreateVolumesFromImageTest-455036596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.297s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:00 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-5691fa78-5dba-4ac0-a07b-b6e5b9119acf tempest-CreateVolumesFromImageTest-455036596 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:51:00 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-5691fa78-5dba-4ac0-a07b-b6e5b9119acf tempest-CreateVolumesFromImageTest-455036596 None] Deleted volume successfully. Sep 23 14:51:00 devstack sudo[103940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1f10d4dd-83ef-43af-bc3f-6615cd0a31e9_0oslt00ydevstack@QuobyteHD Sep 23 14:51:00 devstack sudo[103940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:00 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[783d1964-77f2-469a-9d88-dfce9ca83f71]: (4, 'raw') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:51:00 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-6a9d06c4-6a59-4d76-947a-02a5282fac09 tempest-VolumeAndVolumeTypeFromImageTest-496239476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9f44576d-755d-478e-a551-fc801411de2a_qg5ehlsr {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:00 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-5691fa78-5dba-4ac0-a07b-b6e5b9119acf tempest-CreateVolumesFromImageTest-455036596 None] Lock "cinder-4f1f5166-1323-416a-966a-772c1b934d24-delete_volume" released by "delete_volume" :: held 1.876s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:51:00 devstack sudo[103945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9f44576d-755d-478e-a551-fc801411de2a_qg5ehlsr Sep 23 14:51:00 devstack sudo[103945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:00 devstack sudo[103940]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:00 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-0a37e2b1-3ad9-4c7e-ad70-218fdbbcb03e tempest-VolumeImageDependencyTests-1226023076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1f10d4dd-83ef-43af-bc3f-6615cd0a31e9_0oslt00ydevstack@QuobyteHD" returned: 0 in 0.433s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:00 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-0a37e2b1-3ad9-4c7e-ad70-218fdbbcb03e tempest-VolumeImageDependencyTests-1226023076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1f10d4dd-83ef-43af-bc3f-6615cd0a31e9_0oslt00ydevstack@QuobyteHD {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:00 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-7349eebc-5c49-4eca-b8eb-11e0baa22a1c tempest-CreateVolumesFromSnapshotTest-1218382436 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:51:00 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-7349eebc-5c49-4eca-b8eb-11e0baa22a1c tempest-CreateVolumesFromSnapshotTest-1218382436 None] Flow 'volume_create_manager' (6e5d64dc-9d99-49aa-a5d6-b48730a6449d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:51:00 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-7349eebc-5c49-4eca-b8eb-11e0baa22a1c tempest-CreateVolumesFromSnapshotTest-1218382436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7206af61-41f1-45b5-b959-b5c238e0e2d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:00 devstack sudo[103949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1f10d4dd-83ef-43af-bc3f-6615cd0a31e9_0oslt00ydevstack@QuobyteHD Sep 23 14:51:00 devstack sudo[103949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:00 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-7349eebc-5c49-4eca-b8eb-11e0baa22a1c tempest-CreateVolumesFromSnapshotTest-1218382436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7206af61-41f1-45b5-b959-b5c238e0e2d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:51:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-415921761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72ca9cbf-c763-4a8f-9e33-3c060f1630c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbd117570db1461ba75ea39eb63c2847',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:51:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:51:01Z,use_quota=True,user_id='692103393e8f472e9c7edb18e5c97723',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:00 devstack sudo[103945]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:00 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-7349eebc-5c49-4eca-b8eb-11e0baa22a1c tempest-CreateVolumesFromSnapshotTest-1218382436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee9db02a-b757-49a3-a2e1-805e3333cf18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:00 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-7349eebc-5c49-4eca-b8eb-11e0baa22a1c tempest-CreateVolumesFromSnapshotTest-1218382436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee9db02a-b757-49a3-a2e1-805e3333cf18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:00 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-7349eebc-5c49-4eca-b8eb-11e0baa22a1c tempest-CreateVolumesFromSnapshotTest-1218382436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (077369c8-d9b4-48ff-a631-c942492afd30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:00 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-7349eebc-5c49-4eca-b8eb-11e0baa22a1c tempest-CreateVolumesFromSnapshotTest-1218382436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (077369c8-d9b4-48ff-a631-c942492afd30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72ca9cbf-c763-4a8f-9e33-3c060f1630c2', 'volume_name': 'volume-72ca9cbf-c763-4a8f-9e33-3c060f1630c2', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:00 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-7349eebc-5c49-4eca-b8eb-11e0baa22a1c tempest-CreateVolumesFromSnapshotTest-1218382436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e3c9b10-751b-44b1-a53e-b06515741d27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:00 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-7349eebc-5c49-4eca-b8eb-11e0baa22a1c tempest-CreateVolumesFromSnapshotTest-1218382436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e3c9b10-751b-44b1-a53e-b06515741d27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:00 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-7349eebc-5c49-4eca-b8eb-11e0baa22a1c tempest-CreateVolumesFromSnapshotTest-1218382436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44f17800-e796-4db6-a38c-59bf0184a4c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:00 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-7349eebc-5c49-4eca-b8eb-11e0baa22a1c tempest-CreateVolumesFromSnapshotTest-1218382436 None] Volume 72ca9cbf-c763-4a8f-9e33-3c060f1630c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72ca9cbf-c763-4a8f-9e33-3c060f1630c2', 'volume_size': 1} Sep 23 14:51:00 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-7349eebc-5c49-4eca-b8eb-11e0baa22a1c tempest-CreateVolumesFromSnapshotTest-1218382436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:51:00 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-6a9d06c4-6a59-4d76-947a-02a5282fac09 tempest-VolumeAndVolumeTypeFromImageTest-496239476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9f44576d-755d-478e-a551-fc801411de2a_qg5ehlsr" returned: 0 in 0.543s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:00 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-6a9d06c4-6a59-4d76-947a-02a5282fac09 tempest-VolumeAndVolumeTypeFromImageTest-496239476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9f44576d-755d-478e-a551-fc801411de2a_qg5ehlsr {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:00 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-55c35910-8c4b-4a2e-8e53-f9fd9ea11a2a tempest-CreateVolumesFromImageTest-455036596 None] Acquiring lock "cinder-dbaa066c-68ee-49d5-890d-ac727ff556b9-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:51:00 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-55c35910-8c4b-4a2e-8e53-f9fd9ea11a2a tempest-CreateVolumesFromImageTest-455036596 None] Lock "cinder-dbaa066c-68ee-49d5-890d-ac727ff556b9-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:51:00 devstack sudo[103957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9f44576d-755d-478e-a551-fc801411de2a_qg5ehlsr Sep 23 14:51:00 devstack sudo[103957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:00 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-55c35910-8c4b-4a2e-8e53-f9fd9ea11a2a tempest-CreateVolumesFromImageTest-455036596 None] Acquiring lock "cinder-quobyte-dbaa066c-68ee-49d5-890d-ac727ff556b9" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:51:00 devstack sudo[103941]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:01 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-dbafc6fe-5b7b-4a9e-869a-9b53fe98f17a tempest-CreateVolumesFromSnapshotTest-1218382436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2ebc4750-29cf-4ab4-8dca-e5e9692faef0 1073741824" returned: 0 in 0.914s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:01 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-55c35910-8c4b-4a2e-8e53-f9fd9ea11a2a tempest-CreateVolumesFromImageTest-455036596 None] Lock "cinder-quobyte-dbaa066c-68ee-49d5-890d-ac727ff556b9" acquired by "delete_volume" :: waited 0.020s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:51:01 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[12a73997-b422-4f5a-b690-105f502a9b09]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:51:01 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-55c35910-8c4b-4a2e-8e53-f9fd9ea11a2a tempest-CreateVolumesFromImageTest-455036596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-dbaa066c-68ee-49d5-890d-ac727ff556b9 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:01 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-dbafc6fe-5b7b-4a9e-869a-9b53fe98f17a tempest-CreateVolumesFromSnapshotTest-1218382436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2ebc4750-29cf-4ab4-8dca-e5e9692faef0 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:01 devstack sudo[103963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2ebc4750-29cf-4ab4-8dca-e5e9692faef0 Sep 23 14:51:01 devstack sudo[103963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:01 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ad384d8-f922-4b73-baeb-be4958294c1e tempest-CreateVolumesFromSnapshotTest-1218382436 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:51:01 devstack sudo[103949]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:01 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-3ad384d8-f922-4b73-baeb-be4958294c1e tempest-CreateVolumesFromSnapshotTest-1218382436 None] Flow 'volume_create_manager' (57e57946-9f20-4805-9b5c-a38cd6f2225c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:51:01 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-3ad384d8-f922-4b73-baeb-be4958294c1e tempest-CreateVolumesFromSnapshotTest-1218382436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fd81977-e973-4425-abf6-3d487031fed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:01 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-0a37e2b1-3ad9-4c7e-ad70-218fdbbcb03e tempest-VolumeImageDependencyTests-1226023076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1f10d4dd-83ef-43af-bc3f-6615cd0a31e9_0oslt00ydevstack@QuobyteHD" returned: 1 in 0.694s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:01 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-0a37e2b1-3ad9-4c7e-ad70-218fdbbcb03e tempest-VolumeImageDependencyTests-1226023076 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1f10d4dd-83ef-43af-bc3f-6615cd0a31e9_0oslt00ydevstack@QuobyteHD' failed. Not Retrying. {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 14:51:01 devstack cinder-volume[86310]: DEBUG cinder.image.image_utils [None req-0a37e2b1-3ad9-4c7e-ad70-218fdbbcb03e tempest-VolumeImageDependencyTests-1226023076 None] 1f10d4dd-83ef-43af-bc3f-6615cd0a31e9 was raw, converting to qcow2 {{(pid=86310) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 23 14:51:01 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-0a37e2b1-3ad9-4c7e-ad70-218fdbbcb03e tempest-VolumeImageDependencyTests-1226023076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1f10d4dd-83ef-43af-bc3f-6615cd0a31e9_0oslt00ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-95f0a8da-3ea9-4392-ac79-0d9f8079286e {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:01 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-3ad384d8-f922-4b73-baeb-be4958294c1e tempest-CreateVolumesFromSnapshotTest-1218382436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fd81977-e973-4425-abf6-3d487031fed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:51:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-465807872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03899a30-662b-4b1e-a40e-a8e9bb04da33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbd117570db1461ba75ea39eb63c2847',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:51:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:51:01Z,use_quota=True,user_id='692103393e8f472e9c7edb18e5c97723',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:01 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-3ad384d8-f922-4b73-baeb-be4958294c1e tempest-CreateVolumesFromSnapshotTest-1218382436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cda3eba-9f1b-45ef-8899-61c8922e99f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:01 devstack sudo[103957]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:01 devstack sudo[103966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1f10d4dd-83ef-43af-bc3f-6615cd0a31e9_0oslt00ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-95f0a8da-3ea9-4392-ac79-0d9f8079286e Sep 23 14:51:01 devstack sudo[103966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:01 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-3ad384d8-f922-4b73-baeb-be4958294c1e tempest-CreateVolumesFromSnapshotTest-1218382436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cda3eba-9f1b-45ef-8899-61c8922e99f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:01 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-3ad384d8-f922-4b73-baeb-be4958294c1e tempest-CreateVolumesFromSnapshotTest-1218382436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2759a213-3db9-4b25-97f4-8ba6558b1477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:01 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-3ad384d8-f922-4b73-baeb-be4958294c1e tempest-CreateVolumesFromSnapshotTest-1218382436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2759a213-3db9-4b25-97f4-8ba6558b1477) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03899a30-662b-4b1e-a40e-a8e9bb04da33', 'volume_name': 'volume-03899a30-662b-4b1e-a40e-a8e9bb04da33', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:01 devstack sudo[103960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-dbaa066c-68ee-49d5-890d-ac727ff556b9 Sep 23 14:51:01 devstack sudo[103960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:01 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-3ad384d8-f922-4b73-baeb-be4958294c1e tempest-CreateVolumesFromSnapshotTest-1218382436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29d4bcca-f581-4ca5-8df2-77485382fd67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:01 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-3ad384d8-f922-4b73-baeb-be4958294c1e tempest-CreateVolumesFromSnapshotTest-1218382436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29d4bcca-f581-4ca5-8df2-77485382fd67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:01 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-3ad384d8-f922-4b73-baeb-be4958294c1e tempest-CreateVolumesFromSnapshotTest-1218382436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59b140f7-5796-4158-a7c2-777f542f76dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:01 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-3ad384d8-f922-4b73-baeb-be4958294c1e tempest-CreateVolumesFromSnapshotTest-1218382436 None] Volume 03899a30-662b-4b1e-a40e-a8e9bb04da33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03899a30-662b-4b1e-a40e-a8e9bb04da33', 'volume_size': 1} Sep 23 14:51:01 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-3ad384d8-f922-4b73-baeb-be4958294c1e tempest-CreateVolumesFromSnapshotTest-1218382436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:51:01 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-6a9d06c4-6a59-4d76-947a-02a5282fac09 tempest-VolumeAndVolumeTypeFromImageTest-496239476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9f44576d-755d-478e-a551-fc801411de2a_qg5ehlsr" returned: 1 in 0.474s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:01 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-6a9d06c4-6a59-4d76-947a-02a5282fac09 tempest-VolumeAndVolumeTypeFromImageTest-496239476 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9f44576d-755d-478e-a551-fc801411de2a_qg5ehlsr' failed. Not Retrying. {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 14:51:01 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[f20d999c-802e-44d0-81b6-d5f5a8ae97c0]: (4, 'raw') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:51:01 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-6a9d06c4-6a59-4d76-947a-02a5282fac09 tempest-VolumeAndVolumeTypeFromImageTest-496239476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9f44576d-755d-478e-a551-fc801411de2a_jnxuacfedevstack@QuobyteHD {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:01 devstack sudo[103970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9f44576d-755d-478e-a551-fc801411de2a_jnxuacfedevstack@QuobyteHD Sep 23 14:51:01 devstack sudo[103970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:01 devstack sudo[103963]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:01 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-dbafc6fe-5b7b-4a9e-869a-9b53fe98f17a tempest-CreateVolumesFromSnapshotTest-1218382436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2ebc4750-29cf-4ab4-8dca-e5e9692faef0" returned: 0 in 0.304s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:01 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-dbafc6fe-5b7b-4a9e-869a-9b53fe98f17a tempest-CreateVolumesFromSnapshotTest-1218382436 None] <== create_volume: return (1319ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:51:01 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-dbafc6fe-5b7b-4a9e-869a-9b53fe98f17a tempest-CreateVolumesFromSnapshotTest-1218382436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.324s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:51:01 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-e6a33d4d-3a4e-4b50-a20a-0618805cc4f0 tempest-CreateVolumesFromSnapshotTest-1218382436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.763s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:51:01 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-e6a33d4d-3a4e-4b50-a20a-0618805cc4f0 tempest-CreateVolumesFromSnapshotTest-1218382436 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:50:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-696302112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab2afe57-c4c8-4903-939b-f212406f686f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbd117570db1461ba75ea39eb63c2847',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:50:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:50:59Z,use_quota=True,user_id='692103393e8f472e9c7edb18e5c97723',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:51:01 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-e6a33d4d-3a4e-4b50-a20a-0618805cc4f0 tempest-CreateVolumesFromSnapshotTest-1218382436 None] Creating volume ab2afe57-c4c8-4903-939b-f212406f686f {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:51:01 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-e6a33d4d-3a4e-4b50-a20a-0618805cc4f0 tempest-CreateVolumesFromSnapshotTest-1218382436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:51:01 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-e6a33d4d-3a4e-4b50-a20a-0618805cc4f0 tempest-CreateVolumesFromSnapshotTest-1218382436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:51:01 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-e6a33d4d-3a4e-4b50-a20a-0618805cc4f0 tempest-CreateVolumesFromSnapshotTest-1218382436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:51:01 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-e6a33d4d-3a4e-4b50-a20a-0618805cc4f0 tempest-CreateVolumesFromSnapshotTest-1218382436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:51:01 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-e6a33d4d-3a4e-4b50-a20a-0618805cc4f0 tempest-CreateVolumesFromSnapshotTest-1218382436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:51:01 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-e6a33d4d-3a4e-4b50-a20a-0618805cc4f0 tempest-CreateVolumesFromSnapshotTest-1218382436 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:51:01 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-e6a33d4d-3a4e-4b50-a20a-0618805cc4f0 tempest-CreateVolumesFromSnapshotTest-1218382436 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:51:01 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-e6a33d4d-3a4e-4b50-a20a-0618805cc4f0 tempest-CreateVolumesFromSnapshotTest-1218382436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-ab2afe57-c4c8-4903-939b-f212406f686f 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:01 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-dbafc6fe-5b7b-4a9e-869a-9b53fe98f17a tempest-CreateVolumesFromSnapshotTest-1218382436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (184088ac-8912-402f-bf8c-53cbf9bf04ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ebc4750-29cf-4ab4-8dca-e5e9692faef0', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:01 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-dbafc6fe-5b7b-4a9e-869a-9b53fe98f17a tempest-CreateVolumesFromSnapshotTest-1218382436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83a64bd4-02df-4483-8674-f35a884c7aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:01 devstack sudo[103973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-ab2afe57-c4c8-4903-939b-f212406f686f 1073741824 Sep 23 14:51:01 devstack sudo[103973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:01 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-dbafc6fe-5b7b-4a9e-869a-9b53fe98f17a tempest-CreateVolumesFromSnapshotTest-1218382436 None] Volume volume-2ebc4750-29cf-4ab4-8dca-e5e9692faef0 (2ebc4750-29cf-4ab4-8dca-e5e9692faef0): created successfully Sep 23 14:51:01 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-dbafc6fe-5b7b-4a9e-869a-9b53fe98f17a tempest-CreateVolumesFromSnapshotTest-1218382436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83a64bd4-02df-4483-8674-f35a884c7aa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:01 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-dbafc6fe-5b7b-4a9e-869a-9b53fe98f17a tempest-CreateVolumesFromSnapshotTest-1218382436 None] Flow 'volume_create_manager' (eaf9a304-8f56-450d-94f9-4e2f4dde529f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:51:01 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-dbafc6fe-5b7b-4a9e-869a-9b53fe98f17a tempest-CreateVolumesFromSnapshotTest-1218382436 None] Created volume successfully. Sep 23 14:51:01 devstack sudo[103960]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:01 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-55c35910-8c4b-4a2e-8e53-f9fd9ea11a2a tempest-CreateVolumesFromImageTest-455036596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-dbaa066c-68ee-49d5-890d-ac727ff556b9" returned: 0 in 0.502s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:01 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-55c35910-8c4b-4a2e-8e53-f9fd9ea11a2a tempest-CreateVolumesFromImageTest-455036596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-dbaa066c-68ee-49d5-890d-ac727ff556b9 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:01 devstack sudo[103981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-dbaa066c-68ee-49d5-890d-ac727ff556b9 Sep 23 14:51:01 devstack sudo[103981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:01 devstack sudo[103970]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:01 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-6a9d06c4-6a59-4d76-947a-02a5282fac09 tempest-VolumeAndVolumeTypeFromImageTest-496239476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9f44576d-755d-478e-a551-fc801411de2a_jnxuacfedevstack@QuobyteHD" returned: 0 in 0.413s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:01 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-6a9d06c4-6a59-4d76-947a-02a5282fac09 tempest-VolumeAndVolumeTypeFromImageTest-496239476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9f44576d-755d-478e-a551-fc801411de2a_jnxuacfedevstack@QuobyteHD {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:01 devstack sudo[103966]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:01 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-0a37e2b1-3ad9-4c7e-ad70-218fdbbcb03e tempest-VolumeImageDependencyTests-1226023076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1f10d4dd-83ef-43af-bc3f-6615cd0a31e9_0oslt00ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-95f0a8da-3ea9-4392-ac79-0d9f8079286e" returned: 0 in 0.551s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:01 devstack cinder-volume[86310]: DEBUG cinder.image.image_utils [None req-0a37e2b1-3ad9-4c7e-ad70-218fdbbcb03e tempest-VolumeImageDependencyTests-1226023076 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1f10d4dd-83ef-43af-bc3f-6615cd0a31e9_0oslt00ydevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-95f0a8da-3ea9-4392-ac79-0d9f8079286e {{(pid=86310) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 14:51:01 devstack cinder-volume[86310]: INFO cinder.image.image_utils [None req-0a37e2b1-3ad9-4c7e-ad70-218fdbbcb03e tempest-VolumeImageDependencyTests-1226023076 None] Converted 0.00 MB image at 0.00 MB/s Sep 23 14:51:01 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-0a37e2b1-3ad9-4c7e-ad70-218fdbbcb03e tempest-VolumeImageDependencyTests-1226023076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-95f0a8da-3ea9-4392-ac79-0d9f8079286e 1G {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:01 devstack sudo[103990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-95f0a8da-3ea9-4392-ac79-0d9f8079286e 1G Sep 23 14:51:01 devstack sudo[103990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:01 devstack sudo[103986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9f44576d-755d-478e-a551-fc801411de2a_jnxuacfedevstack@QuobyteHD Sep 23 14:51:01 devstack sudo[103986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:01 devstack sudo[103981]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:01 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-55c35910-8c4b-4a2e-8e53-f9fd9ea11a2a tempest-CreateVolumesFromImageTest-455036596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-dbaa066c-68ee-49d5-890d-ac727ff556b9" returned: 0 in 0.322s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:01 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-55c35910-8c4b-4a2e-8e53-f9fd9ea11a2a tempest-CreateVolumesFromImageTest-455036596 None] Lock "cinder-quobyte-dbaa066c-68ee-49d5-890d-ac727ff556b9" released by "delete_volume" :: held 0.895s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:51:01 devstack sudo[103973]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:01 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-e6a33d4d-3a4e-4b50-a20a-0618805cc4f0 tempest-CreateVolumesFromSnapshotTest-1218382436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-ab2afe57-c4c8-4903-939b-f212406f686f 1073741824" returned: 0 in 0.537s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:01 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-55c35910-8c4b-4a2e-8e53-f9fd9ea11a2a tempest-CreateVolumesFromImageTest-455036596 None] Created reservations ['127840b2-b085-448c-9d18-6a82b86fa204', 'f10e2f03-7103-4a64-b7fa-a4fae29cbc8d', 'a43849e0-50e4-4523-b66f-78f1777a1ab3', '11acfdc7-1c33-4f54-8635-3514c4976ee1'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:51:02 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-e6a33d4d-3a4e-4b50-a20a-0618805cc4f0 tempest-CreateVolumesFromSnapshotTest-1218382436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-ab2afe57-c4c8-4903-939b-f212406f686f {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:02 devstack sudo[103995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-ab2afe57-c4c8-4903-939b-f212406f686f Sep 23 14:51:02 devstack sudo[103995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:02 devstack sudo[103986]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:02 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-6a9d06c4-6a59-4d76-947a-02a5282fac09 tempest-VolumeAndVolumeTypeFromImageTest-496239476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9f44576d-755d-478e-a551-fc801411de2a_jnxuacfedevstack@QuobyteHD" returned: 1 in 0.409s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:02 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-6a9d06c4-6a59-4d76-947a-02a5282fac09 tempest-VolumeAndVolumeTypeFromImageTest-496239476 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9f44576d-755d-478e-a551-fc801411de2a_jnxuacfedevstack@QuobyteHD' failed. Not Retrying. {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 14:51:02 devstack cinder-volume[86310]: DEBUG cinder.image.image_utils [None req-6a9d06c4-6a59-4d76-947a-02a5282fac09 tempest-VolumeAndVolumeTypeFromImageTest-496239476 None] 9f44576d-755d-478e-a551-fc801411de2a was raw, converting to qcow2 {{(pid=86310) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 23 14:51:02 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-6a9d06c4-6a59-4d76-947a-02a5282fac09 tempest-VolumeAndVolumeTypeFromImageTest-496239476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_9f44576d-755d-478e-a551-fc801411de2a_jnxuacfedevstack@QuobyteHD /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-0c358676-b7ab-4d1e-b220-44587b8a782c {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:02 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-55c35910-8c4b-4a2e-8e53-f9fd9ea11a2a tempest-CreateVolumesFromImageTest-455036596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:51:02 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-55c35910-8c4b-4a2e-8e53-f9fd9ea11a2a tempest-CreateVolumesFromImageTest-455036596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:51:02 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-55c35910-8c4b-4a2e-8e53-f9fd9ea11a2a tempest-CreateVolumesFromImageTest-455036596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:51:02 devstack sudo[104003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_9f44576d-755d-478e-a551-fc801411de2a_jnxuacfedevstack@QuobyteHD /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-0c358676-b7ab-4d1e-b220-44587b8a782c Sep 23 14:51:02 devstack sudo[104003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:02 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-55c35910-8c4b-4a2e-8e53-f9fd9ea11a2a tempest-CreateVolumesFromImageTest-455036596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:51:02 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-55c35910-8c4b-4a2e-8e53-f9fd9ea11a2a tempest-CreateVolumesFromImageTest-455036596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:51:02 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-55c35910-8c4b-4a2e-8e53-f9fd9ea11a2a tempest-CreateVolumesFromImageTest-455036596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:02 devstack sudo[104005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:51:02 devstack sudo[104005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:02 devstack sudo[103990]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:02 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-0a37e2b1-3ad9-4c7e-ad70-218fdbbcb03e tempest-VolumeImageDependencyTests-1226023076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-95f0a8da-3ea9-4392-ac79-0d9f8079286e 1G" returned: 0 in 0.473s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:02 devstack cinder-volume[86310]: DEBUG cinder.volume.volume_utils [None req-0a37e2b1-3ad9-4c7e-ad70-218fdbbcb03e tempest-VolumeImageDependencyTests-1226023076 None] Downloaded image 1f10d4dd-83ef-43af-bc3f-6615cd0a31e9 ((None, [{'url': 'file:///opt/stack/data/glance/images/1f10d4dd-83ef-43af-bc3f-6615cd0a31e9', 'metadata': {}}])) to volume 95f0a8da-3ea9-4392-ac79-0d9f8079286e successfully. {{(pid=86310) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 23 14:51:02 devstack cinder-volume[86310]: DEBUG cinder.image.image_utils [None req-0a37e2b1-3ad9-4c7e-ad70-218fdbbcb03e tempest-VolumeImageDependencyTests-1226023076 None] Temporary image 1f10d4dd-83ef-43af-bc3f-6615cd0a31e9 for user 7a83628165694ca79d9acf7e29cf8c50 is deleted. {{(pid=86310) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 23 14:51:02 devstack cinder-volume[86310]: DEBUG cinder.volume.volume_utils [None req-0a37e2b1-3ad9-4c7e-ad70-218fdbbcb03e tempest-VolumeImageDependencyTests-1226023076 None] Marking volume 95f0a8da-3ea9-4392-ac79-0d9f8079286e as bootable. {{(pid=86310) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 23 14:51:02 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-7b71c61e-7065-4a91-b379-59fe2aca3ad3 tempest-CreateVolumesFromImageTest-455036596 None] Acquiring lock "cinder-6574c9df-c7ae-439e-bec7-29196bb81692-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:51:02 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a37e2b1-3ad9-4c7e-ad70-218fdbbcb03e tempest-VolumeImageDependencyTests-1226023076 None] Copying metadata from image 1f10d4dd-83ef-43af-bc3f-6615cd0a31e9 to 95f0a8da-3ea9-4392-ac79-0d9f8079286e. {{(pid=86310) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 23 14:51:02 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a37e2b1-3ad9-4c7e-ad70-218fdbbcb03e tempest-VolumeImageDependencyTests-1226023076 None] Creating volume glance metadata for volume 95f0a8da-3ea9-4392-ac79-0d9f8079286e backed by image 1f10d4dd-83ef-43af-bc3f-6615cd0a31e9 with: {'image_id': '1f10d4dd-83ef-43af-bc3f-6615cd0a31e9', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '4e81c7bf56380eaa3122695002457f06', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86310) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 23 14:51:02 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-7b71c61e-7065-4a91-b379-59fe2aca3ad3 tempest-CreateVolumesFromImageTest-455036596 None] Lock "cinder-6574c9df-c7ae-439e-bec7-29196bb81692-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:51:02 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-7b71c61e-7065-4a91-b379-59fe2aca3ad3 tempest-CreateVolumesFromImageTest-455036596 None] Acquiring lock "cinder-quobyte-6574c9df-c7ae-439e-bec7-29196bb81692" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:51:02 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-7b71c61e-7065-4a91-b379-59fe2aca3ad3 tempest-CreateVolumesFromImageTest-455036596 None] Lock "cinder-quobyte-6574c9df-c7ae-439e-bec7-29196bb81692" acquired by "delete_volume" :: waited 0.048s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:51:02 devstack sudo[103995]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:02 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-e6a33d4d-3a4e-4b50-a20a-0618805cc4f0 tempest-CreateVolumesFromSnapshotTest-1218382436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-ab2afe57-c4c8-4903-939b-f212406f686f" returned: 0 in 0.414s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:02 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-e6a33d4d-3a4e-4b50-a20a-0618805cc4f0 tempest-CreateVolumesFromSnapshotTest-1218382436 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:51:02 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-e6a33d4d-3a4e-4b50-a20a-0618805cc4f0 tempest-CreateVolumesFromSnapshotTest-1218382436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.016s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:51:02 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-b106d679-35cb-42fc-91fe-8254ccc5867c tempest-CreateVolumesFromSnapshotTest-1218382436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.378s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:51:02 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-b106d679-35cb-42fc-91fe-8254ccc5867c tempest-CreateVolumesFromSnapshotTest-1218382436 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:51:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-635274774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=090a2019-2f89-4b0d-8fd1-94de747e1842,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbd117570db1461ba75ea39eb63c2847',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:51:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:51:00Z,use_quota=True,user_id='692103393e8f472e9c7edb18e5c97723',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:51:02 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-b106d679-35cb-42fc-91fe-8254ccc5867c tempest-CreateVolumesFromSnapshotTest-1218382436 None] Creating volume 090a2019-2f89-4b0d-8fd1-94de747e1842 {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:51:02 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-b106d679-35cb-42fc-91fe-8254ccc5867c tempest-CreateVolumesFromSnapshotTest-1218382436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:51:02 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-b106d679-35cb-42fc-91fe-8254ccc5867c tempest-CreateVolumesFromSnapshotTest-1218382436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:51:02 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-b106d679-35cb-42fc-91fe-8254ccc5867c tempest-CreateVolumesFromSnapshotTest-1218382436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:51:02 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-b106d679-35cb-42fc-91fe-8254ccc5867c tempest-CreateVolumesFromSnapshotTest-1218382436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:51:02 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-b106d679-35cb-42fc-91fe-8254ccc5867c tempest-CreateVolumesFromSnapshotTest-1218382436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:51:02 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-b106d679-35cb-42fc-91fe-8254ccc5867c tempest-CreateVolumesFromSnapshotTest-1218382436 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:51:02 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-b106d679-35cb-42fc-91fe-8254ccc5867c tempest-CreateVolumesFromSnapshotTest-1218382436 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:51:02 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-b106d679-35cb-42fc-91fe-8254ccc5867c tempest-CreateVolumesFromSnapshotTest-1218382436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-090a2019-2f89-4b0d-8fd1-94de747e1842 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:02 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd14b273-73ee-4ece-b0c7-0bc610171f96]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:51:02 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-7b71c61e-7065-4a91-b379-59fe2aca3ad3 tempest-CreateVolumesFromImageTest-455036596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6574c9df-c7ae-439e-bec7-29196bb81692 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:02 devstack sudo[104010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-090a2019-2f89-4b0d-8fd1-94de747e1842 1073741824 Sep 23 14:51:02 devstack sudo[104010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:02 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-e6a33d4d-3a4e-4b50-a20a-0618805cc4f0 tempest-CreateVolumesFromSnapshotTest-1218382436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0ee73bf-8c7f-4e08-97c4-1863e1b0cbbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab2afe57-c4c8-4903-939b-f212406f686f', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:02 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-e6a33d4d-3a4e-4b50-a20a-0618805cc4f0 tempest-CreateVolumesFromSnapshotTest-1218382436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db0716ff-5677-4360-8600-648b3cbb2b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:02 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-0a37e2b1-3ad9-4c7e-ad70-218fdbbcb03e tempest-VolumeImageDependencyTests-1226023076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83e23967-9070-4d78-b81d-9e01c831f881) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95f0a8da-3ea9-4392-ac79-0d9f8079286e', 'volume_size': 1, 'image_id': '1f10d4dd-83ef-43af-bc3f-6615cd0a31e9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1f10d4dd-83ef-43af-bc3f-6615cd0a31e9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4e81c7bf56380eaa3122695002457f06', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'bd35946751604d9cacf5a706240a4609', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '22f9f2ff3ff4cbbc763feb1b9331cb91fa1e614bae7e17956982c20d5e42687537380a02de79e0d0da9d61d03788b51e5dddf4f006602959b4165dce066d51e4', 'id': '1f10d4dd-83ef-43af-bc3f-6615cd0a31e9', 'created_at': datetime.datetime(2026, 9, 23, 12, 50, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 23, 12, 50, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1f10d4dd-83ef-43af-bc3f-6615cd0a31e9/file', 'properties': {}}, 'image_service': }' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:02 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-0a37e2b1-3ad9-4c7e-ad70-218fdbbcb03e tempest-VolumeImageDependencyTests-1226023076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78cf8474-34dd-42d8-84e6-b82e0dd2cc82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:02 devstack sudo[104005]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:02 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-55c35910-8c4b-4a2e-8e53-f9fd9ea11a2a tempest-CreateVolumesFromImageTest-455036596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.386s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:02 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-e6a33d4d-3a4e-4b50-a20a-0618805cc4f0 tempest-CreateVolumesFromSnapshotTest-1218382436 None] Volume volume-ab2afe57-c4c8-4903-939b-f212406f686f (ab2afe57-c4c8-4903-939b-f212406f686f): created successfully Sep 23 14:51:02 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-e6a33d4d-3a4e-4b50-a20a-0618805cc4f0 tempest-CreateVolumesFromSnapshotTest-1218382436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db0716ff-5677-4360-8600-648b3cbb2b71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:02 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-e6a33d4d-3a4e-4b50-a20a-0618805cc4f0 tempest-CreateVolumesFromSnapshotTest-1218382436 None] Flow 'volume_create_manager' (e7cae4fb-fc9e-49c0-9309-2996473d397f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:51:02 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-55c35910-8c4b-4a2e-8e53-f9fd9ea11a2a tempest-CreateVolumesFromImageTest-455036596 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:51:02 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-55c35910-8c4b-4a2e-8e53-f9fd9ea11a2a tempest-CreateVolumesFromImageTest-455036596 None] Deleted volume successfully. Sep 23 14:51:02 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-0a37e2b1-3ad9-4c7e-ad70-218fdbbcb03e tempest-VolumeImageDependencyTests-1226023076 None] Volume volume-95f0a8da-3ea9-4392-ac79-0d9f8079286e (95f0a8da-3ea9-4392-ac79-0d9f8079286e): created successfully Sep 23 14:51:02 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-0a37e2b1-3ad9-4c7e-ad70-218fdbbcb03e tempest-VolumeImageDependencyTests-1226023076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78cf8474-34dd-42d8-84e6-b82e0dd2cc82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:02 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-0a37e2b1-3ad9-4c7e-ad70-218fdbbcb03e tempest-VolumeImageDependencyTests-1226023076 None] Flow 'volume_create_manager' (bdf66033-cf6c-4668-a1cf-41ff119a54b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:51:02 devstack sudo[104012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6574c9df-c7ae-439e-bec7-29196bb81692 Sep 23 14:51:02 devstack sudo[104012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:02 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-e6a33d4d-3a4e-4b50-a20a-0618805cc4f0 tempest-CreateVolumesFromSnapshotTest-1218382436 None] Created volume successfully. Sep 23 14:51:02 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-55c35910-8c4b-4a2e-8e53-f9fd9ea11a2a tempest-CreateVolumesFromImageTest-455036596 None] Lock "cinder-dbaa066c-68ee-49d5-890d-ac727ff556b9-delete_volume" released by "delete_volume" :: held 1.719s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:51:02 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-0a37e2b1-3ad9-4c7e-ad70-218fdbbcb03e tempest-VolumeImageDependencyTests-1226023076 None] Created volume successfully. Sep 23 14:51:02 devstack sudo[104003]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:02 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-6a9d06c4-6a59-4d76-947a-02a5282fac09 tempest-VolumeAndVolumeTypeFromImageTest-496239476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_9f44576d-755d-478e-a551-fc801411de2a_jnxuacfedevstack@QuobyteHD /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-0c358676-b7ab-4d1e-b220-44587b8a782c" returned: 0 in 0.631s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:02 devstack cinder-volume[86310]: DEBUG cinder.image.image_utils [None req-6a9d06c4-6a59-4d76-947a-02a5282fac09 tempest-VolumeAndVolumeTypeFromImageTest-496239476 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9f44576d-755d-478e-a551-fc801411de2a_jnxuacfedevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-0c358676-b7ab-4d1e-b220-44587b8a782c {{(pid=86310) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 14:51:02 devstack cinder-volume[86310]: INFO cinder.image.image_utils [None req-6a9d06c4-6a59-4d76-947a-02a5282fac09 tempest-VolumeAndVolumeTypeFromImageTest-496239476 None] Converted 0.00 MB image at 0.00 MB/s Sep 23 14:51:02 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-6a9d06c4-6a59-4d76-947a-02a5282fac09 tempest-VolumeAndVolumeTypeFromImageTest-496239476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-0c358676-b7ab-4d1e-b220-44587b8a782c 1G {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:02 devstack sudo[104019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-0c358676-b7ab-4d1e-b220-44587b8a782c 1G Sep 23 14:51:02 devstack sudo[104019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:02 devstack sudo[104012]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:02 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-7b71c61e-7065-4a91-b379-59fe2aca3ad3 tempest-CreateVolumesFromImageTest-455036596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6574c9df-c7ae-439e-bec7-29196bb81692" returned: 0 in 0.454s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:02 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-7b71c61e-7065-4a91-b379-59fe2aca3ad3 tempest-CreateVolumesFromImageTest-455036596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6574c9df-c7ae-439e-bec7-29196bb81692 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:02 devstack sudo[104027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6574c9df-c7ae-439e-bec7-29196bb81692 Sep 23 14:51:02 devstack sudo[104027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:03 devstack sudo[104010]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:03 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-b106d679-35cb-42fc-91fe-8254ccc5867c tempest-CreateVolumesFromSnapshotTest-1218382436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-090a2019-2f89-4b0d-8fd1-94de747e1842 1073741824" returned: 0 in 0.562s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:03 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-b106d679-35cb-42fc-91fe-8254ccc5867c tempest-CreateVolumesFromSnapshotTest-1218382436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-090a2019-2f89-4b0d-8fd1-94de747e1842 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:03 devstack sudo[104032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-090a2019-2f89-4b0d-8fd1-94de747e1842 Sep 23 14:51:03 devstack sudo[104032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:03 devstack sudo[104019]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:03 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-6a9d06c4-6a59-4d76-947a-02a5282fac09 tempest-VolumeAndVolumeTypeFromImageTest-496239476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-0c358676-b7ab-4d1e-b220-44587b8a782c 1G" returned: 0 in 0.441s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:03 devstack cinder-volume[86310]: DEBUG cinder.volume.volume_utils [None req-6a9d06c4-6a59-4d76-947a-02a5282fac09 tempest-VolumeAndVolumeTypeFromImageTest-496239476 None] Downloaded image 9f44576d-755d-478e-a551-fc801411de2a ((None, [{'url': 'file:///opt/stack/data/glance/images/9f44576d-755d-478e-a551-fc801411de2a', 'metadata': {}}])) to volume 0c358676-b7ab-4d1e-b220-44587b8a782c successfully. {{(pid=86310) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 23 14:51:03 devstack cinder-volume[86310]: DEBUG cinder.image.image_utils [None req-6a9d06c4-6a59-4d76-947a-02a5282fac09 tempest-VolumeAndVolumeTypeFromImageTest-496239476 None] Temporary image 9f44576d-755d-478e-a551-fc801411de2a for user 7fcf8c6294fd4c8f97bece3114c04369 is deleted. {{(pid=86310) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 23 14:51:03 devstack cinder-volume[86310]: DEBUG cinder.volume.volume_utils [None req-6a9d06c4-6a59-4d76-947a-02a5282fac09 tempest-VolumeAndVolumeTypeFromImageTest-496239476 None] Marking volume 0c358676-b7ab-4d1e-b220-44587b8a782c as bootable. {{(pid=86310) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 23 14:51:03 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a9d06c4-6a59-4d76-947a-02a5282fac09 tempest-VolumeAndVolumeTypeFromImageTest-496239476 None] Copying metadata from image 9f44576d-755d-478e-a551-fc801411de2a to 0c358676-b7ab-4d1e-b220-44587b8a782c. {{(pid=86310) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 23 14:51:03 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a9d06c4-6a59-4d76-947a-02a5282fac09 tempest-VolumeAndVolumeTypeFromImageTest-496239476 None] Creating volume glance metadata for volume 0c358676-b7ab-4d1e-b220-44587b8a782c backed by image 9f44576d-755d-478e-a551-fc801411de2a with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '9f44576d-755d-478e-a551-fc801411de2a', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '5ec323b9201f1378ff8b7b453d48e7f2', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86310) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 23 14:51:03 devstack sudo[104027]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:03 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-7b71c61e-7065-4a91-b379-59fe2aca3ad3 tempest-CreateVolumesFromImageTest-455036596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6574c9df-c7ae-439e-bec7-29196bb81692" returned: 0 in 0.331s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:03 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-7b71c61e-7065-4a91-b379-59fe2aca3ad3 tempest-CreateVolumesFromImageTest-455036596 None] Lock "cinder-quobyte-6574c9df-c7ae-439e-bec7-29196bb81692" released by "delete_volume" :: held 0.876s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:51:03 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-f931d55f-1410-418d-a483-ba95b88a900d tempest-VolumeImageDependencyTests-1226023076 None] Acquiring lock "cinder-95f0a8da-3ea9-4392-ac79-0d9f8079286e-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:51:03 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-f931d55f-1410-418d-a483-ba95b88a900d tempest-VolumeImageDependencyTests-1226023076 None] Lock "cinder-95f0a8da-3ea9-4392-ac79-0d9f8079286e-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:51:03 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-7b71c61e-7065-4a91-b379-59fe2aca3ad3 tempest-CreateVolumesFromImageTest-455036596 None] Created reservations ['fac7f332-4235-47be-9be6-5dca116f3437', '9aae8d3f-7b98-4cbe-bbf9-530feea912ff', '6ab15f6a-334c-48d7-bc0e-070c8e55f9a0', '7273d64b-d884-4b20-a1c6-1adf8accf3fd'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:51:03 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-f931d55f-1410-418d-a483-ba95b88a900d tempest-VolumeImageDependencyTests-1226023076 None] Acquiring lock "cinder-quobyte-95f0a8da-3ea9-4392-ac79-0d9f8079286e" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:51:03 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-6a9d06c4-6a59-4d76-947a-02a5282fac09 tempest-VolumeAndVolumeTypeFromImageTest-496239476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49e4d77a-4327-4534-a3c8-d2f7d46ca876) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c358676-b7ab-4d1e-b220-44587b8a782c', 'volume_size': 1, 'image_id': '9f44576d-755d-478e-a551-fc801411de2a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9f44576d-755d-478e-a551-fc801411de2a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5ec323b9201f1378ff8b7b453d48e7f2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f633351771e34e5c88b9f16e1219e995', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0e225bcc57a204ca5a9c8e57857a1a5e770be0c456fbd109b2e713806d846fb6509630a61784885962c073ed650a562acb604a4289555b5f0f959de79f6a651b', 'id': '9f44576d-755d-478e-a551-fc801411de2a', 'created_at': datetime.datetime(2026, 9, 23, 12, 50, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 23, 12, 50, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9f44576d-755d-478e-a551-fc801411de2a/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:03 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-6a9d06c4-6a59-4d76-947a-02a5282fac09 tempest-VolumeAndVolumeTypeFromImageTest-496239476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f884eb8-a3b2-42a9-abf8-c8f8a63e2fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:03 devstack sudo[104032]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:03 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-b106d679-35cb-42fc-91fe-8254ccc5867c tempest-CreateVolumesFromSnapshotTest-1218382436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-090a2019-2f89-4b0d-8fd1-94de747e1842" returned: 0 in 0.413s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:03 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-b106d679-35cb-42fc-91fe-8254ccc5867c tempest-CreateVolumesFromSnapshotTest-1218382436 None] <== create_volume: return (1028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:51:03 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-b106d679-35cb-42fc-91fe-8254ccc5867c tempest-CreateVolumesFromSnapshotTest-1218382436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.032s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:51:03 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-f931d55f-1410-418d-a483-ba95b88a900d tempest-VolumeImageDependencyTests-1226023076 None] Lock "cinder-quobyte-95f0a8da-3ea9-4392-ac79-0d9f8079286e" acquired by "delete_volume" :: waited 0.039s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:51:03 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-7349eebc-5c49-4eca-b8eb-11e0baa22a1c tempest-CreateVolumesFromSnapshotTest-1218382436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.692s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:51:03 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-7349eebc-5c49-4eca-b8eb-11e0baa22a1c tempest-CreateVolumesFromSnapshotTest-1218382436 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:51:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-415921761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72ca9cbf-c763-4a8f-9e33-3c060f1630c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbd117570db1461ba75ea39eb63c2847',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:51:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:51:01Z,use_quota=True,user_id='692103393e8f472e9c7edb18e5c97723',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:51:03 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-7349eebc-5c49-4eca-b8eb-11e0baa22a1c tempest-CreateVolumesFromSnapshotTest-1218382436 None] Creating volume 72ca9cbf-c763-4a8f-9e33-3c060f1630c2 {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:51:03 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-7349eebc-5c49-4eca-b8eb-11e0baa22a1c tempest-CreateVolumesFromSnapshotTest-1218382436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:51:03 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-7349eebc-5c49-4eca-b8eb-11e0baa22a1c tempest-CreateVolumesFromSnapshotTest-1218382436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:51:03 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-7349eebc-5c49-4eca-b8eb-11e0baa22a1c tempest-CreateVolumesFromSnapshotTest-1218382436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:51:03 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-7349eebc-5c49-4eca-b8eb-11e0baa22a1c tempest-CreateVolumesFromSnapshotTest-1218382436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:51:03 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-7349eebc-5c49-4eca-b8eb-11e0baa22a1c tempest-CreateVolumesFromSnapshotTest-1218382436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:51:03 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-7349eebc-5c49-4eca-b8eb-11e0baa22a1c tempest-CreateVolumesFromSnapshotTest-1218382436 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:51:03 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-7349eebc-5c49-4eca-b8eb-11e0baa22a1c tempest-CreateVolumesFromSnapshotTest-1218382436 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:51:03 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-7349eebc-5c49-4eca-b8eb-11e0baa22a1c tempest-CreateVolumesFromSnapshotTest-1218382436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-72ca9cbf-c763-4a8f-9e33-3c060f1630c2 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:03 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[88ca810c-4d93-4da5-b3db-bc6e5954216f]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:51:03 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-f931d55f-1410-418d-a483-ba95b88a900d tempest-VolumeImageDependencyTests-1226023076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-95f0a8da-3ea9-4392-ac79-0d9f8079286e {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:03 devstack sudo[104037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-72ca9cbf-c763-4a8f-9e33-3c060f1630c2 1073741824 Sep 23 14:51:03 devstack sudo[104037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:03 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-6a9d06c4-6a59-4d76-947a-02a5282fac09 tempest-VolumeAndVolumeTypeFromImageTest-496239476 None] Volume volume-0c358676-b7ab-4d1e-b220-44587b8a782c (0c358676-b7ab-4d1e-b220-44587b8a782c): created successfully Sep 23 14:51:03 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-6a9d06c4-6a59-4d76-947a-02a5282fac09 tempest-VolumeAndVolumeTypeFromImageTest-496239476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f884eb8-a3b2-42a9-abf8-c8f8a63e2fdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:03 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-6a9d06c4-6a59-4d76-947a-02a5282fac09 tempest-VolumeAndVolumeTypeFromImageTest-496239476 None] Flow 'volume_create_manager' (3239ce19-f4cf-424e-b469-ff5344c49b69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:51:03 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-b106d679-35cb-42fc-91fe-8254ccc5867c tempest-CreateVolumesFromSnapshotTest-1218382436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e2e7a78-075b-4c43-b05f-66b1e93eec46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-090a2019-2f89-4b0d-8fd1-94de747e1842', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:03 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-b106d679-35cb-42fc-91fe-8254ccc5867c tempest-CreateVolumesFromSnapshotTest-1218382436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac86dd57-bf49-442d-9b0f-027a5ed8d88f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:03 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-b106d679-35cb-42fc-91fe-8254ccc5867c tempest-CreateVolumesFromSnapshotTest-1218382436 None] Volume volume-090a2019-2f89-4b0d-8fd1-94de747e1842 (090a2019-2f89-4b0d-8fd1-94de747e1842): created successfully Sep 23 14:51:03 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-b106d679-35cb-42fc-91fe-8254ccc5867c tempest-CreateVolumesFromSnapshotTest-1218382436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac86dd57-bf49-442d-9b0f-027a5ed8d88f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:03 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-b106d679-35cb-42fc-91fe-8254ccc5867c tempest-CreateVolumesFromSnapshotTest-1218382436 None] Flow 'volume_create_manager' (1d875ac6-fc47-4727-b464-851641ef47e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:51:03 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-6a9d06c4-6a59-4d76-947a-02a5282fac09 tempest-VolumeAndVolumeTypeFromImageTest-496239476 None] Created volume successfully. Sep 23 14:51:03 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-7b71c61e-7065-4a91-b379-59fe2aca3ad3 tempest-CreateVolumesFromImageTest-455036596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:51:03 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-7b71c61e-7065-4a91-b379-59fe2aca3ad3 tempest-CreateVolumesFromImageTest-455036596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:51:03 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-7b71c61e-7065-4a91-b379-59fe2aca3ad3 tempest-CreateVolumesFromImageTest-455036596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:51:03 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-7b71c61e-7065-4a91-b379-59fe2aca3ad3 tempest-CreateVolumesFromImageTest-455036596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:51:03 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-7b71c61e-7065-4a91-b379-59fe2aca3ad3 tempest-CreateVolumesFromImageTest-455036596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:51:03 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-7b71c61e-7065-4a91-b379-59fe2aca3ad3 tempest-CreateVolumesFromImageTest-455036596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:03 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-b106d679-35cb-42fc-91fe-8254ccc5867c tempest-CreateVolumesFromSnapshotTest-1218382436 None] Created volume successfully. Sep 23 14:51:03 devstack sudo[104038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-95f0a8da-3ea9-4392-ac79-0d9f8079286e Sep 23 14:51:03 devstack sudo[104038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:03 devstack sudo[104040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:51:03 devstack sudo[104040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:03 devstack sudo[104040]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:03 devstack sudo[104038]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:03 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-f931d55f-1410-418d-a483-ba95b88a900d tempest-VolumeImageDependencyTests-1226023076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-95f0a8da-3ea9-4392-ac79-0d9f8079286e" returned: 0 in 0.397s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:03 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-f931d55f-1410-418d-a483-ba95b88a900d tempest-VolumeImageDependencyTests-1226023076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-95f0a8da-3ea9-4392-ac79-0d9f8079286e {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:03 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-7b71c61e-7065-4a91-b379-59fe2aca3ad3 tempest-CreateVolumesFromImageTest-455036596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.320s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:03 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-7b71c61e-7065-4a91-b379-59fe2aca3ad3 tempest-CreateVolumesFromImageTest-455036596 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:51:03 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-7b71c61e-7065-4a91-b379-59fe2aca3ad3 tempest-CreateVolumesFromImageTest-455036596 None] Deleted volume successfully. Sep 23 14:51:03 devstack sudo[104051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-95f0a8da-3ea9-4392-ac79-0d9f8079286e Sep 23 14:51:03 devstack sudo[104051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:03 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-7b71c61e-7065-4a91-b379-59fe2aca3ad3 tempest-CreateVolumesFromImageTest-455036596 None] Lock "cinder-6574c9df-c7ae-439e-bec7-29196bb81692-delete_volume" released by "delete_volume" :: held 1.677s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:51:04 devstack sudo[104037]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:04 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-7349eebc-5c49-4eca-b8eb-11e0baa22a1c tempest-CreateVolumesFromSnapshotTest-1218382436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-72ca9cbf-c763-4a8f-9e33-3c060f1630c2 1073741824" returned: 0 in 0.547s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:04 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-2561bb3b-de3f-45ca-b8ca-06736b8e450e tempest-VolumeAndVolumeTypeFromImageTest-496239476 None] Acquiring lock "cinder-0c358676-b7ab-4d1e-b220-44587b8a782c-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:51:04 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-2561bb3b-de3f-45ca-b8ca-06736b8e450e tempest-VolumeAndVolumeTypeFromImageTest-496239476 None] Lock "cinder-0c358676-b7ab-4d1e-b220-44587b8a782c-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:51:04 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-7349eebc-5c49-4eca-b8eb-11e0baa22a1c tempest-CreateVolumesFromSnapshotTest-1218382436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-72ca9cbf-c763-4a8f-9e33-3c060f1630c2 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:04 devstack sudo[104053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-72ca9cbf-c763-4a8f-9e33-3c060f1630c2 Sep 23 14:51:04 devstack sudo[104053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:04 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-2561bb3b-de3f-45ca-b8ca-06736b8e450e tempest-VolumeAndVolumeTypeFromImageTest-496239476 None] Acquiring lock "cinder-quobyte-0c358676-b7ab-4d1e-b220-44587b8a782c" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:51:04 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-2561bb3b-de3f-45ca-b8ca-06736b8e450e tempest-VolumeAndVolumeTypeFromImageTest-496239476 None] Lock "cinder-quobyte-0c358676-b7ab-4d1e-b220-44587b8a782c" acquired by "delete_volume" :: waited 0.022s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:51:04 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[46324546-0538-4bde-91b0-8c4953fa3276]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:51:04 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-2561bb3b-de3f-45ca-b8ca-06736b8e450e tempest-VolumeAndVolumeTypeFromImageTest-496239476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-0c358676-b7ab-4d1e-b220-44587b8a782c {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:04 devstack sudo[104051]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:04 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-f931d55f-1410-418d-a483-ba95b88a900d tempest-VolumeImageDependencyTests-1226023076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-95f0a8da-3ea9-4392-ac79-0d9f8079286e" returned: 0 in 0.281s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:04 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-f931d55f-1410-418d-a483-ba95b88a900d tempest-VolumeImageDependencyTests-1226023076 None] Lock "cinder-quobyte-95f0a8da-3ea9-4392-ac79-0d9f8079286e" released by "delete_volume" :: held 0.744s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:51:04 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-f931d55f-1410-418d-a483-ba95b88a900d tempest-VolumeImageDependencyTests-1226023076 None] Created reservations ['6bc1e7c8-1663-4fb3-a443-155a1ff9edff', '7e44c74f-fb38-4c2e-990c-a5e845683953', '4917de29-480e-43fa-b265-13b950bd625d', '4acb73bd-470e-4000-800b-a13a8bba6563'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:51:04 devstack sudo[104056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-0c358676-b7ab-4d1e-b220-44587b8a782c Sep 23 14:51:04 devstack sudo[104056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:04 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-f931d55f-1410-418d-a483-ba95b88a900d tempest-VolumeImageDependencyTests-1226023076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:51:04 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-f931d55f-1410-418d-a483-ba95b88a900d tempest-VolumeImageDependencyTests-1226023076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:51:04 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-f931d55f-1410-418d-a483-ba95b88a900d tempest-VolumeImageDependencyTests-1226023076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:51:04 devstack sudo[104053]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:04 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-f931d55f-1410-418d-a483-ba95b88a900d tempest-VolumeImageDependencyTests-1226023076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:51:04 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-f931d55f-1410-418d-a483-ba95b88a900d tempest-VolumeImageDependencyTests-1226023076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:51:04 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-f931d55f-1410-418d-a483-ba95b88a900d tempest-VolumeImageDependencyTests-1226023076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:04 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-7349eebc-5c49-4eca-b8eb-11e0baa22a1c tempest-CreateVolumesFromSnapshotTest-1218382436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-72ca9cbf-c763-4a8f-9e33-3c060f1630c2" returned: 0 in 0.308s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:04 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-7349eebc-5c49-4eca-b8eb-11e0baa22a1c tempest-CreateVolumesFromSnapshotTest-1218382436 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:51:04 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-7349eebc-5c49-4eca-b8eb-11e0baa22a1c tempest-CreateVolumesFromSnapshotTest-1218382436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:51:04 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-3ad384d8-f922-4b73-baeb-be4958294c1e tempest-CreateVolumesFromSnapshotTest-1218382436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.155s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:51:04 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-3ad384d8-f922-4b73-baeb-be4958294c1e tempest-CreateVolumesFromSnapshotTest-1218382436 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:51:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-465807872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03899a30-662b-4b1e-a40e-a8e9bb04da33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbd117570db1461ba75ea39eb63c2847',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:51:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:51:01Z,use_quota=True,user_id='692103393e8f472e9c7edb18e5c97723',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:51:04 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-3ad384d8-f922-4b73-baeb-be4958294c1e tempest-CreateVolumesFromSnapshotTest-1218382436 None] Creating volume 03899a30-662b-4b1e-a40e-a8e9bb04da33 {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:51:04 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-3ad384d8-f922-4b73-baeb-be4958294c1e tempest-CreateVolumesFromSnapshotTest-1218382436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:51:04 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-3ad384d8-f922-4b73-baeb-be4958294c1e tempest-CreateVolumesFromSnapshotTest-1218382436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:51:04 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-3ad384d8-f922-4b73-baeb-be4958294c1e tempest-CreateVolumesFromSnapshotTest-1218382436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:51:04 devstack sudo[104059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:51:04 devstack sudo[104059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:04 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-3ad384d8-f922-4b73-baeb-be4958294c1e tempest-CreateVolumesFromSnapshotTest-1218382436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:51:04 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-3ad384d8-f922-4b73-baeb-be4958294c1e tempest-CreateVolumesFromSnapshotTest-1218382436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:51:04 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-3ad384d8-f922-4b73-baeb-be4958294c1e tempest-CreateVolumesFromSnapshotTest-1218382436 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:51:04 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-3ad384d8-f922-4b73-baeb-be4958294c1e tempest-CreateVolumesFromSnapshotTest-1218382436 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:51:04 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-3ad384d8-f922-4b73-baeb-be4958294c1e tempest-CreateVolumesFromSnapshotTest-1218382436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-03899a30-662b-4b1e-a40e-a8e9bb04da33 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:04 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-7349eebc-5c49-4eca-b8eb-11e0baa22a1c tempest-CreateVolumesFromSnapshotTest-1218382436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44f17800-e796-4db6-a38c-59bf0184a4c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72ca9cbf-c763-4a8f-9e33-3c060f1630c2', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:04 devstack sudo[104061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-03899a30-662b-4b1e-a40e-a8e9bb04da33 1073741824 Sep 23 14:51:04 devstack sudo[104061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:04 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-7349eebc-5c49-4eca-b8eb-11e0baa22a1c tempest-CreateVolumesFromSnapshotTest-1218382436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4108b8e9-8d54-4dc9-95f8-027bcc7f13f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:04 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-7349eebc-5c49-4eca-b8eb-11e0baa22a1c tempest-CreateVolumesFromSnapshotTest-1218382436 None] Volume volume-72ca9cbf-c763-4a8f-9e33-3c060f1630c2 (72ca9cbf-c763-4a8f-9e33-3c060f1630c2): created successfully Sep 23 14:51:04 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-7349eebc-5c49-4eca-b8eb-11e0baa22a1c tempest-CreateVolumesFromSnapshotTest-1218382436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4108b8e9-8d54-4dc9-95f8-027bcc7f13f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:04 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-7349eebc-5c49-4eca-b8eb-11e0baa22a1c tempest-CreateVolumesFromSnapshotTest-1218382436 None] Flow 'volume_create_manager' (6e5d64dc-9d99-49aa-a5d6-b48730a6449d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:51:04 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-7349eebc-5c49-4eca-b8eb-11e0baa22a1c tempest-CreateVolumesFromSnapshotTest-1218382436 None] Created volume successfully. Sep 23 14:51:04 devstack sudo[104059]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:04 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-f931d55f-1410-418d-a483-ba95b88a900d tempest-VolumeImageDependencyTests-1226023076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.377s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:04 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-f931d55f-1410-418d-a483-ba95b88a900d tempest-VolumeImageDependencyTests-1226023076 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:51:04 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-f931d55f-1410-418d-a483-ba95b88a900d tempest-VolumeImageDependencyTests-1226023076 None] Deleted volume successfully. Sep 23 14:51:04 devstack sudo[104056]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:04 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-2561bb3b-de3f-45ca-b8ca-06736b8e450e tempest-VolumeAndVolumeTypeFromImageTest-496239476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-0c358676-b7ab-4d1e-b220-44587b8a782c" returned: 0 in 0.622s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:04 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-2561bb3b-de3f-45ca-b8ca-06736b8e450e tempest-VolumeAndVolumeTypeFromImageTest-496239476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-0c358676-b7ab-4d1e-b220-44587b8a782c {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:04 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-f931d55f-1410-418d-a483-ba95b88a900d tempest-VolumeImageDependencyTests-1226023076 None] Lock "cinder-95f0a8da-3ea9-4392-ac79-0d9f8079286e-delete_volume" released by "delete_volume" :: held 1.476s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:51:04 devstack sudo[104067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-0c358676-b7ab-4d1e-b220-44587b8a782c Sep 23 14:51:04 devstack sudo[104067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:05 devstack sudo[104067]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:05 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-2561bb3b-de3f-45ca-b8ca-06736b8e450e tempest-VolumeAndVolumeTypeFromImageTest-496239476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-0c358676-b7ab-4d1e-b220-44587b8a782c" returned: 0 in 0.340s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:05 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-2561bb3b-de3f-45ca-b8ca-06736b8e450e tempest-VolumeAndVolumeTypeFromImageTest-496239476 None] Lock "cinder-quobyte-0c358676-b7ab-4d1e-b220-44587b8a782c" released by "delete_volume" :: held 1.014s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:51:05 devstack sudo[104061]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:05 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-3ad384d8-f922-4b73-baeb-be4958294c1e tempest-CreateVolumesFromSnapshotTest-1218382436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-03899a30-662b-4b1e-a40e-a8e9bb04da33 1073741824" returned: 0 in 0.782s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:05 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-2561bb3b-de3f-45ca-b8ca-06736b8e450e tempest-VolumeAndVolumeTypeFromImageTest-496239476 None] Created reservations ['4dc0ba52-0848-4092-b63e-869052ae5993', '55804c57-b03f-43f1-8a48-8e0507bf7d44', '8a8246b5-7b69-41f8-ae95-b33e0c293d07', '72d3e550-5568-4177-8303-13ea18156cf7'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:51:05 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-3ad384d8-f922-4b73-baeb-be4958294c1e tempest-CreateVolumesFromSnapshotTest-1218382436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-03899a30-662b-4b1e-a40e-a8e9bb04da33 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:05 devstack sudo[104074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-03899a30-662b-4b1e-a40e-a8e9bb04da33 Sep 23 14:51:05 devstack sudo[104074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:05 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-2561bb3b-de3f-45ca-b8ca-06736b8e450e tempest-VolumeAndVolumeTypeFromImageTest-496239476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:51:05 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-2561bb3b-de3f-45ca-b8ca-06736b8e450e tempest-VolumeAndVolumeTypeFromImageTest-496239476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:51:05 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-2561bb3b-de3f-45ca-b8ca-06736b8e450e tempest-VolumeAndVolumeTypeFromImageTest-496239476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:51:05 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-2561bb3b-de3f-45ca-b8ca-06736b8e450e tempest-VolumeAndVolumeTypeFromImageTest-496239476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:51:05 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-2561bb3b-de3f-45ca-b8ca-06736b8e450e tempest-VolumeAndVolumeTypeFromImageTest-496239476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:51:05 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-2561bb3b-de3f-45ca-b8ca-06736b8e450e tempest-VolumeAndVolumeTypeFromImageTest-496239476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:05 devstack sudo[104076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:51:05 devstack sudo[104076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:05 devstack sudo[104074]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:05 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-3ad384d8-f922-4b73-baeb-be4958294c1e tempest-CreateVolumesFromSnapshotTest-1218382436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-03899a30-662b-4b1e-a40e-a8e9bb04da33" returned: 0 in 0.311s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:05 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-3ad384d8-f922-4b73-baeb-be4958294c1e tempest-CreateVolumesFromSnapshotTest-1218382436 None] <== create_volume: return (1163ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:51:05 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-3ad384d8-f922-4b73-baeb-be4958294c1e tempest-CreateVolumesFromSnapshotTest-1218382436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.166s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:51:05 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-3ad384d8-f922-4b73-baeb-be4958294c1e tempest-CreateVolumesFromSnapshotTest-1218382436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59b140f7-5796-4158-a7c2-777f542f76dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03899a30-662b-4b1e-a40e-a8e9bb04da33', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:05 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-3ad384d8-f922-4b73-baeb-be4958294c1e tempest-CreateVolumesFromSnapshotTest-1218382436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (360ce70b-6ee6-46ec-9541-7282fe7af697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:05 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-3ad384d8-f922-4b73-baeb-be4958294c1e tempest-CreateVolumesFromSnapshotTest-1218382436 None] Volume volume-03899a30-662b-4b1e-a40e-a8e9bb04da33 (03899a30-662b-4b1e-a40e-a8e9bb04da33): created successfully Sep 23 14:51:05 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-3ad384d8-f922-4b73-baeb-be4958294c1e tempest-CreateVolumesFromSnapshotTest-1218382436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (360ce70b-6ee6-46ec-9541-7282fe7af697) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:05 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-3ad384d8-f922-4b73-baeb-be4958294c1e tempest-CreateVolumesFromSnapshotTest-1218382436 None] Flow 'volume_create_manager' (57e57946-9f20-4805-9b5c-a38cd6f2225c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:51:05 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-3ad384d8-f922-4b73-baeb-be4958294c1e tempest-CreateVolumesFromSnapshotTest-1218382436 None] Created volume successfully. Sep 23 14:51:05 devstack sudo[104076]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:05 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-2561bb3b-de3f-45ca-b8ca-06736b8e450e tempest-VolumeAndVolumeTypeFromImageTest-496239476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.444s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:05 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-2561bb3b-de3f-45ca-b8ca-06736b8e450e tempest-VolumeAndVolumeTypeFromImageTest-496239476 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:51:05 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-2561bb3b-de3f-45ca-b8ca-06736b8e450e tempest-VolumeAndVolumeTypeFromImageTest-496239476 None] Deleted volume successfully. Sep 23 14:51:05 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-2561bb3b-de3f-45ca-b8ca-06736b8e450e tempest-VolumeAndVolumeTypeFromImageTest-496239476 None] Lock "cinder-0c358676-b7ab-4d1e-b220-44587b8a782c-delete_volume" released by "delete_volume" :: held 1.772s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:51:05 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-4daf6f44-6cf1-43f2-9917-4826771f9f73 tempest-CreateVolumesFromSnapshotTest-1218382436 None] Acquiring lock "cinder-03899a30-662b-4b1e-a40e-a8e9bb04da33-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:51:05 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-4daf6f44-6cf1-43f2-9917-4826771f9f73 tempest-CreateVolumesFromSnapshotTest-1218382436 None] Lock "cinder-03899a30-662b-4b1e-a40e-a8e9bb04da33-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:51:05 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-4daf6f44-6cf1-43f2-9917-4826771f9f73 tempest-CreateVolumesFromSnapshotTest-1218382436 None] Acquiring lock "cinder-quobyte-03899a30-662b-4b1e-a40e-a8e9bb04da33" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:51:05 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-4daf6f44-6cf1-43f2-9917-4826771f9f73 tempest-CreateVolumesFromSnapshotTest-1218382436 None] Lock "cinder-quobyte-03899a30-662b-4b1e-a40e-a8e9bb04da33" acquired by "delete_volume" :: waited 0.016s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:51:06 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[09c3950c-5f91-4b4f-867f-5795f60d67ad]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:51:06 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-4daf6f44-6cf1-43f2-9917-4826771f9f73 tempest-CreateVolumesFromSnapshotTest-1218382436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-03899a30-662b-4b1e-a40e-a8e9bb04da33 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:06 devstack sudo[104080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-03899a30-662b-4b1e-a40e-a8e9bb04da33 Sep 23 14:51:06 devstack sudo[104080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:06 devstack sudo[104080]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:06 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-4daf6f44-6cf1-43f2-9917-4826771f9f73 tempest-CreateVolumesFromSnapshotTest-1218382436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-03899a30-662b-4b1e-a40e-a8e9bb04da33" returned: 0 in 0.557s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:06 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-4daf6f44-6cf1-43f2-9917-4826771f9f73 tempest-CreateVolumesFromSnapshotTest-1218382436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-03899a30-662b-4b1e-a40e-a8e9bb04da33 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:06 devstack sudo[104086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-03899a30-662b-4b1e-a40e-a8e9bb04da33 Sep 23 14:51:06 devstack sudo[104086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:06 devstack sudo[104086]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:06 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-4daf6f44-6cf1-43f2-9917-4826771f9f73 tempest-CreateVolumesFromSnapshotTest-1218382436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-03899a30-662b-4b1e-a40e-a8e9bb04da33" returned: 0 in 0.283s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:06 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-4daf6f44-6cf1-43f2-9917-4826771f9f73 tempest-CreateVolumesFromSnapshotTest-1218382436 None] Lock "cinder-quobyte-03899a30-662b-4b1e-a40e-a8e9bb04da33" released by "delete_volume" :: held 0.913s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:51:06 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-4daf6f44-6cf1-43f2-9917-4826771f9f73 tempest-CreateVolumesFromSnapshotTest-1218382436 None] Created reservations ['7eb7ed20-ab11-4973-a3f5-abda8a91ac45', '1fb5adf7-cb09-44a6-b8d3-f24436e5b4ad', '8a6867fe-98f2-4c65-a048-986fc064231a', '99458b23-e585-41cf-aa6c-79cd724bac8b'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:51:07 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-4daf6f44-6cf1-43f2-9917-4826771f9f73 tempest-CreateVolumesFromSnapshotTest-1218382436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:51:07 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-4daf6f44-6cf1-43f2-9917-4826771f9f73 tempest-CreateVolumesFromSnapshotTest-1218382436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:51:07 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-4daf6f44-6cf1-43f2-9917-4826771f9f73 tempest-CreateVolumesFromSnapshotTest-1218382436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:51:07 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-4daf6f44-6cf1-43f2-9917-4826771f9f73 tempest-CreateVolumesFromSnapshotTest-1218382436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:51:07 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-4daf6f44-6cf1-43f2-9917-4826771f9f73 tempest-CreateVolumesFromSnapshotTest-1218382436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:51:07 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-4daf6f44-6cf1-43f2-9917-4826771f9f73 tempest-CreateVolumesFromSnapshotTest-1218382436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:07 devstack sudo[104090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:51:07 devstack sudo[104090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:07 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-1bb934a5-3aa7-4033-b66b-7d95fe94350b tempest-CreateVolumesFromSnapshotTest-1218382436 None] Acquiring lock "cinder-72ca9cbf-c763-4a8f-9e33-3c060f1630c2-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:51:07 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-1bb934a5-3aa7-4033-b66b-7d95fe94350b tempest-CreateVolumesFromSnapshotTest-1218382436 None] Lock "cinder-72ca9cbf-c763-4a8f-9e33-3c060f1630c2-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:51:07 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-1bb934a5-3aa7-4033-b66b-7d95fe94350b tempest-CreateVolumesFromSnapshotTest-1218382436 None] Acquiring lock "cinder-quobyte-72ca9cbf-c763-4a8f-9e33-3c060f1630c2" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:51:07 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-1bb934a5-3aa7-4033-b66b-7d95fe94350b tempest-CreateVolumesFromSnapshotTest-1218382436 None] Lock "cinder-quobyte-72ca9cbf-c763-4a8f-9e33-3c060f1630c2" acquired by "delete_volume" :: waited 0.040s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:51:07 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bddaf5d-7134-4000-adec-d4b82885cfe0]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:51:07 devstack sudo[104090]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:07 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-1bb934a5-3aa7-4033-b66b-7d95fe94350b tempest-CreateVolumesFromSnapshotTest-1218382436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-72ca9cbf-c763-4a8f-9e33-3c060f1630c2 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:07 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-4daf6f44-6cf1-43f2-9917-4826771f9f73 tempest-CreateVolumesFromSnapshotTest-1218382436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.413s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:07 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-4daf6f44-6cf1-43f2-9917-4826771f9f73 tempest-CreateVolumesFromSnapshotTest-1218382436 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:51:07 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-4daf6f44-6cf1-43f2-9917-4826771f9f73 tempest-CreateVolumesFromSnapshotTest-1218382436 None] Deleted volume successfully. Sep 23 14:51:07 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-4daf6f44-6cf1-43f2-9917-4826771f9f73 tempest-CreateVolumesFromSnapshotTest-1218382436 None] Lock "cinder-03899a30-662b-4b1e-a40e-a8e9bb04da33-delete_volume" released by "delete_volume" :: held 1.594s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:51:07 devstack sudo[104094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-72ca9cbf-c763-4a8f-9e33-3c060f1630c2 Sep 23 14:51:07 devstack sudo[104094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:07 devstack sudo[104094]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:07 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-1bb934a5-3aa7-4033-b66b-7d95fe94350b tempest-CreateVolumesFromSnapshotTest-1218382436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-72ca9cbf-c763-4a8f-9e33-3c060f1630c2" returned: 0 in 0.492s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:07 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-1bb934a5-3aa7-4033-b66b-7d95fe94350b tempest-CreateVolumesFromSnapshotTest-1218382436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-72ca9cbf-c763-4a8f-9e33-3c060f1630c2 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:07 devstack sudo[104099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-72ca9cbf-c763-4a8f-9e33-3c060f1630c2 Sep 23 14:51:07 devstack sudo[104099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:08 devstack sudo[104099]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:08 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-1bb934a5-3aa7-4033-b66b-7d95fe94350b tempest-CreateVolumesFromSnapshotTest-1218382436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-72ca9cbf-c763-4a8f-9e33-3c060f1630c2" returned: 0 in 0.294s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:08 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-1bb934a5-3aa7-4033-b66b-7d95fe94350b tempest-CreateVolumesFromSnapshotTest-1218382436 None] Lock "cinder-quobyte-72ca9cbf-c763-4a8f-9e33-3c060f1630c2" released by "delete_volume" :: held 0.882s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:51:08 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-1bb934a5-3aa7-4033-b66b-7d95fe94350b tempest-CreateVolumesFromSnapshotTest-1218382436 None] Created reservations ['072ba9c9-2776-453b-a8c8-dc69d7a62660', '5a16455c-5868-4cb9-9e22-a0b0fb714472', '8e8195bc-a944-4ec7-a8f3-307fdeae91df', 'c0ea9950-2964-4d86-8970-ca6f22118a3d'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:51:08 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-1bb934a5-3aa7-4033-b66b-7d95fe94350b tempest-CreateVolumesFromSnapshotTest-1218382436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:51:08 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-1bb934a5-3aa7-4033-b66b-7d95fe94350b tempest-CreateVolumesFromSnapshotTest-1218382436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:51:08 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-1bb934a5-3aa7-4033-b66b-7d95fe94350b tempest-CreateVolumesFromSnapshotTest-1218382436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:51:08 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-1bb934a5-3aa7-4033-b66b-7d95fe94350b tempest-CreateVolumesFromSnapshotTest-1218382436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:51:08 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-1bb934a5-3aa7-4033-b66b-7d95fe94350b tempest-CreateVolumesFromSnapshotTest-1218382436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:51:08 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-1bb934a5-3aa7-4033-b66b-7d95fe94350b tempest-CreateVolumesFromSnapshotTest-1218382436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:08 devstack sudo[104103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:51:08 devstack sudo[104103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:08 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-1be5bfba-b98b-4b7f-9ce1-ced069a1c75c tempest-CreateVolumesFromSnapshotTest-1218382436 None] Acquiring lock "cinder-090a2019-2f89-4b0d-8fd1-94de747e1842-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:51:08 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-1be5bfba-b98b-4b7f-9ce1-ced069a1c75c tempest-CreateVolumesFromSnapshotTest-1218382436 None] Lock "cinder-090a2019-2f89-4b0d-8fd1-94de747e1842-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:51:08 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-1be5bfba-b98b-4b7f-9ce1-ced069a1c75c tempest-CreateVolumesFromSnapshotTest-1218382436 None] Acquiring lock "cinder-quobyte-090a2019-2f89-4b0d-8fd1-94de747e1842" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:51:08 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-1be5bfba-b98b-4b7f-9ce1-ced069a1c75c tempest-CreateVolumesFromSnapshotTest-1218382436 None] Lock "cinder-quobyte-090a2019-2f89-4b0d-8fd1-94de747e1842" acquired by "delete_volume" :: waited 0.020s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:51:08 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aa3aa28-4096-42e7-9792-d751e91c8795]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:51:08 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-1be5bfba-b98b-4b7f-9ce1-ced069a1c75c tempest-CreateVolumesFromSnapshotTest-1218382436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-090a2019-2f89-4b0d-8fd1-94de747e1842 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:08 devstack sudo[104103]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:08 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-1bb934a5-3aa7-4033-b66b-7d95fe94350b tempest-CreateVolumesFromSnapshotTest-1218382436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.357s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:08 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-1bb934a5-3aa7-4033-b66b-7d95fe94350b tempest-CreateVolumesFromSnapshotTest-1218382436 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:51:08 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-1bb934a5-3aa7-4033-b66b-7d95fe94350b tempest-CreateVolumesFromSnapshotTest-1218382436 None] Deleted volume successfully. Sep 23 14:51:08 devstack sudo[104106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-090a2019-2f89-4b0d-8fd1-94de747e1842 Sep 23 14:51:08 devstack sudo[104106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:08 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-1bb934a5-3aa7-4033-b66b-7d95fe94350b tempest-CreateVolumesFromSnapshotTest-1218382436 None] Lock "cinder-72ca9cbf-c763-4a8f-9e33-3c060f1630c2-delete_volume" released by "delete_volume" :: held 1.739s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:51:09 devstack sudo[104106]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:09 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-1be5bfba-b98b-4b7f-9ce1-ced069a1c75c tempest-CreateVolumesFromSnapshotTest-1218382436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-090a2019-2f89-4b0d-8fd1-94de747e1842" returned: 0 in 0.540s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:09 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-1be5bfba-b98b-4b7f-9ce1-ced069a1c75c tempest-CreateVolumesFromSnapshotTest-1218382436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-090a2019-2f89-4b0d-8fd1-94de747e1842 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:09 devstack sudo[104111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-090a2019-2f89-4b0d-8fd1-94de747e1842 Sep 23 14:51:09 devstack sudo[104111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:09 devstack sudo[104111]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:09 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-1be5bfba-b98b-4b7f-9ce1-ced069a1c75c tempest-CreateVolumesFromSnapshotTest-1218382436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-090a2019-2f89-4b0d-8fd1-94de747e1842" returned: 0 in 0.412s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:09 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-1be5bfba-b98b-4b7f-9ce1-ced069a1c75c tempest-CreateVolumesFromSnapshotTest-1218382436 None] Lock "cinder-quobyte-090a2019-2f89-4b0d-8fd1-94de747e1842" released by "delete_volume" :: held 1.021s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:51:09 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-1be5bfba-b98b-4b7f-9ce1-ced069a1c75c tempest-CreateVolumesFromSnapshotTest-1218382436 None] Created reservations ['50d2122b-6de7-4532-bc63-bd446cc317ab', 'b33c5d18-2d0b-4bab-bc57-f7d39bc779d4', '98d6f70c-10f5-4db8-87c7-a73e453d243c', '37d6d56b-eb58-4d39-92b9-499d17d3c834'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:51:09 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-1be5bfba-b98b-4b7f-9ce1-ced069a1c75c tempest-CreateVolumesFromSnapshotTest-1218382436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:51:09 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-1be5bfba-b98b-4b7f-9ce1-ced069a1c75c tempest-CreateVolumesFromSnapshotTest-1218382436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:51:09 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-1be5bfba-b98b-4b7f-9ce1-ced069a1c75c tempest-CreateVolumesFromSnapshotTest-1218382436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:51:09 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-1be5bfba-b98b-4b7f-9ce1-ced069a1c75c tempest-CreateVolumesFromSnapshotTest-1218382436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:51:09 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-1be5bfba-b98b-4b7f-9ce1-ced069a1c75c tempest-CreateVolumesFromSnapshotTest-1218382436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:51:09 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-1be5bfba-b98b-4b7f-9ce1-ced069a1c75c tempest-CreateVolumesFromSnapshotTest-1218382436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:09 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-392df1a6-0793-4313-9353-a59a14b66585 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:51:09 devstack sudo[104114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:51:09 devstack sudo[104114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:09 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-392df1a6-0793-4313-9353-a59a14b66585 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Flow 'volume_create_manager' (9517634f-89e4-48a6-8a68-75b79b22ae83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:51:09 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-392df1a6-0793-4313-9353-a59a14b66585 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (208f5fd0-81d3-4e5c-995d-1d7cac258a32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:09 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-392df1a6-0793-4313-9353-a59a14b66585 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (208f5fd0-81d3-4e5c-995d-1d7cac258a32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:51:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2055502336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df7c00c6-4ce8-409a-abd8-ddd86bef7bfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='650af342b2c0470bbd578c1e20620a1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:51:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:51:10Z,use_quota=True,user_id='ed73f027af20494ba732b573354a9289',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:09 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-392df1a6-0793-4313-9353-a59a14b66585 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00fb09b3-3cf3-426e-83b0-5f98529e41b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:09 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-392df1a6-0793-4313-9353-a59a14b66585 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00fb09b3-3cf3-426e-83b0-5f98529e41b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:09 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-392df1a6-0793-4313-9353-a59a14b66585 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00e744e3-fc1a-48f5-a8fd-e739f92cbfc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:09 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-392df1a6-0793-4313-9353-a59a14b66585 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00e744e3-fc1a-48f5-a8fd-e739f92cbfc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df7c00c6-4ce8-409a-abd8-ddd86bef7bfb', 'volume_name': 'volume-df7c00c6-4ce8-409a-abd8-ddd86bef7bfb', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:09 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-392df1a6-0793-4313-9353-a59a14b66585 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e848a9f9-3a92-4b2b-81c0-9dea312c13a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:09 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-392df1a6-0793-4313-9353-a59a14b66585 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e848a9f9-3a92-4b2b-81c0-9dea312c13a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:09 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-392df1a6-0793-4313-9353-a59a14b66585 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f7f586b-dbb6-4997-a33a-5bb4607ffb81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:09 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-392df1a6-0793-4313-9353-a59a14b66585 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Volume df7c00c6-4ce8-409a-abd8-ddd86bef7bfb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df7c00c6-4ce8-409a-abd8-ddd86bef7bfb', 'volume_size': 1} Sep 23 14:51:09 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-392df1a6-0793-4313-9353-a59a14b66585 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:51:09 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-392df1a6-0793-4313-9353-a59a14b66585 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:51:09 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-392df1a6-0793-4313-9353-a59a14b66585 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:51:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2055502336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df7c00c6-4ce8-409a-abd8-ddd86bef7bfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='650af342b2c0470bbd578c1e20620a1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:51:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:51:10Z,use_quota=True,user_id='ed73f027af20494ba732b573354a9289',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:51:09 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-392df1a6-0793-4313-9353-a59a14b66585 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Creating volume df7c00c6-4ce8-409a-abd8-ddd86bef7bfb {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:51:09 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-392df1a6-0793-4313-9353-a59a14b66585 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:51:09 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-392df1a6-0793-4313-9353-a59a14b66585 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:51:09 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-392df1a6-0793-4313-9353-a59a14b66585 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:51:09 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-392df1a6-0793-4313-9353-a59a14b66585 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:51:10 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-392df1a6-0793-4313-9353-a59a14b66585 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:51:10 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-392df1a6-0793-4313-9353-a59a14b66585 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:51:10 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-392df1a6-0793-4313-9353-a59a14b66585 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:51:10 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-392df1a6-0793-4313-9353-a59a14b66585 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-df7c00c6-4ce8-409a-abd8-ddd86bef7bfb 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:10 devstack sudo[104116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-df7c00c6-4ce8-409a-abd8-ddd86bef7bfb 1073741824 Sep 23 14:51:10 devstack sudo[104116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:10 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a8fb108-b8d2-43d0-8444-863052fbb155 tempest-CinderUnicodeTest-1321322603 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:51:10 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-3a8fb108-b8d2-43d0-8444-863052fbb155 tempest-CinderUnicodeTest-1321322603 None] Flow 'volume_create_manager' (16fcf439-6757-4e7e-abc3-8befff1f7b78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:51:10 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-3a8fb108-b8d2-43d0-8444-863052fbb155 tempest-CinderUnicodeTest-1321322603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b200e02-b27c-4548-9c4e-5cc20cf42b24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:10 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-3a8fb108-b8d2-43d0-8444-863052fbb155 tempest-CinderUnicodeTest-1321322603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b200e02-b27c-4548-9c4e-5cc20cf42b24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:51:09Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f15b442-c08a-4e56-8ba3-4ad44a52cd8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='881fdfae936346fa91fe5d01a82b099e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:51:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:51:10Z,use_quota=True,user_id='2bcce21fcd51484699fdddfb6ad5f40c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:10 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-3a8fb108-b8d2-43d0-8444-863052fbb155 tempest-CinderUnicodeTest-1321322603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc73f264-f7cb-47c6-a34e-c70d447c5099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:10 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-3a8fb108-b8d2-43d0-8444-863052fbb155 tempest-CinderUnicodeTest-1321322603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc73f264-f7cb-47c6-a34e-c70d447c5099) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:10 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-3a8fb108-b8d2-43d0-8444-863052fbb155 tempest-CinderUnicodeTest-1321322603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dfb8e46-d839-457c-bb35-809691f32478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:10 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-3a8fb108-b8d2-43d0-8444-863052fbb155 tempest-CinderUnicodeTest-1321322603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dfb8e46-d839-457c-bb35-809691f32478) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f15b442-c08a-4e56-8ba3-4ad44a52cd8b', 'volume_name': 'volume-3f15b442-c08a-4e56-8ba3-4ad44a52cd8b', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:10 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-3a8fb108-b8d2-43d0-8444-863052fbb155 tempest-CinderUnicodeTest-1321322603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90b386e6-df78-43b5-a650-e430a4b71b72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:10 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-3a8fb108-b8d2-43d0-8444-863052fbb155 tempest-CinderUnicodeTest-1321322603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90b386e6-df78-43b5-a650-e430a4b71b72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:10 devstack sudo[104114]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:10 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-3a8fb108-b8d2-43d0-8444-863052fbb155 tempest-CinderUnicodeTest-1321322603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00dfe7a8-8a5d-47d7-be86-1232b096eca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:10 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-3a8fb108-b8d2-43d0-8444-863052fbb155 tempest-CinderUnicodeTest-1321322603 None] Volume 3f15b442-c08a-4e56-8ba3-4ad44a52cd8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f15b442-c08a-4e56-8ba3-4ad44a52cd8b', 'volume_size': 1} Sep 23 14:51:10 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-3a8fb108-b8d2-43d0-8444-863052fbb155 tempest-CinderUnicodeTest-1321322603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:51:10 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-1be5bfba-b98b-4b7f-9ce1-ced069a1c75c tempest-CreateVolumesFromSnapshotTest-1218382436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.391s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:10 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-1be5bfba-b98b-4b7f-9ce1-ced069a1c75c tempest-CreateVolumesFromSnapshotTest-1218382436 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:51:10 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-1be5bfba-b98b-4b7f-9ce1-ced069a1c75c tempest-CreateVolumesFromSnapshotTest-1218382436 None] Deleted volume successfully. Sep 23 14:51:10 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-1be5bfba-b98b-4b7f-9ce1-ced069a1c75c tempest-CreateVolumesFromSnapshotTest-1218382436 None] Lock "cinder-090a2019-2f89-4b0d-8fd1-94de747e1842-delete_volume" released by "delete_volume" :: held 1.701s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:51:10 devstack sudo[104116]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:10 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-392df1a6-0793-4313-9353-a59a14b66585 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-df7c00c6-4ce8-409a-abd8-ddd86bef7bfb 1073741824" returned: 0 in 0.545s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:10 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-392df1a6-0793-4313-9353-a59a14b66585 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-df7c00c6-4ce8-409a-abd8-ddd86bef7bfb {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:10 devstack sudo[104123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-df7c00c6-4ce8-409a-abd8-ddd86bef7bfb Sep 23 14:51:10 devstack sudo[104123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:10 devstack sudo[104123]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:10 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-1c484338-83f5-42c6-922a-5a00d41cc3b8 tempest-CreateVolumesFromSnapshotTest-1218382436 None] Acquiring lock "cinder-ab2afe57-c4c8-4903-939b-f212406f686f-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:51:10 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-392df1a6-0793-4313-9353-a59a14b66585 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-df7c00c6-4ce8-409a-abd8-ddd86bef7bfb" returned: 0 in 0.289s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:10 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-392df1a6-0793-4313-9353-a59a14b66585 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:51:10 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-392df1a6-0793-4313-9353-a59a14b66585 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:51:10 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-3a8fb108-b8d2-43d0-8444-863052fbb155 tempest-CinderUnicodeTest-1321322603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.647s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:51:10 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-3a8fb108-b8d2-43d0-8444-863052fbb155 tempest-CinderUnicodeTest-1321322603 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:51:09Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f15b442-c08a-4e56-8ba3-4ad44a52cd8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='881fdfae936346fa91fe5d01a82b099e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:51:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:51:10Z,use_quota=True,user_id='2bcce21fcd51484699fdddfb6ad5f40c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:51:10 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-3a8fb108-b8d2-43d0-8444-863052fbb155 tempest-CinderUnicodeTest-1321322603 None] Creating volume 3f15b442-c08a-4e56-8ba3-4ad44a52cd8b {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:51:10 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-3a8fb108-b8d2-43d0-8444-863052fbb155 tempest-CinderUnicodeTest-1321322603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:51:10 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-3a8fb108-b8d2-43d0-8444-863052fbb155 tempest-CinderUnicodeTest-1321322603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:51:10 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-3a8fb108-b8d2-43d0-8444-863052fbb155 tempest-CinderUnicodeTest-1321322603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:51:10 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-3a8fb108-b8d2-43d0-8444-863052fbb155 tempest-CinderUnicodeTest-1321322603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:51:10 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-3a8fb108-b8d2-43d0-8444-863052fbb155 tempest-CinderUnicodeTest-1321322603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:51:10 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-3a8fb108-b8d2-43d0-8444-863052fbb155 tempest-CinderUnicodeTest-1321322603 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:51:10 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-3a8fb108-b8d2-43d0-8444-863052fbb155 tempest-CinderUnicodeTest-1321322603 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:51:10 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-3a8fb108-b8d2-43d0-8444-863052fbb155 tempest-CinderUnicodeTest-1321322603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-3f15b442-c08a-4e56-8ba3-4ad44a52cd8b 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:10 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-1c484338-83f5-42c6-922a-5a00d41cc3b8 tempest-CreateVolumesFromSnapshotTest-1218382436 None] Lock "cinder-ab2afe57-c4c8-4903-939b-f212406f686f-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:51:10 devstack sudo[104128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-3f15b442-c08a-4e56-8ba3-4ad44a52cd8b 1073741824 Sep 23 14:51:10 devstack sudo[104128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:10 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-392df1a6-0793-4313-9353-a59a14b66585 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f7f586b-dbb6-4997-a33a-5bb4607ffb81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df7c00c6-4ce8-409a-abd8-ddd86bef7bfb', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:10 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-392df1a6-0793-4313-9353-a59a14b66585 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20a698b5-754e-4574-a5d8-cf0c741bcf9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:10 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-392df1a6-0793-4313-9353-a59a14b66585 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Volume volume-df7c00c6-4ce8-409a-abd8-ddd86bef7bfb (df7c00c6-4ce8-409a-abd8-ddd86bef7bfb): created successfully Sep 23 14:51:10 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-392df1a6-0793-4313-9353-a59a14b66585 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20a698b5-754e-4574-a5d8-cf0c741bcf9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:10 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-392df1a6-0793-4313-9353-a59a14b66585 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Flow 'volume_create_manager' (9517634f-89e4-48a6-8a68-75b79b22ae83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:51:11 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-392df1a6-0793-4313-9353-a59a14b66585 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Created volume successfully. Sep 23 14:51:11 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-1c484338-83f5-42c6-922a-5a00d41cc3b8 tempest-CreateVolumesFromSnapshotTest-1218382436 None] Acquiring lock "cinder-quobyte-ab2afe57-c4c8-4903-939b-f212406f686f" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:51:11 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-1c484338-83f5-42c6-922a-5a00d41cc3b8 tempest-CreateVolumesFromSnapshotTest-1218382436 None] Lock "cinder-quobyte-ab2afe57-c4c8-4903-939b-f212406f686f" acquired by "delete_volume" :: waited 0.026s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:51:11 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[28003770-8e25-48e6-a5d6-770949e7d759]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:51:11 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-1c484338-83f5-42c6-922a-5a00d41cc3b8 tempest-CreateVolumesFromSnapshotTest-1218382436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-ab2afe57-c4c8-4903-939b-f212406f686f {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:11 devstack sudo[104130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-ab2afe57-c4c8-4903-939b-f212406f686f Sep 23 14:51:11 devstack sudo[104130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:11 devstack sudo[104128]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:11 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-3a8fb108-b8d2-43d0-8444-863052fbb155 tempest-CinderUnicodeTest-1321322603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-3f15b442-c08a-4e56-8ba3-4ad44a52cd8b 1073741824" returned: 0 in 0.532s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:11 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-3a8fb108-b8d2-43d0-8444-863052fbb155 tempest-CinderUnicodeTest-1321322603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-3f15b442-c08a-4e56-8ba3-4ad44a52cd8b {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:11 devstack sudo[104130]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:11 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-1c484338-83f5-42c6-922a-5a00d41cc3b8 tempest-CreateVolumesFromSnapshotTest-1218382436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-ab2afe57-c4c8-4903-939b-f212406f686f" returned: 0 in 0.423s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:11 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-1c484338-83f5-42c6-922a-5a00d41cc3b8 tempest-CreateVolumesFromSnapshotTest-1218382436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-ab2afe57-c4c8-4903-939b-f212406f686f {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:11 devstack sudo[104140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-3f15b442-c08a-4e56-8ba3-4ad44a52cd8b Sep 23 14:51:11 devstack sudo[104140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:11 devstack sudo[104142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-ab2afe57-c4c8-4903-939b-f212406f686f Sep 23 14:51:11 devstack sudo[104142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:11 devstack sudo[104140]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:11 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-3a8fb108-b8d2-43d0-8444-863052fbb155 tempest-CinderUnicodeTest-1321322603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-3f15b442-c08a-4e56-8ba3-4ad44a52cd8b" returned: 0 in 0.327s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:11 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-3a8fb108-b8d2-43d0-8444-863052fbb155 tempest-CinderUnicodeTest-1321322603 None] <== create_volume: return (917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:51:11 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-3a8fb108-b8d2-43d0-8444-863052fbb155 tempest-CinderUnicodeTest-1321322603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:51:11 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-3a8fb108-b8d2-43d0-8444-863052fbb155 tempest-CinderUnicodeTest-1321322603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00dfe7a8-8a5d-47d7-be86-1232b096eca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f15b442-c08a-4e56-8ba3-4ad44a52cd8b', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:11 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-3a8fb108-b8d2-43d0-8444-863052fbb155 tempest-CinderUnicodeTest-1321322603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b596389-5e94-42a8-85e3-6d0902a006cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:11 devstack sudo[104142]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:11 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-1c484338-83f5-42c6-922a-5a00d41cc3b8 tempest-CreateVolumesFromSnapshotTest-1218382436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-ab2afe57-c4c8-4903-939b-f212406f686f" returned: 0 in 0.342s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:11 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-1c484338-83f5-42c6-922a-5a00d41cc3b8 tempest-CreateVolumesFromSnapshotTest-1218382436 None] Lock "cinder-quobyte-ab2afe57-c4c8-4903-939b-f212406f686f" released by "delete_volume" :: held 0.834s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:51:11 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-3a8fb108-b8d2-43d0-8444-863052fbb155 tempest-CinderUnicodeTest-1321322603 None] Volume volume-3f15b442-c08a-4e56-8ba3-4ad44a52cd8b (3f15b442-c08a-4e56-8ba3-4ad44a52cd8b): created successfully Sep 23 14:51:11 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-3a8fb108-b8d2-43d0-8444-863052fbb155 tempest-CinderUnicodeTest-1321322603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b596389-5e94-42a8-85e3-6d0902a006cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:11 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-3a8fb108-b8d2-43d0-8444-863052fbb155 tempest-CinderUnicodeTest-1321322603 None] Flow 'volume_create_manager' (16fcf439-6757-4e7e-abc3-8befff1f7b78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:51:11 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-3a8fb108-b8d2-43d0-8444-863052fbb155 tempest-CinderUnicodeTest-1321322603 None] Created volume successfully. Sep 23 14:51:11 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-1c484338-83f5-42c6-922a-5a00d41cc3b8 tempest-CreateVolumesFromSnapshotTest-1218382436 None] Created reservations ['fbe8620a-aea6-4305-b298-fa64e7c4ac50', '58711c8b-5c34-4d6d-81a1-08579c701c38', '7902f833-6e25-4510-a68a-6c307072a408', '583dcd59-5d92-43bf-b6cd-f2ff6569e423'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:51:12 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-1c484338-83f5-42c6-922a-5a00d41cc3b8 tempest-CreateVolumesFromSnapshotTest-1218382436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:51:12 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-1c484338-83f5-42c6-922a-5a00d41cc3b8 tempest-CreateVolumesFromSnapshotTest-1218382436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:51:12 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-1c484338-83f5-42c6-922a-5a00d41cc3b8 tempest-CreateVolumesFromSnapshotTest-1218382436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:51:12 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-1c484338-83f5-42c6-922a-5a00d41cc3b8 tempest-CreateVolumesFromSnapshotTest-1218382436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:51:12 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-1c484338-83f5-42c6-922a-5a00d41cc3b8 tempest-CreateVolumesFromSnapshotTest-1218382436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:51:12 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-1c484338-83f5-42c6-922a-5a00d41cc3b8 tempest-CreateVolumesFromSnapshotTest-1218382436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:12 devstack sudo[104146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:51:12 devstack sudo[104146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:12 devstack sudo[104146]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:12 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-1c484338-83f5-42c6-922a-5a00d41cc3b8 tempest-CreateVolumesFromSnapshotTest-1218382436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.331s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:12 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-1c484338-83f5-42c6-922a-5a00d41cc3b8 tempest-CreateVolumesFromSnapshotTest-1218382436 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:51:12 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-1c484338-83f5-42c6-922a-5a00d41cc3b8 tempest-CreateVolumesFromSnapshotTest-1218382436 None] Deleted volume successfully. Sep 23 14:51:12 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-1c484338-83f5-42c6-922a-5a00d41cc3b8 tempest-CreateVolumesFromSnapshotTest-1218382436 None] Lock "cinder-ab2afe57-c4c8-4903-939b-f212406f686f-delete_volume" released by "delete_volume" :: held 1.504s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:51:12 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-eebd100b-26fd-4fbb-89bc-b3a626c069e5 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:51:12 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-eebd100b-26fd-4fbb-89bc-b3a626c069e5 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Flow 'volume_create_manager' (1c31b57c-5382-4178-9f75-79ad9cd04fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:51:12 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-eebd100b-26fd-4fbb-89bc-b3a626c069e5 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8843d18d-6a6c-455e-b417-e9f6910e4536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:12 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-eebd100b-26fd-4fbb-89bc-b3a626c069e5 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8843d18d-6a6c-455e-b417-e9f6910e4536) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:51:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-741567139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfb0a89e-bcc9-4028-8cea-205c5945260d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='650af342b2c0470bbd578c1e20620a1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:51:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:51:12Z,use_quota=True,user_id='ed73f027af20494ba732b573354a9289',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:12 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-eebd100b-26fd-4fbb-89bc-b3a626c069e5 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c914d1ee-6367-41d9-95ed-9e47cc9dd27c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:12 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-eebd100b-26fd-4fbb-89bc-b3a626c069e5 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c914d1ee-6367-41d9-95ed-9e47cc9dd27c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:12 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-eebd100b-26fd-4fbb-89bc-b3a626c069e5 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b810688-c32f-4d30-b949-dcef8735dcc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:12 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-eebd100b-26fd-4fbb-89bc-b3a626c069e5 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b810688-c32f-4d30-b949-dcef8735dcc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bfb0a89e-bcc9-4028-8cea-205c5945260d', 'volume_name': 'volume-bfb0a89e-bcc9-4028-8cea-205c5945260d', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:12 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-eebd100b-26fd-4fbb-89bc-b3a626c069e5 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5846c8a3-cab6-4a62-b42a-fde542982c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:12 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-eebd100b-26fd-4fbb-89bc-b3a626c069e5 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5846c8a3-cab6-4a62-b42a-fde542982c46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:12 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-eebd100b-26fd-4fbb-89bc-b3a626c069e5 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (165f7b60-3415-41f9-ac6e-73934167e2dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:12 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-eebd100b-26fd-4fbb-89bc-b3a626c069e5 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Volume bfb0a89e-bcc9-4028-8cea-205c5945260d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bfb0a89e-bcc9-4028-8cea-205c5945260d', 'volume_size': 1} Sep 23 14:51:12 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-eebd100b-26fd-4fbb-89bc-b3a626c069e5 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:51:12 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-eebd100b-26fd-4fbb-89bc-b3a626c069e5 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:51:12 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-eebd100b-26fd-4fbb-89bc-b3a626c069e5 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:51:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-741567139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfb0a89e-bcc9-4028-8cea-205c5945260d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='650af342b2c0470bbd578c1e20620a1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:51:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:51:12Z,use_quota=True,user_id='ed73f027af20494ba732b573354a9289',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:51:12 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-eebd100b-26fd-4fbb-89bc-b3a626c069e5 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Creating volume bfb0a89e-bcc9-4028-8cea-205c5945260d {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:51:12 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-eebd100b-26fd-4fbb-89bc-b3a626c069e5 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:51:12 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-eebd100b-26fd-4fbb-89bc-b3a626c069e5 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:51:12 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-eebd100b-26fd-4fbb-89bc-b3a626c069e5 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:51:12 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-eebd100b-26fd-4fbb-89bc-b3a626c069e5 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:51:12 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-eebd100b-26fd-4fbb-89bc-b3a626c069e5 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:51:12 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-eebd100b-26fd-4fbb-89bc-b3a626c069e5 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:51:12 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-eebd100b-26fd-4fbb-89bc-b3a626c069e5 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:51:12 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-eebd100b-26fd-4fbb-89bc-b3a626c069e5 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bfb0a89e-bcc9-4028-8cea-205c5945260d 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:12 devstack sudo[104149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bfb0a89e-bcc9-4028-8cea-205c5945260d 1073741824 Sep 23 14:51:12 devstack sudo[104149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:12 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-34af6f50-8a21-42c4-b82a-1d28189d663f tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:51:12 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-34af6f50-8a21-42c4-b82a-1d28189d663f tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Flow 'volume_create_manager' (7345dd62-9246-45a2-849c-304a4fad5685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:51:12 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-34af6f50-8a21-42c4-b82a-1d28189d663f tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b05a6e2-09fd-42a7-bfe2-c80a280cd533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:12 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-34af6f50-8a21-42c4-b82a-1d28189d663f tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b05a6e2-09fd-42a7-bfe2-c80a280cd533) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:51:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-446834303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7159b520-d496-429f-b4ad-104765980edb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='650af342b2c0470bbd578c1e20620a1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:51:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:51:13Z,use_quota=True,user_id='ed73f027af20494ba732b573354a9289',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:12 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-34af6f50-8a21-42c4-b82a-1d28189d663f tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdcbe119-8cff-4892-abad-8f15682e9dd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:12 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-34af6f50-8a21-42c4-b82a-1d28189d663f tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdcbe119-8cff-4892-abad-8f15682e9dd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:12 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-34af6f50-8a21-42c4-b82a-1d28189d663f tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9be09c43-349c-436e-a107-7cbfbd9facaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:12 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-34af6f50-8a21-42c4-b82a-1d28189d663f tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9be09c43-349c-436e-a107-7cbfbd9facaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7159b520-d496-429f-b4ad-104765980edb', 'volume_name': 'volume-7159b520-d496-429f-b4ad-104765980edb', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:12 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-34af6f50-8a21-42c4-b82a-1d28189d663f tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9650102a-76b6-4aae-b63b-31b769457d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:12 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-34af6f50-8a21-42c4-b82a-1d28189d663f tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9650102a-76b6-4aae-b63b-31b769457d9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:12 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-34af6f50-8a21-42c4-b82a-1d28189d663f tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61bbed51-25fa-46e1-9c35-5f32836e8681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:12 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-34af6f50-8a21-42c4-b82a-1d28189d663f tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Volume 7159b520-d496-429f-b4ad-104765980edb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7159b520-d496-429f-b4ad-104765980edb', 'volume_size': 1} Sep 23 14:51:12 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-34af6f50-8a21-42c4-b82a-1d28189d663f tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:51:13 devstack sudo[104149]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:13 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-eebd100b-26fd-4fbb-89bc-b3a626c069e5 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bfb0a89e-bcc9-4028-8cea-205c5945260d 1073741824" returned: 0 in 0.654s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:13 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-eebd100b-26fd-4fbb-89bc-b3a626c069e5 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bfb0a89e-bcc9-4028-8cea-205c5945260d {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:13 devstack sudo[104156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bfb0a89e-bcc9-4028-8cea-205c5945260d Sep 23 14:51:13 devstack sudo[104156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:13 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-e184dac8-27bc-4c32-b4be-467ca2d9997c tempest-CreateVolumesFromSnapshotTest-1218382436 None] Acquiring lock "cinder-2ebc4750-29cf-4ab4-8dca-e5e9692faef0-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:51:13 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-e184dac8-27bc-4c32-b4be-467ca2d9997c tempest-CreateVolumesFromSnapshotTest-1218382436 None] Lock "cinder-2ebc4750-29cf-4ab4-8dca-e5e9692faef0-delete_volume" acquired by "delete_volume" :: waited 0.081s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:51:13 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed421c96-1732-49ba-965d-664522718d39 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:51:13 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-ed421c96-1732-49ba-965d-664522718d39 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Flow 'volume_create_manager' (a70656fd-5182-4520-8fa3-f542d4140cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:51:13 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-ed421c96-1732-49ba-965d-664522718d39 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6b3b0e6-ca40-4d85-9e0e-729c43ddafc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:13 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-e184dac8-27bc-4c32-b4be-467ca2d9997c tempest-CreateVolumesFromSnapshotTest-1218382436 None] Acquiring lock "cinder-quobyte-2ebc4750-29cf-4ab4-8dca-e5e9692faef0" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:51:13 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-ed421c96-1732-49ba-965d-664522718d39 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6b3b0e6-ca40-4d85-9e0e-729c43ddafc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:51:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1331145952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44506418-87c5-4786-b2df-89b8e94aba18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='650af342b2c0470bbd578c1e20620a1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:51:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:51:13Z,use_quota=True,user_id='ed73f027af20494ba732b573354a9289',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:13 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-ed421c96-1732-49ba-965d-664522718d39 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d5306d1-77fb-457f-a91a-ec9cd2ba2f9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:13 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-ed421c96-1732-49ba-965d-664522718d39 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d5306d1-77fb-457f-a91a-ec9cd2ba2f9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:13 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-ed421c96-1732-49ba-965d-664522718d39 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1224636a-d8fd-4d29-abc6-75e73fa8a74d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:13 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-ed421c96-1732-49ba-965d-664522718d39 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1224636a-d8fd-4d29-abc6-75e73fa8a74d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44506418-87c5-4786-b2df-89b8e94aba18', 'volume_name': 'volume-44506418-87c5-4786-b2df-89b8e94aba18', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:13 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-ed421c96-1732-49ba-965d-664522718d39 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5928dec7-9654-4804-811e-358d23feb283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:13 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-ed421c96-1732-49ba-965d-664522718d39 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5928dec7-9654-4804-811e-358d23feb283) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:13 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-ed421c96-1732-49ba-965d-664522718d39 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c10f2f2-2963-467e-bfb9-bac5502a804d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:13 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-ed421c96-1732-49ba-965d-664522718d39 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Volume 44506418-87c5-4786-b2df-89b8e94aba18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44506418-87c5-4786-b2df-89b8e94aba18', 'volume_size': 1} Sep 23 14:51:13 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-ed421c96-1732-49ba-965d-664522718d39 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:51:13 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-e184dac8-27bc-4c32-b4be-467ca2d9997c tempest-CreateVolumesFromSnapshotTest-1218382436 None] Lock "cinder-quobyte-2ebc4750-29cf-4ab4-8dca-e5e9692faef0" acquired by "delete_volume" :: waited 0.080s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:51:13 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[1744ff69-270f-4fa9-950d-fa555a1cc823]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:51:13 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-e184dac8-27bc-4c32-b4be-467ca2d9997c tempest-CreateVolumesFromSnapshotTest-1218382436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2ebc4750-29cf-4ab4-8dca-e5e9692faef0 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:13 devstack sudo[104156]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:13 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-eebd100b-26fd-4fbb-89bc-b3a626c069e5 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bfb0a89e-bcc9-4028-8cea-205c5945260d" returned: 0 in 0.448s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:13 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-eebd100b-26fd-4fbb-89bc-b3a626c069e5 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] <== create_volume: return (1164ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:51:13 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-eebd100b-26fd-4fbb-89bc-b3a626c069e5 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.168s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:51:13 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-34af6f50-8a21-42c4-b82a-1d28189d663f tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.769s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:51:13 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-34af6f50-8a21-42c4-b82a-1d28189d663f tempest-CreateVolumesFromSourceVolumeTest-702571909 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:51:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-446834303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7159b520-d496-429f-b4ad-104765980edb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='650af342b2c0470bbd578c1e20620a1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:51:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:51:13Z,use_quota=True,user_id='ed73f027af20494ba732b573354a9289',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:51:13 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-34af6f50-8a21-42c4-b82a-1d28189d663f tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Creating volume 7159b520-d496-429f-b4ad-104765980edb {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:51:13 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-34af6f50-8a21-42c4-b82a-1d28189d663f tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:51:13 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-34af6f50-8a21-42c4-b82a-1d28189d663f tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:51:13 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-34af6f50-8a21-42c4-b82a-1d28189d663f tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:51:13 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-34af6f50-8a21-42c4-b82a-1d28189d663f tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:51:13 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-34af6f50-8a21-42c4-b82a-1d28189d663f tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:51:13 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-34af6f50-8a21-42c4-b82a-1d28189d663f tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:51:13 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-34af6f50-8a21-42c4-b82a-1d28189d663f tempest-CreateVolumesFromSourceVolumeTest-702571909 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:51:13 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-34af6f50-8a21-42c4-b82a-1d28189d663f tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7159b520-d496-429f-b4ad-104765980edb 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:13 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-eebd100b-26fd-4fbb-89bc-b3a626c069e5 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (165f7b60-3415-41f9-ac6e-73934167e2dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bfb0a89e-bcc9-4028-8cea-205c5945260d', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:13 devstack sudo[104160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7159b520-d496-429f-b4ad-104765980edb 1073741824 Sep 23 14:51:13 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-eebd100b-26fd-4fbb-89bc-b3a626c069e5 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46a06bd5-0840-45b8-8dc4-341fbb8004aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:13 devstack sudo[104160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:13 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-eebd100b-26fd-4fbb-89bc-b3a626c069e5 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Volume volume-bfb0a89e-bcc9-4028-8cea-205c5945260d (bfb0a89e-bcc9-4028-8cea-205c5945260d): created successfully Sep 23 14:51:13 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-eebd100b-26fd-4fbb-89bc-b3a626c069e5 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46a06bd5-0840-45b8-8dc4-341fbb8004aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:13 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-eebd100b-26fd-4fbb-89bc-b3a626c069e5 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Flow 'volume_create_manager' (1c31b57c-5382-4178-9f75-79ad9cd04fa6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:51:13 devstack sudo[104159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2ebc4750-29cf-4ab4-8dca-e5e9692faef0 Sep 23 14:51:13 devstack sudo[104159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:13 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-eebd100b-26fd-4fbb-89bc-b3a626c069e5 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Created volume successfully. Sep 23 14:51:14 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-9335e2dd-52b8-4e17-aa48-b86db48fbe3d tempest-ProjectReaderTests-1422491147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:51:14 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-9335e2dd-52b8-4e17-aa48-b86db48fbe3d tempest-ProjectReaderTests-1422491147 None] Flow 'volume_create_manager' (fb6d5a7d-ac76-4e26-8d02-1b56f7c4ac71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:51:14 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-9335e2dd-52b8-4e17-aa48-b86db48fbe3d tempest-ProjectReaderTests-1422491147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e39c94a5-3808-4d8e-9dd5-f06297f9befe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:14 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-9335e2dd-52b8-4e17-aa48-b86db48fbe3d tempest-ProjectReaderTests-1422491147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e39c94a5-3808-4d8e-9dd5-f06297f9befe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:51:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1018535761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fad7cbe3-54b6-480c-90e1-2a1100478df9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5480fde18834c20926ef72662381362',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:51:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:51:14Z,use_quota=True,user_id='9c4b6322803a4a9cae974bf15863a243',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:14 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-9335e2dd-52b8-4e17-aa48-b86db48fbe3d tempest-ProjectReaderTests-1422491147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6e075a9-f6a5-4ffd-b12d-5ae88c9a2105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:14 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-9335e2dd-52b8-4e17-aa48-b86db48fbe3d tempest-ProjectReaderTests-1422491147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6e075a9-f6a5-4ffd-b12d-5ae88c9a2105) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:14 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-9335e2dd-52b8-4e17-aa48-b86db48fbe3d tempest-ProjectReaderTests-1422491147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b8c9175-b0b7-4e79-909c-49080d50ff9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:14 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-9335e2dd-52b8-4e17-aa48-b86db48fbe3d tempest-ProjectReaderTests-1422491147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b8c9175-b0b7-4e79-909c-49080d50ff9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fad7cbe3-54b6-480c-90e1-2a1100478df9', 'volume_name': 'volume-fad7cbe3-54b6-480c-90e1-2a1100478df9', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:14 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-9335e2dd-52b8-4e17-aa48-b86db48fbe3d tempest-ProjectReaderTests-1422491147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de8aea41-a7b8-4068-a10f-abd8ef807749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:14 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-9335e2dd-52b8-4e17-aa48-b86db48fbe3d tempest-ProjectReaderTests-1422491147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de8aea41-a7b8-4068-a10f-abd8ef807749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:14 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-9335e2dd-52b8-4e17-aa48-b86db48fbe3d tempest-ProjectReaderTests-1422491147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d685577-ecc7-4125-9816-0cf88962ae1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:14 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-9335e2dd-52b8-4e17-aa48-b86db48fbe3d tempest-ProjectReaderTests-1422491147 None] Volume fad7cbe3-54b6-480c-90e1-2a1100478df9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fad7cbe3-54b6-480c-90e1-2a1100478df9', 'volume_size': 1} Sep 23 14:51:14 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-9335e2dd-52b8-4e17-aa48-b86db48fbe3d tempest-ProjectReaderTests-1422491147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:51:14 devstack sudo[104159]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:14 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-e184dac8-27bc-4c32-b4be-467ca2d9997c tempest-CreateVolumesFromSnapshotTest-1218382436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2ebc4750-29cf-4ab4-8dca-e5e9692faef0" returned: 0 in 0.627s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:14 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-e184dac8-27bc-4c32-b4be-467ca2d9997c tempest-CreateVolumesFromSnapshotTest-1218382436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2ebc4750-29cf-4ab4-8dca-e5e9692faef0 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:14 devstack sudo[104171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2ebc4750-29cf-4ab4-8dca-e5e9692faef0 Sep 23 14:51:14 devstack sudo[104171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:14 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-04e48ad8-0759-4bc6-a6e0-9496291ae89c tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:51:14 devstack sudo[104160]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:14 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-04e48ad8-0759-4bc6-a6e0-9496291ae89c tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Flow 'volume_create_manager' (ac21a0a1-5b4e-4698-8d27-2444b4c588be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:51:14 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-04e48ad8-0759-4bc6-a6e0-9496291ae89c tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c171ebb4-7a59-4844-838f-b11c05c875ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:14 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-34af6f50-8a21-42c4-b82a-1d28189d663f tempest-CreateVolumesFromSourceVolumeTest-702571909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7159b520-d496-429f-b4ad-104765980edb 1073741824" returned: 0 in 0.653s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:14 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-04e48ad8-0759-4bc6-a6e0-9496291ae89c tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c171ebb4-7a59-4844-838f-b11c05c875ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:51:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1129778717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d878cad7-6c04-49af-804d-20068bb6d946,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='650af342b2c0470bbd578c1e20620a1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:51:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:51:14Z,use_quota=True,user_id='ed73f027af20494ba732b573354a9289',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:14 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-04e48ad8-0759-4bc6-a6e0-9496291ae89c tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efc21027-2ef8-4c18-bbb1-9f06521ec3cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:14 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-04e48ad8-0759-4bc6-a6e0-9496291ae89c tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efc21027-2ef8-4c18-bbb1-9f06521ec3cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:14 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-04e48ad8-0759-4bc6-a6e0-9496291ae89c tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3094c27f-87cb-4bc5-9d31-c7aaae3ffe6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:14 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-04e48ad8-0759-4bc6-a6e0-9496291ae89c tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3094c27f-87cb-4bc5-9d31-c7aaae3ffe6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd878cad7-6c04-49af-804d-20068bb6d946', 'volume_name': 'volume-d878cad7-6c04-49af-804d-20068bb6d946', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:14 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-04e48ad8-0759-4bc6-a6e0-9496291ae89c tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1e88f38-515a-4d57-bc10-76c911ec33c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:14 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-04e48ad8-0759-4bc6-a6e0-9496291ae89c tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1e88f38-515a-4d57-bc10-76c911ec33c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:14 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-04e48ad8-0759-4bc6-a6e0-9496291ae89c tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cf2832d-3149-44fe-9f6b-dc00f5bd2017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:14 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-04e48ad8-0759-4bc6-a6e0-9496291ae89c tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Volume d878cad7-6c04-49af-804d-20068bb6d946: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d878cad7-6c04-49af-804d-20068bb6d946', 'volume_size': 1} Sep 23 14:51:14 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-04e48ad8-0759-4bc6-a6e0-9496291ae89c tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:51:14 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-eac10ce6-44c2-4183-9d2f-92e653086313 tempest-CinderUnicodeTest-1321322603 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:51:14 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-eac10ce6-44c2-4183-9d2f-92e653086313 tempest-CinderUnicodeTest-1321322603 None] Flow 'volume_create_manager' (32bdb48e-486c-4eda-aba5-5b4e7d609dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:51:14 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-eac10ce6-44c2-4183-9d2f-92e653086313 tempest-CinderUnicodeTest-1321322603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90e9a13f-a9a2-4289-b012-615db9e39e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:14 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-34af6f50-8a21-42c4-b82a-1d28189d663f tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7159b520-d496-429f-b4ad-104765980edb {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:14 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-eac10ce6-44c2-4183-9d2f-92e653086313 tempest-CinderUnicodeTest-1321322603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90e9a13f-a9a2-4289-b012-615db9e39e2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:51:14Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-991403110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3c0b4c6-56e4-44d2-ba9c-2d4bb8630170,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='881fdfae936346fa91fe5d01a82b099e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:51:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:51:14Z,use_quota=True,user_id='2bcce21fcd51484699fdddfb6ad5f40c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:14 devstack sudo[104173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7159b520-d496-429f-b4ad-104765980edb Sep 23 14:51:14 devstack sudo[104173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:14 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-eac10ce6-44c2-4183-9d2f-92e653086313 tempest-CinderUnicodeTest-1321322603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de0fc992-6a6f-4243-94b2-88cc36bbd4a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:14 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-eac10ce6-44c2-4183-9d2f-92e653086313 tempest-CinderUnicodeTest-1321322603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de0fc992-6a6f-4243-94b2-88cc36bbd4a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:14 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-eac10ce6-44c2-4183-9d2f-92e653086313 tempest-CinderUnicodeTest-1321322603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a22374a4-9b43-4edf-a8ee-4cc13b86c982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:14 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-eac10ce6-44c2-4183-9d2f-92e653086313 tempest-CinderUnicodeTest-1321322603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a22374a4-9b43-4edf-a8ee-4cc13b86c982) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3c0b4c6-56e4-44d2-ba9c-2d4bb8630170', 'volume_name': 'volume-d3c0b4c6-56e4-44d2-ba9c-2d4bb8630170', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:14 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-eac10ce6-44c2-4183-9d2f-92e653086313 tempest-CinderUnicodeTest-1321322603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99f3664b-dd90-4cef-976b-b6cefc40d3db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:14 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-eac10ce6-44c2-4183-9d2f-92e653086313 tempest-CinderUnicodeTest-1321322603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99f3664b-dd90-4cef-976b-b6cefc40d3db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:14 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-eac10ce6-44c2-4183-9d2f-92e653086313 tempest-CinderUnicodeTest-1321322603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9d6eb09-6b7b-4209-b3b0-611c7bd3062f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:14 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-eac10ce6-44c2-4183-9d2f-92e653086313 tempest-CinderUnicodeTest-1321322603 None] Volume d3c0b4c6-56e4-44d2-ba9c-2d4bb8630170: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3c0b4c6-56e4-44d2-ba9c-2d4bb8630170', 'volume_size': 1} Sep 23 14:51:14 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-eac10ce6-44c2-4183-9d2f-92e653086313 tempest-CinderUnicodeTest-1321322603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:51:14 devstack sudo[104171]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:14 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-65a86268-799f-47d3-8c59-9b45758743e0 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:51:14 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-65a86268-799f-47d3-8c59-9b45758743e0 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Flow 'volume_create_manager' (6c33f943-4dcb-4f43-aedc-403e8c618460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:51:14 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-65a86268-799f-47d3-8c59-9b45758743e0 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (095c7c3d-8e72-4dbf-8667-f3760212ac32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:14 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-e184dac8-27bc-4c32-b4be-467ca2d9997c tempest-CreateVolumesFromSnapshotTest-1218382436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-2ebc4750-29cf-4ab4-8dca-e5e9692faef0" returned: 0 in 0.409s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:14 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-e184dac8-27bc-4c32-b4be-467ca2d9997c tempest-CreateVolumesFromSnapshotTest-1218382436 None] Lock "cinder-quobyte-2ebc4750-29cf-4ab4-8dca-e5e9692faef0" released by "delete_volume" :: held 1.121s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:51:14 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-65a86268-799f-47d3-8c59-9b45758743e0 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (095c7c3d-8e72-4dbf-8667-f3760212ac32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:51:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-488125122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a4f89d0-d24a-4b23-a31b-be363560971f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='650af342b2c0470bbd578c1e20620a1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:51:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:51:15Z,use_quota=True,user_id='ed73f027af20494ba732b573354a9289',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:14 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-65a86268-799f-47d3-8c59-9b45758743e0 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de61e920-c8d1-4c8a-8f83-375aa5d2ecc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:14 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-65a86268-799f-47d3-8c59-9b45758743e0 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de61e920-c8d1-4c8a-8f83-375aa5d2ecc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:14 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-65a86268-799f-47d3-8c59-9b45758743e0 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21c14627-4be3-415a-ad56-536d9f4d918b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:14 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-65a86268-799f-47d3-8c59-9b45758743e0 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21c14627-4be3-415a-ad56-536d9f4d918b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a4f89d0-d24a-4b23-a31b-be363560971f', 'volume_name': 'volume-7a4f89d0-d24a-4b23-a31b-be363560971f', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:14 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-65a86268-799f-47d3-8c59-9b45758743e0 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ba36819-97ac-41ed-bdd0-6def82992652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:14 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-65a86268-799f-47d3-8c59-9b45758743e0 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ba36819-97ac-41ed-bdd0-6def82992652) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:14 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-65a86268-799f-47d3-8c59-9b45758743e0 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e8d9e74-c372-4c95-a917-c2054dceb84b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:14 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-65a86268-799f-47d3-8c59-9b45758743e0 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Volume 7a4f89d0-d24a-4b23-a31b-be363560971f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a4f89d0-d24a-4b23-a31b-be363560971f', 'volume_size': 1} Sep 23 14:51:14 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-65a86268-799f-47d3-8c59-9b45758743e0 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:51:14 devstack sudo[104173]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:14 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-34af6f50-8a21-42c4-b82a-1d28189d663f tempest-CreateVolumesFromSourceVolumeTest-702571909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7159b520-d496-429f-b4ad-104765980edb" returned: 0 in 0.276s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:14 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-34af6f50-8a21-42c4-b82a-1d28189d663f tempest-CreateVolumesFromSourceVolumeTest-702571909 None] <== create_volume: return (1090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:51:14 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-34af6f50-8a21-42c4-b82a-1d28189d663f tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.098s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:51:14 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-ed421c96-1732-49ba-965d-664522718d39 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.223s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:51:14 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-ed421c96-1732-49ba-965d-664522718d39 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:51:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1331145952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44506418-87c5-4786-b2df-89b8e94aba18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='650af342b2c0470bbd578c1e20620a1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:51:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:51:13Z,use_quota=True,user_id='ed73f027af20494ba732b573354a9289',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:51:14 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-ed421c96-1732-49ba-965d-664522718d39 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Creating volume 44506418-87c5-4786-b2df-89b8e94aba18 {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:51:14 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-ed421c96-1732-49ba-965d-664522718d39 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:51:14 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-ed421c96-1732-49ba-965d-664522718d39 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:51:14 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-ed421c96-1732-49ba-965d-664522718d39 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:51:14 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-ed421c96-1732-49ba-965d-664522718d39 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:51:14 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-ed421c96-1732-49ba-965d-664522718d39 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:51:14 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-ed421c96-1732-49ba-965d-664522718d39 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:51:14 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-ed421c96-1732-49ba-965d-664522718d39 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:51:14 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ed421c96-1732-49ba-965d-664522718d39 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-44506418-87c5-4786-b2df-89b8e94aba18 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:14 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-34af6f50-8a21-42c4-b82a-1d28189d663f tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61bbed51-25fa-46e1-9c35-5f32836e8681) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7159b520-d496-429f-b4ad-104765980edb', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:14 devstack sudo[104177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-44506418-87c5-4786-b2df-89b8e94aba18 1073741824 Sep 23 14:51:14 devstack sudo[104177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:14 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-34af6f50-8a21-42c4-b82a-1d28189d663f tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1c87211-fff3-4c8b-853a-076575db1c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:14 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-e184dac8-27bc-4c32-b4be-467ca2d9997c tempest-CreateVolumesFromSnapshotTest-1218382436 None] Created reservations ['19488cb8-480a-454d-806a-c7182d641616', '4d0555e1-39b0-4a4e-8f6e-5435b5a555e6', '7900446c-00c4-4b29-8f64-03d1344f66da', 'be9553f9-f29d-46a3-a866-2111dfe7b3b0'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:51:14 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-34af6f50-8a21-42c4-b82a-1d28189d663f tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Volume volume-7159b520-d496-429f-b4ad-104765980edb (7159b520-d496-429f-b4ad-104765980edb): created successfully Sep 23 14:51:14 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-34af6f50-8a21-42c4-b82a-1d28189d663f tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1c87211-fff3-4c8b-853a-076575db1c7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:14 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-34af6f50-8a21-42c4-b82a-1d28189d663f tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Flow 'volume_create_manager' (7345dd62-9246-45a2-849c-304a4fad5685) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:51:14 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-34af6f50-8a21-42c4-b82a-1d28189d663f tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Created volume successfully. Sep 23 14:51:14 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-e184dac8-27bc-4c32-b4be-467ca2d9997c tempest-CreateVolumesFromSnapshotTest-1218382436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:51:14 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-e184dac8-27bc-4c32-b4be-467ca2d9997c tempest-CreateVolumesFromSnapshotTest-1218382436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:51:14 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-e184dac8-27bc-4c32-b4be-467ca2d9997c tempest-CreateVolumesFromSnapshotTest-1218382436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:51:14 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-e184dac8-27bc-4c32-b4be-467ca2d9997c tempest-CreateVolumesFromSnapshotTest-1218382436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:51:14 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-e184dac8-27bc-4c32-b4be-467ca2d9997c tempest-CreateVolumesFromSnapshotTest-1218382436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:51:14 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-e184dac8-27bc-4c32-b4be-467ca2d9997c tempest-CreateVolumesFromSnapshotTest-1218382436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:15 devstack sudo[104179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:51:15 devstack sudo[104179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:15 devstack sudo[104179]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:15 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-e184dac8-27bc-4c32-b4be-467ca2d9997c tempest-CreateVolumesFromSnapshotTest-1218382436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.271s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:15 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-e184dac8-27bc-4c32-b4be-467ca2d9997c tempest-CreateVolumesFromSnapshotTest-1218382436 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:51:15 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-e184dac8-27bc-4c32-b4be-467ca2d9997c tempest-CreateVolumesFromSnapshotTest-1218382436 None] Deleted volume successfully. Sep 23 14:51:15 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-e184dac8-27bc-4c32-b4be-467ca2d9997c tempest-CreateVolumesFromSnapshotTest-1218382436 None] Lock "cinder-2ebc4750-29cf-4ab4-8dca-e5e9692faef0-delete_volume" released by "delete_volume" :: held 1.820s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:51:15 devstack sudo[104177]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:15 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ed421c96-1732-49ba-965d-664522718d39 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-44506418-87c5-4786-b2df-89b8e94aba18 1073741824" returned: 0 in 0.449s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:15 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ed421c96-1732-49ba-965d-664522718d39 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-44506418-87c5-4786-b2df-89b8e94aba18 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:15 devstack sudo[104185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-44506418-87c5-4786-b2df-89b8e94aba18 Sep 23 14:51:15 devstack sudo[104185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:15 devstack sudo[104185]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:15 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ed421c96-1732-49ba-965d-664522718d39 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-44506418-87c5-4786-b2df-89b8e94aba18" returned: 0 in 0.250s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:15 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-ed421c96-1732-49ba-965d-664522718d39 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] <== create_volume: return (738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:51:15 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-ed421c96-1732-49ba-965d-664522718d39 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.740s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:51:15 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-9335e2dd-52b8-4e17-aa48-b86db48fbe3d tempest-ProjectReaderTests-1422491147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.360s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:51:15 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-9335e2dd-52b8-4e17-aa48-b86db48fbe3d tempest-ProjectReaderTests-1422491147 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:51:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1018535761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fad7cbe3-54b6-480c-90e1-2a1100478df9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5480fde18834c20926ef72662381362',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:51:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:51:14Z,use_quota=True,user_id='9c4b6322803a4a9cae974bf15863a243',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:51:15 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-9335e2dd-52b8-4e17-aa48-b86db48fbe3d tempest-ProjectReaderTests-1422491147 None] Creating volume fad7cbe3-54b6-480c-90e1-2a1100478df9 {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:51:15 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-9335e2dd-52b8-4e17-aa48-b86db48fbe3d tempest-ProjectReaderTests-1422491147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:51:15 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-9335e2dd-52b8-4e17-aa48-b86db48fbe3d tempest-ProjectReaderTests-1422491147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:51:15 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-9335e2dd-52b8-4e17-aa48-b86db48fbe3d tempest-ProjectReaderTests-1422491147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:51:15 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-9335e2dd-52b8-4e17-aa48-b86db48fbe3d tempest-ProjectReaderTests-1422491147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:51:15 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-9335e2dd-52b8-4e17-aa48-b86db48fbe3d tempest-ProjectReaderTests-1422491147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:51:15 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-9335e2dd-52b8-4e17-aa48-b86db48fbe3d tempest-ProjectReaderTests-1422491147 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:51:15 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-9335e2dd-52b8-4e17-aa48-b86db48fbe3d tempest-ProjectReaderTests-1422491147 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:51:15 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-9335e2dd-52b8-4e17-aa48-b86db48fbe3d tempest-ProjectReaderTests-1422491147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fad7cbe3-54b6-480c-90e1-2a1100478df9 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:15 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-ed421c96-1732-49ba-965d-664522718d39 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c10f2f2-2963-467e-bfb9-bac5502a804d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44506418-87c5-4786-b2df-89b8e94aba18', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:15 devstack sudo[104188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fad7cbe3-54b6-480c-90e1-2a1100478df9 1073741824 Sep 23 14:51:15 devstack sudo[104188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:15 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-ed421c96-1732-49ba-965d-664522718d39 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b59e8874-c330-4c97-b63a-4ebcbc328cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:15 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-ed421c96-1732-49ba-965d-664522718d39 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Volume volume-44506418-87c5-4786-b2df-89b8e94aba18 (44506418-87c5-4786-b2df-89b8e94aba18): created successfully Sep 23 14:51:15 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-ed421c96-1732-49ba-965d-664522718d39 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b59e8874-c330-4c97-b63a-4ebcbc328cca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:15 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-ed421c96-1732-49ba-965d-664522718d39 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Flow 'volume_create_manager' (a70656fd-5182-4520-8fa3-f542d4140cde) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:51:15 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-ed421c96-1732-49ba-965d-664522718d39 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Created volume successfully. Sep 23 14:51:15 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-8266bfbc-31d1-48d6-892e-06a817e94a16 tempest-CreateVolumesFromSnapshotTest-1218382436 None] Acquiring lock "cinder-210b7ae8-df5c-42ae-bb76-1f146faceebd-delete_snapshot" by "delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:51:15 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-8266bfbc-31d1-48d6-892e-06a817e94a16 tempest-CreateVolumesFromSnapshotTest-1218382436 None] Lock "cinder-210b7ae8-df5c-42ae-bb76-1f146faceebd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:51:15 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-8266bfbc-31d1-48d6-892e-06a817e94a16 tempest-CreateVolumesFromSnapshotTest-1218382436 None] Acquiring lock "cinder-quobyte-82b47b51-3d87-4e7f-8a72-f9a37b938253" by "delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:51:15 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-8266bfbc-31d1-48d6-892e-06a817e94a16 tempest-CreateVolumesFromSnapshotTest-1218382436 None] Lock "cinder-quobyte-82b47b51-3d87-4e7f-8a72-f9a37b938253" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:51:15 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-8266bfbc-31d1-48d6-892e-06a817e94a16 tempest-CreateVolumesFromSnapshotTest-1218382436 None] Acquiring lock "cinder-quobyte-210b7ae8-df5c-42ae-bb76-1f146faceebd" by "_delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:51:15 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-8266bfbc-31d1-48d6-892e-06a817e94a16 tempest-CreateVolumesFromSnapshotTest-1218382436 None] Lock "cinder-quobyte-210b7ae8-df5c-42ae-bb76-1f146faceebd" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:51:15 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-8266bfbc-31d1-48d6-892e-06a817e94a16 tempest-CreateVolumesFromSnapshotTest-1218382436 None] Deleting offline snapshot 210b7ae8-df5c-42ae-bb76-1f146faceebd of volume 82b47b51-3d87-4e7f-8a72-f9a37b938253 {{(pid=86310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 14:51:16 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-8266bfbc-31d1-48d6-892e-06a817e94a16 tempest-CreateVolumesFromSnapshotTest-1218382436 None] snapshot_file for this snap is: volume-82b47b51-3d87-4e7f-8a72-f9a37b938253.210b7ae8-df5c-42ae-bb76-1f146faceebd {{(pid=86310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 14:51:16 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6b54dbe-3c85-439a-89dd-b6335ec70dcb]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:51:16 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8266bfbc-31d1-48d6-892e-06a817e94a16 tempest-CreateVolumesFromSnapshotTest-1218382436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-82b47b51-3d87-4e7f-8a72-f9a37b938253.210b7ae8-df5c-42ae-bb76-1f146faceebd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:16 devstack sudo[104188]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:16 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-9335e2dd-52b8-4e17-aa48-b86db48fbe3d tempest-ProjectReaderTests-1422491147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fad7cbe3-54b6-480c-90e1-2a1100478df9 1073741824" returned: 0 in 0.480s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:16 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-9335e2dd-52b8-4e17-aa48-b86db48fbe3d tempest-ProjectReaderTests-1422491147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fad7cbe3-54b6-480c-90e1-2a1100478df9 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:16 devstack sudo[104194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-82b47b51-3d87-4e7f-8a72-f9a37b938253.210b7ae8-df5c-42ae-bb76-1f146faceebd Sep 23 14:51:16 devstack sudo[104194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:16 devstack sudo[104195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fad7cbe3-54b6-480c-90e1-2a1100478df9 Sep 23 14:51:16 devstack sudo[104195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:16 devstack sudo[104195]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:16 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-9335e2dd-52b8-4e17-aa48-b86db48fbe3d tempest-ProjectReaderTests-1422491147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fad7cbe3-54b6-480c-90e1-2a1100478df9" returned: 0 in 0.259s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:16 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-9335e2dd-52b8-4e17-aa48-b86db48fbe3d tempest-ProjectReaderTests-1422491147 None] <== create_volume: return (780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:51:16 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-9335e2dd-52b8-4e17-aa48-b86db48fbe3d tempest-ProjectReaderTests-1422491147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:51:16 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-04e48ad8-0759-4bc6-a6e0-9496291ae89c tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.891s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:51:16 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-04e48ad8-0759-4bc6-a6e0-9496291ae89c tempest-CreateVolumesFromSourceVolumeTest-702571909 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:51:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1129778717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d878cad7-6c04-49af-804d-20068bb6d946,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='650af342b2c0470bbd578c1e20620a1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:51:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:51:14Z,use_quota=True,user_id='ed73f027af20494ba732b573354a9289',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:51:16 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-04e48ad8-0759-4bc6-a6e0-9496291ae89c tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Creating volume d878cad7-6c04-49af-804d-20068bb6d946 {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:51:16 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-04e48ad8-0759-4bc6-a6e0-9496291ae89c tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:51:16 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-04e48ad8-0759-4bc6-a6e0-9496291ae89c tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:51:16 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-04e48ad8-0759-4bc6-a6e0-9496291ae89c tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:51:16 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-04e48ad8-0759-4bc6-a6e0-9496291ae89c tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:51:16 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-04e48ad8-0759-4bc6-a6e0-9496291ae89c tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:51:16 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-04e48ad8-0759-4bc6-a6e0-9496291ae89c tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:51:16 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-04e48ad8-0759-4bc6-a6e0-9496291ae89c tempest-CreateVolumesFromSourceVolumeTest-702571909 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:51:16 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-04e48ad8-0759-4bc6-a6e0-9496291ae89c tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d878cad7-6c04-49af-804d-20068bb6d946 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:16 devstack sudo[104194]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:16 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8266bfbc-31d1-48d6-892e-06a817e94a16 tempest-CreateVolumesFromSnapshotTest-1218382436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-82b47b51-3d87-4e7f-8a72-f9a37b938253.210b7ae8-df5c-42ae-bb76-1f146faceebd" returned: 0 in 0.395s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:16 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-8266bfbc-31d1-48d6-892e-06a817e94a16 tempest-CreateVolumesFromSnapshotTest-1218382436 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82b47b51-3d87-4e7f-8a72-f9a37b938253(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 14:51:16 devstack sudo[104202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d878cad7-6c04-49af-804d-20068bb6d946 1073741824 Sep 23 14:51:16 devstack sudo[104202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:16 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-9335e2dd-52b8-4e17-aa48-b86db48fbe3d tempest-ProjectReaderTests-1422491147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d685577-ecc7-4125-9816-0cf88962ae1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fad7cbe3-54b6-480c-90e1-2a1100478df9', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:16 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-9335e2dd-52b8-4e17-aa48-b86db48fbe3d tempest-ProjectReaderTests-1422491147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4e85922-6136-4947-beb6-ec7bd3e7f829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:16 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8ea99c9-d7d0-43b1-b20e-541c5f2e9c3a]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:51:16 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8266bfbc-31d1-48d6-892e-06a817e94a16 tempest-CreateVolumesFromSnapshotTest-1218382436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-82b47b51-3d87-4e7f-8a72-f9a37b938253 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:16 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-9335e2dd-52b8-4e17-aa48-b86db48fbe3d tempest-ProjectReaderTests-1422491147 None] Volume volume-fad7cbe3-54b6-480c-90e1-2a1100478df9 (fad7cbe3-54b6-480c-90e1-2a1100478df9): created successfully Sep 23 14:51:16 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-9335e2dd-52b8-4e17-aa48-b86db48fbe3d tempest-ProjectReaderTests-1422491147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4e85922-6136-4947-beb6-ec7bd3e7f829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:16 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-9335e2dd-52b8-4e17-aa48-b86db48fbe3d tempest-ProjectReaderTests-1422491147 None] Flow 'volume_create_manager' (fb6d5a7d-ac76-4e26-8d02-1b56f7c4ac71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:51:16 devstack sudo[104204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-82b47b51-3d87-4e7f-8a72-f9a37b938253 Sep 23 14:51:16 devstack sudo[104204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:16 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-9335e2dd-52b8-4e17-aa48-b86db48fbe3d tempest-ProjectReaderTests-1422491147 None] Created volume successfully. Sep 23 14:51:16 devstack sudo[104204]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:16 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8266bfbc-31d1-48d6-892e-06a817e94a16 tempest-CreateVolumesFromSnapshotTest-1218382436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-82b47b51-3d87-4e7f-8a72-f9a37b938253" returned: 0 in 0.437s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:16 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8266bfbc-31d1-48d6-892e-06a817e94a16 tempest-CreateVolumesFromSnapshotTest-1218382436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-82b47b51-3d87-4e7f-8a72-f9a37b938253.210b7ae8-df5c-42ae-bb76-1f146faceebd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:16 devstack sudo[104202]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:16 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-04e48ad8-0759-4bc6-a6e0-9496291ae89c tempest-CreateVolumesFromSourceVolumeTest-702571909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d878cad7-6c04-49af-804d-20068bb6d946 1073741824" returned: 0 in 0.521s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:16 devstack sudo[104213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-82b47b51-3d87-4e7f-8a72-f9a37b938253.210b7ae8-df5c-42ae-bb76-1f146faceebd Sep 23 14:51:16 devstack sudo[104213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:16 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-04e48ad8-0759-4bc6-a6e0-9496291ae89c tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d878cad7-6c04-49af-804d-20068bb6d946 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:17 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-e53e0b83-f8af-42ff-85ce-c5df77fcf572 tempest-ProjectReaderTests-1422491147 None] Acquiring lock "cinder-fad7cbe3-54b6-480c-90e1-2a1100478df9-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:51:17 devstack sudo[104215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d878cad7-6c04-49af-804d-20068bb6d946 Sep 23 14:51:17 devstack sudo[104215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:17 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-e53e0b83-f8af-42ff-85ce-c5df77fcf572 tempest-ProjectReaderTests-1422491147 None] Lock "cinder-fad7cbe3-54b6-480c-90e1-2a1100478df9-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:51:17 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-e53e0b83-f8af-42ff-85ce-c5df77fcf572 tempest-ProjectReaderTests-1422491147 None] Acquiring lock "cinder-quobyte-fad7cbe3-54b6-480c-90e1-2a1100478df9" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:51:17 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-e53e0b83-f8af-42ff-85ce-c5df77fcf572 tempest-ProjectReaderTests-1422491147 None] Lock "cinder-quobyte-fad7cbe3-54b6-480c-90e1-2a1100478df9" acquired by "delete_volume" :: waited 0.017s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:51:17 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee4846d1-e81f-41ca-8553-25fb36303f8b]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:51:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-e53e0b83-f8af-42ff-85ce-c5df77fcf572 tempest-ProjectReaderTests-1422491147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fad7cbe3-54b6-480c-90e1-2a1100478df9 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:17 devstack sudo[104218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fad7cbe3-54b6-480c-90e1-2a1100478df9 Sep 23 14:51:17 devstack sudo[104218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:17 devstack sudo[104215]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-04e48ad8-0759-4bc6-a6e0-9496291ae89c tempest-CreateVolumesFromSourceVolumeTest-702571909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d878cad7-6c04-49af-804d-20068bb6d946" returned: 0 in 0.318s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:17 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-04e48ad8-0759-4bc6-a6e0-9496291ae89c tempest-CreateVolumesFromSourceVolumeTest-702571909 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:51:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-04e48ad8-0759-4bc6-a6e0-9496291ae89c tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.903s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:51:17 devstack sudo[104213]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-eac10ce6-44c2-4183-9d2f-92e653086313 tempest-CinderUnicodeTest-1321322603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.658s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:51:17 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-eac10ce6-44c2-4183-9d2f-92e653086313 tempest-CinderUnicodeTest-1321322603 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:51:14Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-991403110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3c0b4c6-56e4-44d2-ba9c-2d4bb8630170,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='881fdfae936346fa91fe5d01a82b099e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:51:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:51:14Z,use_quota=True,user_id='2bcce21fcd51484699fdddfb6ad5f40c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:51:17 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-eac10ce6-44c2-4183-9d2f-92e653086313 tempest-CinderUnicodeTest-1321322603 None] Creating volume d3c0b4c6-56e4-44d2-ba9c-2d4bb8630170 {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:51:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-eac10ce6-44c2-4183-9d2f-92e653086313 tempest-CinderUnicodeTest-1321322603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:51:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-eac10ce6-44c2-4183-9d2f-92e653086313 tempest-CinderUnicodeTest-1321322603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:51:17 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-eac10ce6-44c2-4183-9d2f-92e653086313 tempest-CinderUnicodeTest-1321322603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:51:17 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-eac10ce6-44c2-4183-9d2f-92e653086313 tempest-CinderUnicodeTest-1321322603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:51:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-eac10ce6-44c2-4183-9d2f-92e653086313 tempest-CinderUnicodeTest-1321322603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:51:17 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-eac10ce6-44c2-4183-9d2f-92e653086313 tempest-CinderUnicodeTest-1321322603 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:51:17 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-eac10ce6-44c2-4183-9d2f-92e653086313 tempest-CinderUnicodeTest-1321322603 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:51:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-eac10ce6-44c2-4183-9d2f-92e653086313 tempest-CinderUnicodeTest-1321322603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d3c0b4c6-56e4-44d2-ba9c-2d4bb8630170 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8266bfbc-31d1-48d6-892e-06a817e94a16 tempest-CreateVolumesFromSnapshotTest-1218382436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-82b47b51-3d87-4e7f-8a72-f9a37b938253.210b7ae8-df5c-42ae-bb76-1f146faceebd" returned: 0 in 0.421s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8266bfbc-31d1-48d6-892e-06a817e94a16 tempest-CreateVolumesFromSnapshotTest-1218382436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-82b47b51-3d87-4e7f-8a72-f9a37b938253.210b7ae8-df5c-42ae-bb76-1f146faceebd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:17 devstack sudo[104223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d3c0b4c6-56e4-44d2-ba9c-2d4bb8630170 1073741824 Sep 23 14:51:17 devstack sudo[104223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:17 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-04e48ad8-0759-4bc6-a6e0-9496291ae89c tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cf2832d-3149-44fe-9f6b-dc00f5bd2017) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d878cad7-6c04-49af-804d-20068bb6d946', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:17 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-04e48ad8-0759-4bc6-a6e0-9496291ae89c tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a3f5a6b-b15c-4ef5-a000-fc8bcc1a9167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:17 devstack sudo[104224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-82b47b51-3d87-4e7f-8a72-f9a37b938253.210b7ae8-df5c-42ae-bb76-1f146faceebd Sep 23 14:51:17 devstack sudo[104224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:17 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-04e48ad8-0759-4bc6-a6e0-9496291ae89c tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Volume volume-d878cad7-6c04-49af-804d-20068bb6d946 (d878cad7-6c04-49af-804d-20068bb6d946): created successfully Sep 23 14:51:17 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-04e48ad8-0759-4bc6-a6e0-9496291ae89c tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a3f5a6b-b15c-4ef5-a000-fc8bcc1a9167) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:17 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-04e48ad8-0759-4bc6-a6e0-9496291ae89c tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Flow 'volume_create_manager' (ac21a0a1-5b4e-4698-8d27-2444b4c588be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:51:17 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-04e48ad8-0759-4bc6-a6e0-9496291ae89c tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Created volume successfully. Sep 23 14:51:17 devstack sudo[104218]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-e53e0b83-f8af-42ff-85ce-c5df77fcf572 tempest-ProjectReaderTests-1422491147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fad7cbe3-54b6-480c-90e1-2a1100478df9" returned: 0 in 0.425s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-e53e0b83-f8af-42ff-85ce-c5df77fcf572 tempest-ProjectReaderTests-1422491147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fad7cbe3-54b6-480c-90e1-2a1100478df9 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:17 devstack sudo[104234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fad7cbe3-54b6-480c-90e1-2a1100478df9 Sep 23 14:51:17 devstack sudo[104234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:17 devstack sudo[104224]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8266bfbc-31d1-48d6-892e-06a817e94a16 tempest-CreateVolumesFromSnapshotTest-1218382436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-82b47b51-3d87-4e7f-8a72-f9a37b938253.210b7ae8-df5c-42ae-bb76-1f146faceebd" returned: 0 in 0.299s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:17 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-8266bfbc-31d1-48d6-892e-06a817e94a16 tempest-CreateVolumesFromSnapshotTest-1218382436 None] Lock "cinder-quobyte-210b7ae8-df5c-42ae-bb76-1f146faceebd" released by "_delete_snapshot" :: held 1.691s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:51:17 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-8266bfbc-31d1-48d6-892e-06a817e94a16 tempest-CreateVolumesFromSnapshotTest-1218382436 None] Lock "cinder-quobyte-82b47b51-3d87-4e7f-8a72-f9a37b938253" released by "delete_snapshot" :: held 1.715s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:51:17 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-8266bfbc-31d1-48d6-892e-06a817e94a16 tempest-CreateVolumesFromSnapshotTest-1218382436 None] Created reservations ['4239618a-6185-4ee5-ab57-2ac96a550885', '8e3963ce-7d22-483d-ada1-7a52bff0769f', 'c3608af8-3fcb-4be5-a4b9-ab98ba647255', 'eceaca7b-ad78-4c92-bc70-cb2e10860ea0'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:51:17 devstack sudo[104223]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-eac10ce6-44c2-4183-9d2f-92e653086313 tempest-CinderUnicodeTest-1321322603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d3c0b4c6-56e4-44d2-ba9c-2d4bb8630170 1073741824" returned: 0 in 0.502s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:17 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-8266bfbc-31d1-48d6-892e-06a817e94a16 tempest-CreateVolumesFromSnapshotTest-1218382436 None] Delete snapshot completed successfully. Sep 23 14:51:17 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-8266bfbc-31d1-48d6-892e-06a817e94a16 tempest-CreateVolumesFromSnapshotTest-1218382436 None] Lock "cinder-210b7ae8-df5c-42ae-bb76-1f146faceebd-delete_snapshot" released by "delete_snapshot" :: held 1.883s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:51:17 devstack sudo[104234]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-eac10ce6-44c2-4183-9d2f-92e653086313 tempest-CinderUnicodeTest-1321322603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d3c0b4c6-56e4-44d2-ba9c-2d4bb8630170 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-e53e0b83-f8af-42ff-85ce-c5df77fcf572 tempest-ProjectReaderTests-1422491147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-fad7cbe3-54b6-480c-90e1-2a1100478df9" returned: 0 in 0.300s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:17 devstack sudo[104237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d3c0b4c6-56e4-44d2-ba9c-2d4bb8630170 Sep 23 14:51:17 devstack sudo[104237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:17 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-e53e0b83-f8af-42ff-85ce-c5df77fcf572 tempest-ProjectReaderTests-1422491147 None] Lock "cinder-quobyte-fad7cbe3-54b6-480c-90e1-2a1100478df9" released by "delete_volume" :: held 0.784s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:51:17 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-e53e0b83-f8af-42ff-85ce-c5df77fcf572 tempest-ProjectReaderTests-1422491147 None] Created reservations ['af474abf-39b7-42b2-8443-f08f9b0820ad', '561c4c3f-a92d-411e-b842-fc876e42ed3b', 'cafcfc8f-77cd-4d7b-a9a7-c7e3f64d738d', 'ca9ad9e3-e172-4ed0-8ac8-8c14a1c5b9a1'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:51:18 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-e53e0b83-f8af-42ff-85ce-c5df77fcf572 tempest-ProjectReaderTests-1422491147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:51:18 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-e53e0b83-f8af-42ff-85ce-c5df77fcf572 tempest-ProjectReaderTests-1422491147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:51:18 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-e53e0b83-f8af-42ff-85ce-c5df77fcf572 tempest-ProjectReaderTests-1422491147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:51:18 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-e53e0b83-f8af-42ff-85ce-c5df77fcf572 tempest-ProjectReaderTests-1422491147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:51:18 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-e53e0b83-f8af-42ff-85ce-c5df77fcf572 tempest-ProjectReaderTests-1422491147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:51:18 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-e53e0b83-f8af-42ff-85ce-c5df77fcf572 tempest-ProjectReaderTests-1422491147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:18 devstack sudo[104239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:51:18 devstack sudo[104239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:18 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-c0afc14d-0d35-4ba9-9d0c-67dff5cae49e tempest-CreateVolumesFromSnapshotTest-1218382436 None] Acquiring lock "cinder-82b47b51-3d87-4e7f-8a72-f9a37b938253-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:51:18 devstack sudo[104237]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:18 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-eac10ce6-44c2-4183-9d2f-92e653086313 tempest-CinderUnicodeTest-1321322603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d3c0b4c6-56e4-44d2-ba9c-2d4bb8630170" returned: 0 in 0.294s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:18 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-eac10ce6-44c2-4183-9d2f-92e653086313 tempest-CinderUnicodeTest-1321322603 None] <== create_volume: return (858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:51:18 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-eac10ce6-44c2-4183-9d2f-92e653086313 tempest-CinderUnicodeTest-1321322603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:51:18 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-65a86268-799f-47d3-8c59-9b45758743e0 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.352s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:51:18 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-65a86268-799f-47d3-8c59-9b45758743e0 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:51:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-488125122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a4f89d0-d24a-4b23-a31b-be363560971f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='650af342b2c0470bbd578c1e20620a1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:51:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:51:15Z,use_quota=True,user_id='ed73f027af20494ba732b573354a9289',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:51:18 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-65a86268-799f-47d3-8c59-9b45758743e0 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Creating volume 7a4f89d0-d24a-4b23-a31b-be363560971f {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:51:18 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-65a86268-799f-47d3-8c59-9b45758743e0 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:51:18 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-65a86268-799f-47d3-8c59-9b45758743e0 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:51:18 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-65a86268-799f-47d3-8c59-9b45758743e0 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:51:18 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-65a86268-799f-47d3-8c59-9b45758743e0 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:51:18 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-65a86268-799f-47d3-8c59-9b45758743e0 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:51:18 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-65a86268-799f-47d3-8c59-9b45758743e0 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:51:18 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-65a86268-799f-47d3-8c59-9b45758743e0 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:51:18 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-65a86268-799f-47d3-8c59-9b45758743e0 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7a4f89d0-d24a-4b23-a31b-be363560971f 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:18 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-c0afc14d-0d35-4ba9-9d0c-67dff5cae49e tempest-CreateVolumesFromSnapshotTest-1218382436 None] Lock "cinder-82b47b51-3d87-4e7f-8a72-f9a37b938253-delete_volume" acquired by "delete_volume" :: waited 0.083s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:51:18 devstack sudo[104242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7a4f89d0-d24a-4b23-a31b-be363560971f 1073741824 Sep 23 14:51:18 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-eac10ce6-44c2-4183-9d2f-92e653086313 tempest-CinderUnicodeTest-1321322603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9d6eb09-6b7b-4209-b3b0-611c7bd3062f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3c0b4c6-56e4-44d2-ba9c-2d4bb8630170', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:18 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-eac10ce6-44c2-4183-9d2f-92e653086313 tempest-CinderUnicodeTest-1321322603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf96f7c3-d51b-4dd1-a369-19e483accadd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:18 devstack sudo[104242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:18 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-eac10ce6-44c2-4183-9d2f-92e653086313 tempest-CinderUnicodeTest-1321322603 None] Volume volume-d3c0b4c6-56e4-44d2-ba9c-2d4bb8630170 (d3c0b4c6-56e4-44d2-ba9c-2d4bb8630170): created successfully Sep 23 14:51:18 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-eac10ce6-44c2-4183-9d2f-92e653086313 tempest-CinderUnicodeTest-1321322603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf96f7c3-d51b-4dd1-a369-19e483accadd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:18 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-eac10ce6-44c2-4183-9d2f-92e653086313 tempest-CinderUnicodeTest-1321322603 None] Flow 'volume_create_manager' (32bdb48e-486c-4eda-aba5-5b4e7d609dad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:51:18 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-eac10ce6-44c2-4183-9d2f-92e653086313 tempest-CinderUnicodeTest-1321322603 None] Created volume successfully. Sep 23 14:51:18 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-c0afc14d-0d35-4ba9-9d0c-67dff5cae49e tempest-CreateVolumesFromSnapshotTest-1218382436 None] Acquiring lock "cinder-quobyte-82b47b51-3d87-4e7f-8a72-f9a37b938253" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:51:18 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-c0afc14d-0d35-4ba9-9d0c-67dff5cae49e tempest-CreateVolumesFromSnapshotTest-1218382436 None] Lock "cinder-quobyte-82b47b51-3d87-4e7f-8a72-f9a37b938253" acquired by "delete_volume" :: waited 0.026s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:51:18 devstack sudo[104239]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:18 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-e53e0b83-f8af-42ff-85ce-c5df77fcf572 tempest-ProjectReaderTests-1422491147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.370s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:18 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-e53e0b83-f8af-42ff-85ce-c5df77fcf572 tempest-ProjectReaderTests-1422491147 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:51:18 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-e53e0b83-f8af-42ff-85ce-c5df77fcf572 tempest-ProjectReaderTests-1422491147 None] Deleted volume successfully. Sep 23 14:51:18 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3eb1c85-a41b-41b1-a411-c1869143c015]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:51:18 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-c0afc14d-0d35-4ba9-9d0c-67dff5cae49e tempest-CreateVolumesFromSnapshotTest-1218382436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-82b47b51-3d87-4e7f-8a72-f9a37b938253 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:18 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-e53e0b83-f8af-42ff-85ce-c5df77fcf572 tempest-ProjectReaderTests-1422491147 None] Lock "cinder-fad7cbe3-54b6-480c-90e1-2a1100478df9-delete_volume" released by "delete_volume" :: held 1.407s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:51:18 devstack sudo[104245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-82b47b51-3d87-4e7f-8a72-f9a37b938253 Sep 23 14:51:18 devstack sudo[104245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:18 devstack sudo[104242]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:18 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-65a86268-799f-47d3-8c59-9b45758743e0 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7a4f89d0-d24a-4b23-a31b-be363560971f 1073741824" returned: 0 in 0.644s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:18 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-65a86268-799f-47d3-8c59-9b45758743e0 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7a4f89d0-d24a-4b23-a31b-be363560971f {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:18 devstack sudo[104245]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:18 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-c0afc14d-0d35-4ba9-9d0c-67dff5cae49e tempest-CreateVolumesFromSnapshotTest-1218382436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-82b47b51-3d87-4e7f-8a72-f9a37b938253" returned: 0 in 0.476s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:18 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-c0afc14d-0d35-4ba9-9d0c-67dff5cae49e tempest-CreateVolumesFromSnapshotTest-1218382436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-82b47b51-3d87-4e7f-8a72-f9a37b938253 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:18 devstack sudo[104254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7a4f89d0-d24a-4b23-a31b-be363560971f Sep 23 14:51:18 devstack sudo[104254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:18 devstack sudo[104255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-82b47b51-3d87-4e7f-8a72-f9a37b938253 Sep 23 14:51:18 devstack sudo[104255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:18 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-4c983164-9a98-414f-a87c-11e420e29317 tempest-CinderUnicodeTest-1321322603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:51:18 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-71d6eda4-ca92-4241-813b-e2d46a1e5e6f tempest-ProjectReaderTests-1422491147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:51:18 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-71d6eda4-ca92-4241-813b-e2d46a1e5e6f tempest-ProjectReaderTests-1422491147 None] Flow 'volume_create_manager' (1224b7ba-b9d3-4fa4-8375-047f57802e69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:51:18 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-71d6eda4-ca92-4241-813b-e2d46a1e5e6f tempest-ProjectReaderTests-1422491147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1880a8b4-247c-4af2-b333-437c8916aa57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:19 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-71d6eda4-ca92-4241-813b-e2d46a1e5e6f tempest-ProjectReaderTests-1422491147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1880a8b4-247c-4af2-b333-437c8916aa57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:51:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1293753064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=472054fa-6806-4485-8d0f-4165960dd0a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5480fde18834c20926ef72662381362',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:51:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:51:19Z,use_quota=True,user_id='9c4b6322803a4a9cae974bf15863a243',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:19 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-71d6eda4-ca92-4241-813b-e2d46a1e5e6f tempest-ProjectReaderTests-1422491147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5956872-3f75-4fc6-a9e9-760e81d67996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:19 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-71d6eda4-ca92-4241-813b-e2d46a1e5e6f tempest-ProjectReaderTests-1422491147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5956872-3f75-4fc6-a9e9-760e81d67996) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:19 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-71d6eda4-ca92-4241-813b-e2d46a1e5e6f tempest-ProjectReaderTests-1422491147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b10d501c-4111-4318-84a5-2405af0317c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:19 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-71d6eda4-ca92-4241-813b-e2d46a1e5e6f tempest-ProjectReaderTests-1422491147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b10d501c-4111-4318-84a5-2405af0317c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '472054fa-6806-4485-8d0f-4165960dd0a5', 'volume_name': 'volume-472054fa-6806-4485-8d0f-4165960dd0a5', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:19 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-71d6eda4-ca92-4241-813b-e2d46a1e5e6f tempest-ProjectReaderTests-1422491147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d92ae3a-5a56-4649-9aaf-1e06cb7e152f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:19 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-71d6eda4-ca92-4241-813b-e2d46a1e5e6f tempest-ProjectReaderTests-1422491147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d92ae3a-5a56-4649-9aaf-1e06cb7e152f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:19 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-71d6eda4-ca92-4241-813b-e2d46a1e5e6f tempest-ProjectReaderTests-1422491147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52d3f1d5-94f9-42cb-b78a-dd0a5e7dd38e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:19 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-71d6eda4-ca92-4241-813b-e2d46a1e5e6f tempest-ProjectReaderTests-1422491147 None] Volume 472054fa-6806-4485-8d0f-4165960dd0a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-472054fa-6806-4485-8d0f-4165960dd0a5', 'volume_size': 1} Sep 23 14:51:19 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-71d6eda4-ca92-4241-813b-e2d46a1e5e6f tempest-ProjectReaderTests-1422491147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:51:19 devstack sudo[104254]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:19 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-65a86268-799f-47d3-8c59-9b45758743e0 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7a4f89d0-d24a-4b23-a31b-be363560971f" returned: 0 in 0.290s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:19 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-65a86268-799f-47d3-8c59-9b45758743e0 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] <== create_volume: return (991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:51:19 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-65a86268-799f-47d3-8c59-9b45758743e0 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.995s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:51:19 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-4c983164-9a98-414f-a87c-11e420e29317 tempest-CinderUnicodeTest-1321322603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.222s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:51:19 devstack sudo[104255]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:19 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-c0afc14d-0d35-4ba9-9d0c-67dff5cae49e tempest-CreateVolumesFromSnapshotTest-1218382436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-82b47b51-3d87-4e7f-8a72-f9a37b938253" returned: 0 in 0.290s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:19 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-65a86268-799f-47d3-8c59-9b45758743e0 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e8d9e74-c372-4c95-a917-c2054dceb84b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a4f89d0-d24a-4b23-a31b-be363560971f', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:19 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-65a86268-799f-47d3-8c59-9b45758743e0 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1f56ea3-8071-42e4-b66c-66faa5744001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:19 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-4c983164-9a98-414f-a87c-11e420e29317 tempest-CinderUnicodeTest-1321322603 None] Creating offline snapshot 067c83ec-3b98-4b67-8704-5d4f042fb677 of volume d3c0b4c6-56e4-44d2-ba9c-2d4bb8630170 {{(pid=86310) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 14:51:19 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-c0afc14d-0d35-4ba9-9d0c-67dff5cae49e tempest-CreateVolumesFromSnapshotTest-1218382436 None] Lock "cinder-quobyte-82b47b51-3d87-4e7f-8a72-f9a37b938253" released by "delete_volume" :: held 0.879s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:51:19 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-65a86268-799f-47d3-8c59-9b45758743e0 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Volume volume-7a4f89d0-d24a-4b23-a31b-be363560971f (7a4f89d0-d24a-4b23-a31b-be363560971f): created successfully Sep 23 14:51:19 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-65a86268-799f-47d3-8c59-9b45758743e0 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1f56ea3-8071-42e4-b66c-66faa5744001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:19 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-65a86268-799f-47d3-8c59-9b45758743e0 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Flow 'volume_create_manager' (6c33f943-4dcb-4f43-aedc-403e8c618460) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:51:19 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbb311b6-6467-4344-a9eb-48303dc24bc4]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:51:19 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-4c983164-9a98-414f-a87c-11e420e29317 tempest-CinderUnicodeTest-1321322603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d3c0b4c6-56e4-44d2-ba9c-2d4bb8630170 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:19 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-65a86268-799f-47d3-8c59-9b45758743e0 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Created volume successfully. Sep 23 14:51:19 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-c0afc14d-0d35-4ba9-9d0c-67dff5cae49e tempest-CreateVolumesFromSnapshotTest-1218382436 None] Created reservations ['ffeaaec4-257a-4589-b920-83abaaae56d0', 'f3a79dc0-3220-43d5-a19f-3cdefec48e75', '2fe9f173-5daa-48d9-8a21-d6ed87f49de3', 'f3216d99-0a85-4a2d-b142-4521e5345443'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:51:19 devstack sudo[104260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d3c0b4c6-56e4-44d2-ba9c-2d4bb8630170 Sep 23 14:51:19 devstack sudo[104260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:19 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-c0afc14d-0d35-4ba9-9d0c-67dff5cae49e tempest-CreateVolumesFromSnapshotTest-1218382436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:51:19 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-c0afc14d-0d35-4ba9-9d0c-67dff5cae49e tempest-CreateVolumesFromSnapshotTest-1218382436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:51:19 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-c0afc14d-0d35-4ba9-9d0c-67dff5cae49e tempest-CreateVolumesFromSnapshotTest-1218382436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:51:19 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-c0afc14d-0d35-4ba9-9d0c-67dff5cae49e tempest-CreateVolumesFromSnapshotTest-1218382436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:51:19 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-c0afc14d-0d35-4ba9-9d0c-67dff5cae49e tempest-CreateVolumesFromSnapshotTest-1218382436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:51:19 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-c0afc14d-0d35-4ba9-9d0c-67dff5cae49e tempest-CreateVolumesFromSnapshotTest-1218382436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:19 devstack sudo[104262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:51:19 devstack sudo[104262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:19 devstack sudo[104260]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:19 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-4c983164-9a98-414f-a87c-11e420e29317 tempest-CinderUnicodeTest-1321322603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d3c0b4c6-56e4-44d2-ba9c-2d4bb8630170" returned: 0 in 0.388s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:19 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-4c983164-9a98-414f-a87c-11e420e29317 tempest-CinderUnicodeTest-1321322603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d3c0b4c6-56e4-44d2-ba9c-2d4bb8630170,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d3c0b4c6-56e4-44d2-ba9c-2d4bb8630170.067c83ec-3b98-4b67-8704-5d4f042fb677 1G {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:19 devstack sudo[104262]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:19 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-c0afc14d-0d35-4ba9-9d0c-67dff5cae49e tempest-CreateVolumesFromSnapshotTest-1218382436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.258s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:19 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-c0afc14d-0d35-4ba9-9d0c-67dff5cae49e tempest-CreateVolumesFromSnapshotTest-1218382436 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:51:19 devstack sudo[104269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d3c0b4c6-56e4-44d2-ba9c-2d4bb8630170,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d3c0b4c6-56e4-44d2-ba9c-2d4bb8630170.067c83ec-3b98-4b67-8704-5d4f042fb677 1G Sep 23 14:51:19 devstack sudo[104269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:19 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-c0afc14d-0d35-4ba9-9d0c-67dff5cae49e tempest-CreateVolumesFromSnapshotTest-1218382436 None] Deleted volume successfully. Sep 23 14:51:19 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-c0afc14d-0d35-4ba9-9d0c-67dff5cae49e tempest-CreateVolumesFromSnapshotTest-1218382436 None] Lock "cinder-82b47b51-3d87-4e7f-8a72-f9a37b938253-delete_volume" released by "delete_volume" :: held 1.456s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:51:20 devstack sudo[104269]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:20 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-4c983164-9a98-414f-a87c-11e420e29317 tempest-CinderUnicodeTest-1321322603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d3c0b4c6-56e4-44d2-ba9c-2d4bb8630170,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d3c0b4c6-56e4-44d2-ba9c-2d4bb8630170.067c83ec-3b98-4b67-8704-5d4f042fb677 1G" returned: 0 in 0.388s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:20 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-4c983164-9a98-414f-a87c-11e420e29317 tempest-CinderUnicodeTest-1321322603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3c0b4c6-56e4-44d2-ba9c-2d4bb8630170 -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d3c0b4c6-56e4-44d2-ba9c-2d4bb8630170.067c83ec-3b98-4b67-8704-5d4f042fb677 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:20 devstack sudo[104274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3c0b4c6-56e4-44d2-ba9c-2d4bb8630170 -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d3c0b4c6-56e4-44d2-ba9c-2d4bb8630170.067c83ec-3b98-4b67-8704-5d4f042fb677 Sep 23 14:51:20 devstack sudo[104274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:20 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-28527bf1-8271-4fef-a94c-e3810893bfbf tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Acquiring lock "cinder-7a4f89d0-d24a-4b23-a31b-be363560971f-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:51:20 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-28527bf1-8271-4fef-a94c-e3810893bfbf tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Lock "cinder-7a4f89d0-d24a-4b23-a31b-be363560971f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:51:20 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-28527bf1-8271-4fef-a94c-e3810893bfbf tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Acquiring lock "cinder-quobyte-7a4f89d0-d24a-4b23-a31b-be363560971f" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:51:20 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-28527bf1-8271-4fef-a94c-e3810893bfbf tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Lock "cinder-quobyte-7a4f89d0-d24a-4b23-a31b-be363560971f" acquired by "delete_volume" :: waited 0.017s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:51:20 devstack sudo[104274]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:20 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-4c983164-9a98-414f-a87c-11e420e29317 tempest-CinderUnicodeTest-1321322603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3c0b4c6-56e4-44d2-ba9c-2d4bb8630170 -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d3c0b4c6-56e4-44d2-ba9c-2d4bb8630170.067c83ec-3b98-4b67-8704-5d4f042fb677" returned: 0 in 0.322s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:20 devstack cinder-volume[86310]: WARNING cinder.volume.drivers.remotefs [None req-4c983164-9a98-414f-a87c-11e420e29317 tempest-CinderUnicodeTest-1321322603 None] /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d3c0b4c6-56e4-44d2-ba9c-2d4bb8630170.067c83ec-3b98-4b67-8704-5d4f042fb677 is being set with open permissions: ugo+rw Sep 23 14:51:20 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-4c983164-9a98-414f-a87c-11e420e29317 tempest-CinderUnicodeTest-1321322603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d3c0b4c6-56e4-44d2-ba9c-2d4bb8630170.067c83ec-3b98-4b67-8704-5d4f042fb677 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:20 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b906169-927e-4140-a694-cf77bc306ba4]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:51:20 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-28527bf1-8271-4fef-a94c-e3810893bfbf tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7a4f89d0-d24a-4b23-a31b-be363560971f {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:20 devstack sudo[104279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d3c0b4c6-56e4-44d2-ba9c-2d4bb8630170.067c83ec-3b98-4b67-8704-5d4f042fb677 Sep 23 14:51:20 devstack sudo[104279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:20 devstack sudo[104280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7a4f89d0-d24a-4b23-a31b-be363560971f Sep 23 14:51:20 devstack sudo[104280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:20 devstack sudo[104279]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:20 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-4c983164-9a98-414f-a87c-11e420e29317 tempest-CinderUnicodeTest-1321322603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d3c0b4c6-56e4-44d2-ba9c-2d4bb8630170.067c83ec-3b98-4b67-8704-5d4f042fb677" returned: 0 in 0.282s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:20 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-4c983164-9a98-414f-a87c-11e420e29317 tempest-CinderUnicodeTest-1321322603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d3c0b4c6-56e4-44d2-ba9c-2d4bb8630170.info {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:20 devstack sudo[104285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d3c0b4c6-56e4-44d2-ba9c-2d4bb8630170.info Sep 23 14:51:20 devstack sudo[104285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:20 devstack sudo[104280]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:20 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-28527bf1-8271-4fef-a94c-e3810893bfbf tempest-CreateVolumesFromSourceVolumeTest-702571909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7a4f89d0-d24a-4b23-a31b-be363560971f" returned: 0 in 0.417s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:20 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-28527bf1-8271-4fef-a94c-e3810893bfbf tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7a4f89d0-d24a-4b23-a31b-be363560971f {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:20 devstack sudo[104290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7a4f89d0-d24a-4b23-a31b-be363560971f Sep 23 14:51:20 devstack sudo[104290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:20 devstack sudo[104285]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:20 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-4c983164-9a98-414f-a87c-11e420e29317 tempest-CinderUnicodeTest-1321322603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d3c0b4c6-56e4-44d2-ba9c-2d4bb8630170.info" returned: 0 in 0.317s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:20 devstack cinder-volume[86310]: WARNING cinder.volume.drivers.remotefs [None req-4c983164-9a98-414f-a87c-11e420e29317 tempest-CinderUnicodeTest-1321322603 None] /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d3c0b4c6-56e4-44d2-ba9c-2d4bb8630170.info is being set with open permissions: ugo+rw Sep 23 14:51:20 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-4c983164-9a98-414f-a87c-11e420e29317 tempest-CinderUnicodeTest-1321322603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d3c0b4c6-56e4-44d2-ba9c-2d4bb8630170.info {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:21 devstack sudo[104293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d3c0b4c6-56e4-44d2-ba9c-2d4bb8630170.info Sep 23 14:51:21 devstack sudo[104293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:21 devstack sudo[104290]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:21 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-28527bf1-8271-4fef-a94c-e3810893bfbf tempest-CreateVolumesFromSourceVolumeTest-702571909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7a4f89d0-d24a-4b23-a31b-be363560971f" returned: 0 in 0.293s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:21 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-28527bf1-8271-4fef-a94c-e3810893bfbf tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Lock "cinder-quobyte-7a4f89d0-d24a-4b23-a31b-be363560971f" released by "delete_volume" :: held 0.784s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:51:21 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-28527bf1-8271-4fef-a94c-e3810893bfbf tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Created reservations ['f54a9450-c82b-4d47-993e-3c9fda2e933a', '5d9016ce-9c29-4fe8-9cda-956fce2c70be', '46cbbedc-fab4-4464-9e03-739477df32c0', 'f92c4e83-f374-4a97-b599-6a6ff62a1c5b'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:51:21 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-28527bf1-8271-4fef-a94c-e3810893bfbf tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:51:21 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-28527bf1-8271-4fef-a94c-e3810893bfbf tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:51:21 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-28527bf1-8271-4fef-a94c-e3810893bfbf tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:51:21 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-28527bf1-8271-4fef-a94c-e3810893bfbf tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:51:21 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-28527bf1-8271-4fef-a94c-e3810893bfbf tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:51:21 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-28527bf1-8271-4fef-a94c-e3810893bfbf tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:21 devstack sudo[104297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:51:21 devstack sudo[104297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:21 devstack sudo[104293]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:21 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-4c983164-9a98-414f-a87c-11e420e29317 tempest-CinderUnicodeTest-1321322603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d3c0b4c6-56e4-44d2-ba9c-2d4bb8630170.info" returned: 0 in 0.336s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:21 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-4c983164-9a98-414f-a87c-11e420e29317 tempest-CinderUnicodeTest-1321322603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.172s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:51:21 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-71d6eda4-ca92-4241-813b-e2d46a1e5e6f tempest-ProjectReaderTests-1422491147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.305s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:51:21 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-71d6eda4-ca92-4241-813b-e2d46a1e5e6f tempest-ProjectReaderTests-1422491147 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:51:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1293753064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=472054fa-6806-4485-8d0f-4165960dd0a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5480fde18834c20926ef72662381362',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:51:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:51:19Z,use_quota=True,user_id='9c4b6322803a4a9cae974bf15863a243',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:51:21 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-71d6eda4-ca92-4241-813b-e2d46a1e5e6f tempest-ProjectReaderTests-1422491147 None] Creating volume 472054fa-6806-4485-8d0f-4165960dd0a5 {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:51:21 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-71d6eda4-ca92-4241-813b-e2d46a1e5e6f tempest-ProjectReaderTests-1422491147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:51:21 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-71d6eda4-ca92-4241-813b-e2d46a1e5e6f tempest-ProjectReaderTests-1422491147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:51:21 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-71d6eda4-ca92-4241-813b-e2d46a1e5e6f tempest-ProjectReaderTests-1422491147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:51:21 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-71d6eda4-ca92-4241-813b-e2d46a1e5e6f tempest-ProjectReaderTests-1422491147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:51:21 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-71d6eda4-ca92-4241-813b-e2d46a1e5e6f tempest-ProjectReaderTests-1422491147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:51:21 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-71d6eda4-ca92-4241-813b-e2d46a1e5e6f tempest-ProjectReaderTests-1422491147 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:51:21 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-71d6eda4-ca92-4241-813b-e2d46a1e5e6f tempest-ProjectReaderTests-1422491147 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:51:21 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-71d6eda4-ca92-4241-813b-e2d46a1e5e6f tempest-ProjectReaderTests-1422491147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-472054fa-6806-4485-8d0f-4165960dd0a5 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:21 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-05c04d8a-5bed-4256-b37a-641c0cb5e951 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Acquiring lock "cinder-d878cad7-6c04-49af-804d-20068bb6d946-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:51:21 devstack sudo[104299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-472054fa-6806-4485-8d0f-4165960dd0a5 1073741824 Sep 23 14:51:21 devstack sudo[104299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:21 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-05c04d8a-5bed-4256-b37a-641c0cb5e951 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Lock "cinder-d878cad7-6c04-49af-804d-20068bb6d946-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:51:21 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-4c983164-9a98-414f-a87c-11e420e29317 tempest-CinderUnicodeTest-1321322603 None] Create snapshot completed successfully Sep 23 14:51:21 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-05c04d8a-5bed-4256-b37a-641c0cb5e951 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Acquiring lock "cinder-quobyte-d878cad7-6c04-49af-804d-20068bb6d946" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:51:21 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-05c04d8a-5bed-4256-b37a-641c0cb5e951 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Lock "cinder-quobyte-d878cad7-6c04-49af-804d-20068bb6d946" acquired by "delete_volume" :: waited 0.019s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:51:21 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[08ea616e-44a6-4f14-9220-3e78fb74dc95]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:51:21 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-05c04d8a-5bed-4256-b37a-641c0cb5e951 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d878cad7-6c04-49af-804d-20068bb6d946 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:21 devstack sudo[104297]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:21 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-28527bf1-8271-4fef-a94c-e3810893bfbf tempest-CreateVolumesFromSourceVolumeTest-702571909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.344s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:21 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-28527bf1-8271-4fef-a94c-e3810893bfbf tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:51:21 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-28527bf1-8271-4fef-a94c-e3810893bfbf tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Deleted volume successfully. Sep 23 14:51:21 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-28527bf1-8271-4fef-a94c-e3810893bfbf tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Lock "cinder-7a4f89d0-d24a-4b23-a31b-be363560971f-delete_volume" released by "delete_volume" :: held 1.445s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:51:21 devstack sudo[104302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d878cad7-6c04-49af-804d-20068bb6d946 Sep 23 14:51:21 devstack sudo[104302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:21 devstack sudo[104299]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:22 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-71d6eda4-ca92-4241-813b-e2d46a1e5e6f tempest-ProjectReaderTests-1422491147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-472054fa-6806-4485-8d0f-4165960dd0a5 1073741824" returned: 0 in 0.639s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:22 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-71d6eda4-ca92-4241-813b-e2d46a1e5e6f tempest-ProjectReaderTests-1422491147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-472054fa-6806-4485-8d0f-4165960dd0a5 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:22 devstack sudo[104302]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:22 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-e4b75f3f-7f1e-4aeb-bb6b-8a641a2c24cd tempest-CinderUnicodeTest-1321322603 None] Acquiring lock "cinder-067c83ec-3b98-4b67-8704-5d4f042fb677-delete_snapshot" by "delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:51:22 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-05c04d8a-5bed-4256-b37a-641c0cb5e951 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d878cad7-6c04-49af-804d-20068bb6d946" returned: 0 in 0.546s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:22 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-05c04d8a-5bed-4256-b37a-641c0cb5e951 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d878cad7-6c04-49af-804d-20068bb6d946 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:22 devstack sudo[104311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-472054fa-6806-4485-8d0f-4165960dd0a5 Sep 23 14:51:22 devstack sudo[104311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:22 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-e4b75f3f-7f1e-4aeb-bb6b-8a641a2c24cd tempest-CinderUnicodeTest-1321322603 None] Lock "cinder-067c83ec-3b98-4b67-8704-5d4f042fb677-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:51:22 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-e4b75f3f-7f1e-4aeb-bb6b-8a641a2c24cd tempest-CinderUnicodeTest-1321322603 None] Acquiring lock "cinder-quobyte-d3c0b4c6-56e4-44d2-ba9c-2d4bb8630170" by "delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:51:22 devstack sudo[104312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d878cad7-6c04-49af-804d-20068bb6d946 Sep 23 14:51:22 devstack sudo[104312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:22 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-e4b75f3f-7f1e-4aeb-bb6b-8a641a2c24cd tempest-CinderUnicodeTest-1321322603 None] Lock "cinder-quobyte-d3c0b4c6-56e4-44d2-ba9c-2d4bb8630170" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:51:22 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-e4b75f3f-7f1e-4aeb-bb6b-8a641a2c24cd tempest-CinderUnicodeTest-1321322603 None] Acquiring lock "cinder-quobyte-067c83ec-3b98-4b67-8704-5d4f042fb677" by "_delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:51:22 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-e4b75f3f-7f1e-4aeb-bb6b-8a641a2c24cd tempest-CinderUnicodeTest-1321322603 None] Lock "cinder-quobyte-067c83ec-3b98-4b67-8704-5d4f042fb677" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:51:22 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-e4b75f3f-7f1e-4aeb-bb6b-8a641a2c24cd tempest-CinderUnicodeTest-1321322603 None] Deleting offline snapshot 067c83ec-3b98-4b67-8704-5d4f042fb677 of volume d3c0b4c6-56e4-44d2-ba9c-2d4bb8630170 {{(pid=86310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 14:51:22 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-e4b75f3f-7f1e-4aeb-bb6b-8a641a2c24cd tempest-CinderUnicodeTest-1321322603 None] snapshot_file for this snap is: volume-d3c0b4c6-56e4-44d2-ba9c-2d4bb8630170.067c83ec-3b98-4b67-8704-5d4f042fb677 {{(pid=86310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 14:51:22 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[d04afca9-95e7-4d67-875c-f6504620b27c]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:51:22 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-e4b75f3f-7f1e-4aeb-bb6b-8a641a2c24cd tempest-CinderUnicodeTest-1321322603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d3c0b4c6-56e4-44d2-ba9c-2d4bb8630170.067c83ec-3b98-4b67-8704-5d4f042fb677 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:22 devstack sudo[104315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d3c0b4c6-56e4-44d2-ba9c-2d4bb8630170.067c83ec-3b98-4b67-8704-5d4f042fb677 Sep 23 14:51:22 devstack sudo[104315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:22 devstack sudo[104312]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:22 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-05c04d8a-5bed-4256-b37a-641c0cb5e951 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d878cad7-6c04-49af-804d-20068bb6d946" returned: 0 in 0.321s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:22 devstack sudo[104311]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:22 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-05c04d8a-5bed-4256-b37a-641c0cb5e951 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Lock "cinder-quobyte-d878cad7-6c04-49af-804d-20068bb6d946" released by "delete_volume" :: held 0.939s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:51:22 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-71d6eda4-ca92-4241-813b-e2d46a1e5e6f tempest-ProjectReaderTests-1422491147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-472054fa-6806-4485-8d0f-4165960dd0a5" returned: 0 in 0.398s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:22 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-71d6eda4-ca92-4241-813b-e2d46a1e5e6f tempest-ProjectReaderTests-1422491147 None] <== create_volume: return (1112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:51:22 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-71d6eda4-ca92-4241-813b-e2d46a1e5e6f tempest-ProjectReaderTests-1422491147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.116s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:51:22 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-71d6eda4-ca92-4241-813b-e2d46a1e5e6f tempest-ProjectReaderTests-1422491147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52d3f1d5-94f9-42cb-b78a-dd0a5e7dd38e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-472054fa-6806-4485-8d0f-4165960dd0a5', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:22 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-71d6eda4-ca92-4241-813b-e2d46a1e5e6f tempest-ProjectReaderTests-1422491147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1f422cf-2bba-4c05-b812-e92ed206f670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:22 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-71d6eda4-ca92-4241-813b-e2d46a1e5e6f tempest-ProjectReaderTests-1422491147 None] Volume volume-472054fa-6806-4485-8d0f-4165960dd0a5 (472054fa-6806-4485-8d0f-4165960dd0a5): created successfully Sep 23 14:51:22 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-71d6eda4-ca92-4241-813b-e2d46a1e5e6f tempest-ProjectReaderTests-1422491147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1f422cf-2bba-4c05-b812-e92ed206f670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:22 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-71d6eda4-ca92-4241-813b-e2d46a1e5e6f tempest-ProjectReaderTests-1422491147 None] Flow 'volume_create_manager' (1224b7ba-b9d3-4fa4-8375-047f57802e69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:51:22 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-71d6eda4-ca92-4241-813b-e2d46a1e5e6f tempest-ProjectReaderTests-1422491147 None] Created volume successfully. Sep 23 14:51:22 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-05c04d8a-5bed-4256-b37a-641c0cb5e951 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Created reservations ['fab7a698-f7e4-4033-bda6-f1919b8b3d9d', '8bd43ff3-c574-4b53-b050-ce174a6f74ca', 'db8c28c8-fab7-4cfb-ba10-5483605acd9b', '53664576-5d0e-4d8f-b634-6fb3cbca73a6'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:51:22 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-05c04d8a-5bed-4256-b37a-641c0cb5e951 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:51:22 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-05c04d8a-5bed-4256-b37a-641c0cb5e951 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:51:22 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-05c04d8a-5bed-4256-b37a-641c0cb5e951 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:51:22 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-05c04d8a-5bed-4256-b37a-641c0cb5e951 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:51:22 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-05c04d8a-5bed-4256-b37a-641c0cb5e951 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:51:22 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-05c04d8a-5bed-4256-b37a-641c0cb5e951 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:22 devstack sudo[104327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:51:22 devstack sudo[104327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:22 devstack sudo[104315]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:22 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-e4b75f3f-7f1e-4aeb-bb6b-8a641a2c24cd tempest-CinderUnicodeTest-1321322603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d3c0b4c6-56e4-44d2-ba9c-2d4bb8630170.067c83ec-3b98-4b67-8704-5d4f042fb677" returned: 0 in 0.447s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:22 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-e4b75f3f-7f1e-4aeb-bb6b-8a641a2c24cd tempest-CinderUnicodeTest-1321322603 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d3c0b4c6-56e4-44d2-ba9c-2d4bb8630170(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 14:51:22 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[c32ea7e1-b684-4858-b4d2-04fbf104d1af]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:51:22 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-e4b75f3f-7f1e-4aeb-bb6b-8a641a2c24cd tempest-CinderUnicodeTest-1321322603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d3c0b4c6-56e4-44d2-ba9c-2d4bb8630170 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:22 devstack sudo[104329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d3c0b4c6-56e4-44d2-ba9c-2d4bb8630170 Sep 23 14:51:22 devstack sudo[104329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:22 devstack sudo[104327]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:22 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-05c04d8a-5bed-4256-b37a-641c0cb5e951 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.267s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:22 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-05c04d8a-5bed-4256-b37a-641c0cb5e951 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:51:22 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-05c04d8a-5bed-4256-b37a-641c0cb5e951 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Deleted volume successfully. Sep 23 14:51:22 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-05c04d8a-5bed-4256-b37a-641c0cb5e951 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Lock "cinder-d878cad7-6c04-49af-804d-20068bb6d946-delete_volume" released by "delete_volume" :: held 1.549s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:51:23 devstack sudo[104329]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:23 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-e4b75f3f-7f1e-4aeb-bb6b-8a641a2c24cd tempest-CinderUnicodeTest-1321322603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d3c0b4c6-56e4-44d2-ba9c-2d4bb8630170" returned: 0 in 0.461s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:23 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-e4b75f3f-7f1e-4aeb-bb6b-8a641a2c24cd tempest-CinderUnicodeTest-1321322603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d3c0b4c6-56e4-44d2-ba9c-2d4bb8630170.067c83ec-3b98-4b67-8704-5d4f042fb677 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:23 devstack sudo[104336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d3c0b4c6-56e4-44d2-ba9c-2d4bb8630170.067c83ec-3b98-4b67-8704-5d4f042fb677 Sep 23 14:51:23 devstack sudo[104336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:23 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-903de471-7840-4d04-b6f6-26117c594f0f tempest-ProjectReaderTests-1422491147 None] Acquiring lock "cinder-472054fa-6806-4485-8d0f-4165960dd0a5-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:51:23 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-903de471-7840-4d04-b6f6-26117c594f0f tempest-ProjectReaderTests-1422491147 None] Lock "cinder-472054fa-6806-4485-8d0f-4165960dd0a5-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:51:23 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-903de471-7840-4d04-b6f6-26117c594f0f tempest-ProjectReaderTests-1422491147 None] Acquiring lock "cinder-quobyte-472054fa-6806-4485-8d0f-4165960dd0a5" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:51:23 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-903de471-7840-4d04-b6f6-26117c594f0f tempest-ProjectReaderTests-1422491147 None] Lock "cinder-quobyte-472054fa-6806-4485-8d0f-4165960dd0a5" acquired by "delete_volume" :: waited 0.020s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:51:23 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[abdaa7ef-e771-41b0-8120-8458d93af91c]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:51:23 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-903de471-7840-4d04-b6f6-26117c594f0f tempest-ProjectReaderTests-1422491147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-472054fa-6806-4485-8d0f-4165960dd0a5 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:23 devstack sudo[104338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-472054fa-6806-4485-8d0f-4165960dd0a5 Sep 23 14:51:23 devstack sudo[104338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:23 devstack sudo[104336]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:23 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-e4b75f3f-7f1e-4aeb-bb6b-8a641a2c24cd tempest-CinderUnicodeTest-1321322603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d3c0b4c6-56e4-44d2-ba9c-2d4bb8630170.067c83ec-3b98-4b67-8704-5d4f042fb677" returned: 0 in 0.445s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:23 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-e4b75f3f-7f1e-4aeb-bb6b-8a641a2c24cd tempest-CinderUnicodeTest-1321322603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d3c0b4c6-56e4-44d2-ba9c-2d4bb8630170.067c83ec-3b98-4b67-8704-5d4f042fb677 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:23 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-4d7f12ab-4e50-404b-8c5e-ecdf483a267c tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Acquiring lock "cinder-44506418-87c5-4786-b2df-89b8e94aba18-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:51:23 devstack sudo[104343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d3c0b4c6-56e4-44d2-ba9c-2d4bb8630170.067c83ec-3b98-4b67-8704-5d4f042fb677 Sep 23 14:51:23 devstack sudo[104343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:23 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-4d7f12ab-4e50-404b-8c5e-ecdf483a267c tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Lock "cinder-44506418-87c5-4786-b2df-89b8e94aba18-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:51:23 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-4d7f12ab-4e50-404b-8c5e-ecdf483a267c tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Acquiring lock "cinder-quobyte-44506418-87c5-4786-b2df-89b8e94aba18" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:51:23 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-4d7f12ab-4e50-404b-8c5e-ecdf483a267c tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Lock "cinder-quobyte-44506418-87c5-4786-b2df-89b8e94aba18" acquired by "delete_volume" :: waited 0.022s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:51:23 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb549781-3248-4eff-aaed-ef92f8aa0475]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:51:23 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-4d7f12ab-4e50-404b-8c5e-ecdf483a267c tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-44506418-87c5-4786-b2df-89b8e94aba18 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:23 devstack sudo[104338]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:23 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-903de471-7840-4d04-b6f6-26117c594f0f tempest-ProjectReaderTests-1422491147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-472054fa-6806-4485-8d0f-4165960dd0a5" returned: 0 in 0.484s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:23 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-903de471-7840-4d04-b6f6-26117c594f0f tempest-ProjectReaderTests-1422491147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-472054fa-6806-4485-8d0f-4165960dd0a5 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:23 devstack sudo[104349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-472054fa-6806-4485-8d0f-4165960dd0a5 Sep 23 14:51:23 devstack sudo[104349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:23 devstack sudo[104348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-44506418-87c5-4786-b2df-89b8e94aba18 Sep 23 14:51:23 devstack sudo[104348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:24 devstack sudo[104343]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:24 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-e4b75f3f-7f1e-4aeb-bb6b-8a641a2c24cd tempest-CinderUnicodeTest-1321322603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d3c0b4c6-56e4-44d2-ba9c-2d4bb8630170.067c83ec-3b98-4b67-8704-5d4f042fb677" returned: 0 in 0.412s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:24 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ec80032-6b6b-4a1e-b77b-5c2c9092df82 tempest-VolumeDependencyTests-1903059066 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:51:24 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-8ec80032-6b6b-4a1e-b77b-5c2c9092df82 tempest-VolumeDependencyTests-1903059066 None] Flow 'volume_create_manager' (98937a03-6748-47a1-ba65-0d8df32ce4df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:51:24 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-8ec80032-6b6b-4a1e-b77b-5c2c9092df82 tempest-VolumeDependencyTests-1903059066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b4096fa-59a3-4d6b-9d59-e73e8ccc467b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:24 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-e4b75f3f-7f1e-4aeb-bb6b-8a641a2c24cd tempest-CinderUnicodeTest-1321322603 None] Lock "cinder-quobyte-067c83ec-3b98-4b67-8704-5d4f042fb677" released by "_delete_snapshot" :: held 1.963s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:51:24 devstack sudo[104349]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:24 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-8ec80032-6b6b-4a1e-b77b-5c2c9092df82 tempest-VolumeDependencyTests-1903059066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b4096fa-59a3-4d6b-9d59-e73e8ccc467b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:51:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1458464564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=574a9942-452f-4442-8e8f-b5cedb2ccd0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51f6d28d27a14ac382b6c352bfba59a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:51:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:51:24Z,use_quota=True,user_id='6db0658af1b945869b07813e0165ccb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:24 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-8ec80032-6b6b-4a1e-b77b-5c2c9092df82 tempest-VolumeDependencyTests-1903059066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (781b8636-ea65-4881-a8c2-0d82c03e991e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:24 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-8ec80032-6b6b-4a1e-b77b-5c2c9092df82 tempest-VolumeDependencyTests-1903059066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (781b8636-ea65-4881-a8c2-0d82c03e991e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:24 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-8ec80032-6b6b-4a1e-b77b-5c2c9092df82 tempest-VolumeDependencyTests-1903059066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (135a74c3-0843-44ad-8653-3c6e34dc2c47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:24 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-8ec80032-6b6b-4a1e-b77b-5c2c9092df82 tempest-VolumeDependencyTests-1903059066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (135a74c3-0843-44ad-8653-3c6e34dc2c47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '574a9942-452f-4442-8e8f-b5cedb2ccd0d', 'volume_name': 'volume-574a9942-452f-4442-8e8f-b5cedb2ccd0d', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:24 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-8ec80032-6b6b-4a1e-b77b-5c2c9092df82 tempest-VolumeDependencyTests-1903059066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09477f53-7df7-4ece-b210-4c8c4a86d331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:24 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-8ec80032-6b6b-4a1e-b77b-5c2c9092df82 tempest-VolumeDependencyTests-1903059066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09477f53-7df7-4ece-b210-4c8c4a86d331) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:24 devstack sudo[104348]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:24 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-8ec80032-6b6b-4a1e-b77b-5c2c9092df82 tempest-VolumeDependencyTests-1903059066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8ac070f-2d2c-46ce-9c1c-f08671d0f537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:24 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-8ec80032-6b6b-4a1e-b77b-5c2c9092df82 tempest-VolumeDependencyTests-1903059066 None] Volume 574a9942-452f-4442-8e8f-b5cedb2ccd0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-574a9942-452f-4442-8e8f-b5cedb2ccd0d', 'volume_size': 1} Sep 23 14:51:24 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-8ec80032-6b6b-4a1e-b77b-5c2c9092df82 tempest-VolumeDependencyTests-1903059066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:51:24 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-8ec80032-6b6b-4a1e-b77b-5c2c9092df82 tempest-VolumeDependencyTests-1903059066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:51:24 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-8ec80032-6b6b-4a1e-b77b-5c2c9092df82 tempest-VolumeDependencyTests-1903059066 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:51:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1458464564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=574a9942-452f-4442-8e8f-b5cedb2ccd0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51f6d28d27a14ac382b6c352bfba59a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:51:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:51:24Z,use_quota=True,user_id='6db0658af1b945869b07813e0165ccb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:51:24 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-8ec80032-6b6b-4a1e-b77b-5c2c9092df82 tempest-VolumeDependencyTests-1903059066 None] Creating volume 574a9942-452f-4442-8e8f-b5cedb2ccd0d {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:51:24 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-8ec80032-6b6b-4a1e-b77b-5c2c9092df82 tempest-VolumeDependencyTests-1903059066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:51:24 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-8ec80032-6b6b-4a1e-b77b-5c2c9092df82 tempest-VolumeDependencyTests-1903059066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:51:24 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-8ec80032-6b6b-4a1e-b77b-5c2c9092df82 tempest-VolumeDependencyTests-1903059066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:51:24 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-8ec80032-6b6b-4a1e-b77b-5c2c9092df82 tempest-VolumeDependencyTests-1903059066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:51:24 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-8ec80032-6b6b-4a1e-b77b-5c2c9092df82 tempest-VolumeDependencyTests-1903059066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:51:24 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-8ec80032-6b6b-4a1e-b77b-5c2c9092df82 tempest-VolumeDependencyTests-1903059066 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:51:24 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-8ec80032-6b6b-4a1e-b77b-5c2c9092df82 tempest-VolumeDependencyTests-1903059066 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:51:24 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8ec80032-6b6b-4a1e-b77b-5c2c9092df82 tempest-VolumeDependencyTests-1903059066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-574a9942-452f-4442-8e8f-b5cedb2ccd0d 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:24 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-e4b75f3f-7f1e-4aeb-bb6b-8a641a2c24cd tempest-CinderUnicodeTest-1321322603 None] Lock "cinder-quobyte-d3c0b4c6-56e4-44d2-ba9c-2d4bb8630170" released by "delete_snapshot" :: held 2.079s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:51:24 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-903de471-7840-4d04-b6f6-26117c594f0f tempest-ProjectReaderTests-1422491147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-472054fa-6806-4485-8d0f-4165960dd0a5" returned: 0 in 0.369s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:24 devstack sudo[104357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-574a9942-452f-4442-8e8f-b5cedb2ccd0d 1073741824 Sep 23 14:51:24 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-4d7f12ab-4e50-404b-8c5e-ecdf483a267c tempest-CreateVolumesFromSourceVolumeTest-702571909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-44506418-87c5-4786-b2df-89b8e94aba18" returned: 0 in 0.463s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:24 devstack sudo[104357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:24 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-4d7f12ab-4e50-404b-8c5e-ecdf483a267c tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-44506418-87c5-4786-b2df-89b8e94aba18 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:24 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-903de471-7840-4d04-b6f6-26117c594f0f tempest-ProjectReaderTests-1422491147 None] Lock "cinder-quobyte-472054fa-6806-4485-8d0f-4165960dd0a5" released by "delete_volume" :: held 0.915s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:51:24 devstack sudo[104359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-44506418-87c5-4786-b2df-89b8e94aba18 Sep 23 14:51:24 devstack sudo[104359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:24 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-903de471-7840-4d04-b6f6-26117c594f0f tempest-ProjectReaderTests-1422491147 None] Created reservations ['202adfab-7525-40bc-9bda-6ab4bee9423c', '36e68579-df86-4a9d-99d7-b5378a210837', 'ed78fd00-30c2-443f-b7e4-9b7221c64f66', 'faa0ead2-2a86-487a-8969-d4c7ca5629b6'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:51:24 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-e4b75f3f-7f1e-4aeb-bb6b-8a641a2c24cd tempest-CinderUnicodeTest-1321322603 None] Created reservations ['3c22c67e-2e72-405f-8169-64979dd636c8', '8c124560-c808-43de-a294-c02c2461a5c3', '79ac2385-480c-4e9c-bf16-5b876a7c5cb6', 'c5752134-fd83-4fc3-add8-bb2b3188aa5e'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:51:24 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-e4b75f3f-7f1e-4aeb-bb6b-8a641a2c24cd tempest-CinderUnicodeTest-1321322603 None] Delete snapshot completed successfully. Sep 23 14:51:24 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-e4b75f3f-7f1e-4aeb-bb6b-8a641a2c24cd tempest-CinderUnicodeTest-1321322603 None] Lock "cinder-067c83ec-3b98-4b67-8704-5d4f042fb677-delete_snapshot" released by "delete_snapshot" :: held 2.352s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:51:24 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-903de471-7840-4d04-b6f6-26117c594f0f tempest-ProjectReaderTests-1422491147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:51:24 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-903de471-7840-4d04-b6f6-26117c594f0f tempest-ProjectReaderTests-1422491147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:51:24 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-903de471-7840-4d04-b6f6-26117c594f0f tempest-ProjectReaderTests-1422491147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:51:24 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-903de471-7840-4d04-b6f6-26117c594f0f tempest-ProjectReaderTests-1422491147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:51:24 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-903de471-7840-4d04-b6f6-26117c594f0f tempest-ProjectReaderTests-1422491147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:51:24 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-903de471-7840-4d04-b6f6-26117c594f0f tempest-ProjectReaderTests-1422491147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:24 devstack sudo[104364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:51:24 devstack sudo[104364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:24 devstack sudo[104359]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:24 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-4d7f12ab-4e50-404b-8c5e-ecdf483a267c tempest-CreateVolumesFromSourceVolumeTest-702571909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-44506418-87c5-4786-b2df-89b8e94aba18" returned: 0 in 0.299s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:24 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-4d7f12ab-4e50-404b-8c5e-ecdf483a267c tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Lock "cinder-quobyte-44506418-87c5-4786-b2df-89b8e94aba18" released by "delete_volume" :: held 0.817s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:51:24 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-4d7f12ab-4e50-404b-8c5e-ecdf483a267c tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Created reservations ['c2225f0f-f2ff-42ab-9dd0-bf07897c71f7', '6ae56c44-1a8d-471e-a58c-5db501b27fa4', '52523f56-f8ab-43ae-ad70-efb317fbf7bc', 'fcf56af7-16cc-4045-962e-9e2e0797e609'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:51:24 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-4d7f12ab-4e50-404b-8c5e-ecdf483a267c tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:51:24 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-4d7f12ab-4e50-404b-8c5e-ecdf483a267c tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:51:24 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-4d7f12ab-4e50-404b-8c5e-ecdf483a267c tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:51:24 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-4d7f12ab-4e50-404b-8c5e-ecdf483a267c tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:51:24 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-4d7f12ab-4e50-404b-8c5e-ecdf483a267c tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:51:24 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-4d7f12ab-4e50-404b-8c5e-ecdf483a267c tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:24 devstack sudo[104368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:51:24 devstack sudo[104368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:24 devstack sudo[104357]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:24 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8ec80032-6b6b-4a1e-b77b-5c2c9092df82 tempest-VolumeDependencyTests-1903059066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-574a9942-452f-4442-8e8f-b5cedb2ccd0d 1073741824" returned: 0 in 0.508s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:24 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8ec80032-6b6b-4a1e-b77b-5c2c9092df82 tempest-VolumeDependencyTests-1903059066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-574a9942-452f-4442-8e8f-b5cedb2ccd0d {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:24 devstack sudo[104364]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:24 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-903de471-7840-4d04-b6f6-26117c594f0f tempest-ProjectReaderTests-1422491147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.288s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:24 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-903de471-7840-4d04-b6f6-26117c594f0f tempest-ProjectReaderTests-1422491147 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:51:24 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-903de471-7840-4d04-b6f6-26117c594f0f tempest-ProjectReaderTests-1422491147 None] Deleted volume successfully. Sep 23 14:51:24 devstack sudo[104371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-574a9942-452f-4442-8e8f-b5cedb2ccd0d Sep 23 14:51:24 devstack sudo[104371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:24 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-903de471-7840-4d04-b6f6-26117c594f0f tempest-ProjectReaderTests-1422491147 None] Lock "cinder-472054fa-6806-4485-8d0f-4165960dd0a5-delete_volume" released by "delete_volume" :: held 1.553s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:51:24 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-1815113a-5c26-40fe-9005-96cd6f60e67e tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Acquiring lock "cinder-7159b520-d496-429f-b4ad-104765980edb-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:51:24 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-1815113a-5c26-40fe-9005-96cd6f60e67e tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Lock "cinder-7159b520-d496-429f-b4ad-104765980edb-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:51:24 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-1815113a-5c26-40fe-9005-96cd6f60e67e tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Acquiring lock "cinder-quobyte-7159b520-d496-429f-b4ad-104765980edb" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:51:25 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-1815113a-5c26-40fe-9005-96cd6f60e67e tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Lock "cinder-quobyte-7159b520-d496-429f-b4ad-104765980edb" acquired by "delete_volume" :: waited 0.024s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:51:25 devstack sudo[104368]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:25 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-4d7f12ab-4e50-404b-8c5e-ecdf483a267c tempest-CreateVolumesFromSourceVolumeTest-702571909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.308s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:25 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-4d7f12ab-4e50-404b-8c5e-ecdf483a267c tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:51:25 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-4d7f12ab-4e50-404b-8c5e-ecdf483a267c tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Deleted volume successfully. Sep 23 14:51:25 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[317549bd-1da2-4062-81e6-53bba14a38d5]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:51:25 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-1815113a-5c26-40fe-9005-96cd6f60e67e tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7159b520-d496-429f-b4ad-104765980edb {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:25 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-4d7f12ab-4e50-404b-8c5e-ecdf483a267c tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Lock "cinder-44506418-87c5-4786-b2df-89b8e94aba18-delete_volume" released by "delete_volume" :: held 1.352s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:51:25 devstack sudo[104371]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:25 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8ec80032-6b6b-4a1e-b77b-5c2c9092df82 tempest-VolumeDependencyTests-1903059066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-574a9942-452f-4442-8e8f-b5cedb2ccd0d" returned: 0 in 0.325s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:25 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-8ec80032-6b6b-4a1e-b77b-5c2c9092df82 tempest-VolumeDependencyTests-1903059066 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:51:25 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-8ec80032-6b6b-4a1e-b77b-5c2c9092df82 tempest-VolumeDependencyTests-1903059066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:51:25 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-8ec80032-6b6b-4a1e-b77b-5c2c9092df82 tempest-VolumeDependencyTests-1903059066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8ac070f-2d2c-46ce-9c1c-f08671d0f537) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-574a9942-452f-4442-8e8f-b5cedb2ccd0d', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:25 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-8ec80032-6b6b-4a1e-b77b-5c2c9092df82 tempest-VolumeDependencyTests-1903059066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c1cba88-c1c3-4f75-9ad8-0a973e3e9e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:25 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-8ec80032-6b6b-4a1e-b77b-5c2c9092df82 tempest-VolumeDependencyTests-1903059066 None] Volume volume-574a9942-452f-4442-8e8f-b5cedb2ccd0d (574a9942-452f-4442-8e8f-b5cedb2ccd0d): created successfully Sep 23 14:51:25 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-8ec80032-6b6b-4a1e-b77b-5c2c9092df82 tempest-VolumeDependencyTests-1903059066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c1cba88-c1c3-4f75-9ad8-0a973e3e9e87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:25 devstack sudo[104374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7159b520-d496-429f-b4ad-104765980edb Sep 23 14:51:25 devstack sudo[104374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:25 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-8ec80032-6b6b-4a1e-b77b-5c2c9092df82 tempest-VolumeDependencyTests-1903059066 None] Flow 'volume_create_manager' (98937a03-6748-47a1-ba65-0d8df32ce4df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:51:25 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-8ec80032-6b6b-4a1e-b77b-5c2c9092df82 tempest-VolumeDependencyTests-1903059066 None] Created volume successfully. Sep 23 14:51:25 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-ac1736a6-927d-4828-8c1e-ea8565b70139 tempest-CinderUnicodeTest-1321322603 None] Acquiring lock "cinder-d3c0b4c6-56e4-44d2-ba9c-2d4bb8630170-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:51:25 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-ac1736a6-927d-4828-8c1e-ea8565b70139 tempest-CinderUnicodeTest-1321322603 None] Lock "cinder-d3c0b4c6-56e4-44d2-ba9c-2d4bb8630170-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:51:25 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-ac1736a6-927d-4828-8c1e-ea8565b70139 tempest-CinderUnicodeTest-1321322603 None] Acquiring lock "cinder-quobyte-d3c0b4c6-56e4-44d2-ba9c-2d4bb8630170" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:51:25 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-ac1736a6-927d-4828-8c1e-ea8565b70139 tempest-CinderUnicodeTest-1321322603 None] Lock "cinder-quobyte-d3c0b4c6-56e4-44d2-ba9c-2d4bb8630170" acquired by "delete_volume" :: waited 0.026s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:51:25 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[232b00d6-6ef6-4e34-8d14-891b0fdddefc]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:51:25 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ac1736a6-927d-4828-8c1e-ea8565b70139 tempest-CinderUnicodeTest-1321322603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d3c0b4c6-56e4-44d2-ba9c-2d4bb8630170 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:25 devstack sudo[104374]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:25 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-1815113a-5c26-40fe-9005-96cd6f60e67e tempest-CreateVolumesFromSourceVolumeTest-702571909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7159b520-d496-429f-b4ad-104765980edb" returned: 0 in 0.414s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:25 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-1815113a-5c26-40fe-9005-96cd6f60e67e tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7159b520-d496-429f-b4ad-104765980edb {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:25 devstack sudo[104381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7159b520-d496-429f-b4ad-104765980edb Sep 23 14:51:25 devstack sudo[104381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:25 devstack sudo[104380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d3c0b4c6-56e4-44d2-ba9c-2d4bb8630170 Sep 23 14:51:25 devstack sudo[104380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:25 devstack sudo[104381]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:25 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-1815113a-5c26-40fe-9005-96cd6f60e67e tempest-CreateVolumesFromSourceVolumeTest-702571909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7159b520-d496-429f-b4ad-104765980edb" returned: 0 in 0.284s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:25 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-1815113a-5c26-40fe-9005-96cd6f60e67e tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Lock "cinder-quobyte-7159b520-d496-429f-b4ad-104765980edb" released by "delete_volume" :: held 0.757s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:51:25 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-1815113a-5c26-40fe-9005-96cd6f60e67e tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Created reservations ['15dfccb8-9109-4eb7-9da8-a17fbe7e1a2f', 'e3de6b16-859e-4dfc-9fd2-41edb4bdc6e8', '155bebd8-d55f-4735-8189-d2b85aa573f4', '7948996e-f6d1-4fea-9177-6844bf4d5efa'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:51:25 devstack sudo[104380]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:25 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ac1736a6-927d-4828-8c1e-ea8565b70139 tempest-CinderUnicodeTest-1321322603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d3c0b4c6-56e4-44d2-ba9c-2d4bb8630170" returned: 0 in 0.418s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:25 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ac1736a6-927d-4828-8c1e-ea8565b70139 tempest-CinderUnicodeTest-1321322603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d3c0b4c6-56e4-44d2-ba9c-2d4bb8630170 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:25 devstack sudo[104388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d3c0b4c6-56e4-44d2-ba9c-2d4bb8630170 Sep 23 14:51:25 devstack sudo[104388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:25 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-1815113a-5c26-40fe-9005-96cd6f60e67e tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:51:25 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-1815113a-5c26-40fe-9005-96cd6f60e67e tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:51:25 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-1815113a-5c26-40fe-9005-96cd6f60e67e tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:51:25 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-1815113a-5c26-40fe-9005-96cd6f60e67e tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:51:25 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-1815113a-5c26-40fe-9005-96cd6f60e67e tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:51:25 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-1815113a-5c26-40fe-9005-96cd6f60e67e tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:25 devstack sudo[104390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:51:25 devstack sudo[104390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:26 devstack sudo[104388]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:26 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-49913253-0f31-4090-8c2f-c217976f49b7 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Acquiring lock "cinder-bfb0a89e-bcc9-4028-8cea-205c5945260d-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:51:26 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ac1736a6-927d-4828-8c1e-ea8565b70139 tempest-CinderUnicodeTest-1321322603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d3c0b4c6-56e4-44d2-ba9c-2d4bb8630170" returned: 0 in 0.330s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:26 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-32f33f89-7db1-47d7-9246-e3f978187f9b tempest-ProjectReaderTests-1422491147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:51:26 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-32f33f89-7db1-47d7-9246-e3f978187f9b tempest-ProjectReaderTests-1422491147 None] Flow 'volume_create_manager' (bbe9e7d3-5788-4a6b-ad69-2a79231b2f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:51:26 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-32f33f89-7db1-47d7-9246-e3f978187f9b tempest-ProjectReaderTests-1422491147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89377ab0-36a4-4b80-94f0-94a65273a02a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:26 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-ac1736a6-927d-4828-8c1e-ea8565b70139 tempest-CinderUnicodeTest-1321322603 None] Lock "cinder-quobyte-d3c0b4c6-56e4-44d2-ba9c-2d4bb8630170" released by "delete_volume" :: held 0.862s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:51:26 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-49913253-0f31-4090-8c2f-c217976f49b7 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Lock "cinder-bfb0a89e-bcc9-4028-8cea-205c5945260d-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:51:26 devstack sudo[104390]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:26 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-1815113a-5c26-40fe-9005-96cd6f60e67e tempest-CreateVolumesFromSourceVolumeTest-702571909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.330s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:26 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-1815113a-5c26-40fe-9005-96cd6f60e67e tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:51:26 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-32f33f89-7db1-47d7-9246-e3f978187f9b tempest-ProjectReaderTests-1422491147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89377ab0-36a4-4b80-94f0-94a65273a02a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:51:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-248227031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21f19080-c179-4d81-86f7-c69c94b1609c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5480fde18834c20926ef72662381362',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:51:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:51:26Z,use_quota=True,user_id='9c4b6322803a4a9cae974bf15863a243',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:26 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-32f33f89-7db1-47d7-9246-e3f978187f9b tempest-ProjectReaderTests-1422491147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93e211a2-5cc3-48cc-bac9-f956951e970d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:26 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-32f33f89-7db1-47d7-9246-e3f978187f9b tempest-ProjectReaderTests-1422491147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93e211a2-5cc3-48cc-bac9-f956951e970d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:26 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-32f33f89-7db1-47d7-9246-e3f978187f9b tempest-ProjectReaderTests-1422491147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae89c6f8-1fda-49b8-a024-bcd713c4241c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:26 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-32f33f89-7db1-47d7-9246-e3f978187f9b tempest-ProjectReaderTests-1422491147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae89c6f8-1fda-49b8-a024-bcd713c4241c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21f19080-c179-4d81-86f7-c69c94b1609c', 'volume_name': 'volume-21f19080-c179-4d81-86f7-c69c94b1609c', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:26 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-32f33f89-7db1-47d7-9246-e3f978187f9b tempest-ProjectReaderTests-1422491147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83c63520-66ae-41fe-8690-d8918fe03764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:26 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-32f33f89-7db1-47d7-9246-e3f978187f9b tempest-ProjectReaderTests-1422491147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83c63520-66ae-41fe-8690-d8918fe03764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:26 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-32f33f89-7db1-47d7-9246-e3f978187f9b tempest-ProjectReaderTests-1422491147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2f41eec-f8a6-4bec-a3cf-203874d11962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:26 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-32f33f89-7db1-47d7-9246-e3f978187f9b tempest-ProjectReaderTests-1422491147 None] Volume 21f19080-c179-4d81-86f7-c69c94b1609c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21f19080-c179-4d81-86f7-c69c94b1609c', 'volume_size': 1} Sep 23 14:51:26 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-32f33f89-7db1-47d7-9246-e3f978187f9b tempest-ProjectReaderTests-1422491147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:51:26 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-32f33f89-7db1-47d7-9246-e3f978187f9b tempest-ProjectReaderTests-1422491147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:51:26 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-32f33f89-7db1-47d7-9246-e3f978187f9b tempest-ProjectReaderTests-1422491147 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:51:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-248227031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21f19080-c179-4d81-86f7-c69c94b1609c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5480fde18834c20926ef72662381362',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:51:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:51:26Z,use_quota=True,user_id='9c4b6322803a4a9cae974bf15863a243',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:51:26 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-32f33f89-7db1-47d7-9246-e3f978187f9b tempest-ProjectReaderTests-1422491147 None] Creating volume 21f19080-c179-4d81-86f7-c69c94b1609c {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:51:26 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-32f33f89-7db1-47d7-9246-e3f978187f9b tempest-ProjectReaderTests-1422491147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:51:26 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-32f33f89-7db1-47d7-9246-e3f978187f9b tempest-ProjectReaderTests-1422491147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:51:26 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-32f33f89-7db1-47d7-9246-e3f978187f9b tempest-ProjectReaderTests-1422491147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:51:26 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-32f33f89-7db1-47d7-9246-e3f978187f9b tempest-ProjectReaderTests-1422491147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:51:26 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-32f33f89-7db1-47d7-9246-e3f978187f9b tempest-ProjectReaderTests-1422491147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:51:26 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-32f33f89-7db1-47d7-9246-e3f978187f9b tempest-ProjectReaderTests-1422491147 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:51:26 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-32f33f89-7db1-47d7-9246-e3f978187f9b tempest-ProjectReaderTests-1422491147 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:51:26 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-32f33f89-7db1-47d7-9246-e3f978187f9b tempest-ProjectReaderTests-1422491147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-21f19080-c179-4d81-86f7-c69c94b1609c 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:26 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-1815113a-5c26-40fe-9005-96cd6f60e67e tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Deleted volume successfully. Sep 23 14:51:26 devstack sudo[104394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-21f19080-c179-4d81-86f7-c69c94b1609c 1073741824 Sep 23 14:51:26 devstack sudo[104394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:26 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-1815113a-5c26-40fe-9005-96cd6f60e67e tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Lock "cinder-7159b520-d496-429f-b4ad-104765980edb-delete_volume" released by "delete_volume" :: held 1.464s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:51:26 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-49913253-0f31-4090-8c2f-c217976f49b7 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Acquiring lock "cinder-quobyte-bfb0a89e-bcc9-4028-8cea-205c5945260d" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:51:26 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-ac1736a6-927d-4828-8c1e-ea8565b70139 tempest-CinderUnicodeTest-1321322603 None] Created reservations ['ac23aea2-aaa5-4d85-a6a3-a8dd4c88ee75', 'a2d855f6-0623-4870-866a-6b5d5ea2c4dd', 'f7b6a2c2-c545-4a9d-8260-1b5c1b03e328', '3e1b9bfb-d4d4-41cb-a75c-cccd5c0c1d3b'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:51:26 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-49913253-0f31-4090-8c2f-c217976f49b7 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Lock "cinder-quobyte-bfb0a89e-bcc9-4028-8cea-205c5945260d" acquired by "delete_volume" :: waited 0.050s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:51:26 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[abded152-d4c2-4b09-985c-5dc6348a4334]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:51:26 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-49913253-0f31-4090-8c2f-c217976f49b7 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bfb0a89e-bcc9-4028-8cea-205c5945260d {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:26 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-9ccf4ccf-78a5-4560-ad97-1e016e8ffaf8 tempest-VolumeDependencyTests-1903059066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:51:26 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-ac1736a6-927d-4828-8c1e-ea8565b70139 tempest-CinderUnicodeTest-1321322603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:51:26 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-ac1736a6-927d-4828-8c1e-ea8565b70139 tempest-CinderUnicodeTest-1321322603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:51:26 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-ac1736a6-927d-4828-8c1e-ea8565b70139 tempest-CinderUnicodeTest-1321322603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:51:26 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-ac1736a6-927d-4828-8c1e-ea8565b70139 tempest-CinderUnicodeTest-1321322603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:51:26 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-ac1736a6-927d-4828-8c1e-ea8565b70139 tempest-CinderUnicodeTest-1321322603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:51:26 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ac1736a6-927d-4828-8c1e-ea8565b70139 tempest-CinderUnicodeTest-1321322603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:26 devstack sudo[104397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:51:26 devstack sudo[104397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:26 devstack sudo[104396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bfb0a89e-bcc9-4028-8cea-205c5945260d Sep 23 14:51:26 devstack sudo[104396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:26 devstack sudo[104394]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:26 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-32f33f89-7db1-47d7-9246-e3f978187f9b tempest-ProjectReaderTests-1422491147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-21f19080-c179-4d81-86f7-c69c94b1609c 1073741824" returned: 0 in 0.524s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:26 devstack sudo[104397]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:26 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ac1736a6-927d-4828-8c1e-ea8565b70139 tempest-CinderUnicodeTest-1321322603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.279s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:26 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-ac1736a6-927d-4828-8c1e-ea8565b70139 tempest-CinderUnicodeTest-1321322603 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:51:26 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-ac1736a6-927d-4828-8c1e-ea8565b70139 tempest-CinderUnicodeTest-1321322603 None] Deleted volume successfully. Sep 23 14:51:26 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-32f33f89-7db1-47d7-9246-e3f978187f9b tempest-ProjectReaderTests-1422491147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-21f19080-c179-4d81-86f7-c69c94b1609c {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:26 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-ac1736a6-927d-4828-8c1e-ea8565b70139 tempest-CinderUnicodeTest-1321322603 None] Lock "cinder-d3c0b4c6-56e4-44d2-ba9c-2d4bb8630170-delete_volume" released by "delete_volume" :: held 1.601s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:51:26 devstack sudo[104408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-21f19080-c179-4d81-86f7-c69c94b1609c Sep 23 14:51:26 devstack sudo[104408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:26 devstack sudo[104396]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:26 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-49913253-0f31-4090-8c2f-c217976f49b7 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bfb0a89e-bcc9-4028-8cea-205c5945260d" returned: 0 in 0.416s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:26 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-49913253-0f31-4090-8c2f-c217976f49b7 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bfb0a89e-bcc9-4028-8cea-205c5945260d {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:26 devstack sudo[104410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bfb0a89e-bcc9-4028-8cea-205c5945260d Sep 23 14:51:26 devstack sudo[104410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:27 devstack sudo[104408]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:27 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-32f33f89-7db1-47d7-9246-e3f978187f9b tempest-ProjectReaderTests-1422491147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-21f19080-c179-4d81-86f7-c69c94b1609c" returned: 0 in 0.253s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:27 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-32f33f89-7db1-47d7-9246-e3f978187f9b tempest-ProjectReaderTests-1422491147 None] <== create_volume: return (835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:51:27 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-32f33f89-7db1-47d7-9246-e3f978187f9b tempest-ProjectReaderTests-1422491147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:51:27 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-9ccf4ccf-78a5-4560-ad97-1e016e8ffaf8 tempest-VolumeDependencyTests-1903059066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.616s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:51:27 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-32f33f89-7db1-47d7-9246-e3f978187f9b tempest-ProjectReaderTests-1422491147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2f41eec-f8a6-4bec-a3cf-203874d11962) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21f19080-c179-4d81-86f7-c69c94b1609c', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:27 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-32f33f89-7db1-47d7-9246-e3f978187f9b tempest-ProjectReaderTests-1422491147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (005eecc7-f5ef-46d9-9273-4eb2180592f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:27 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-9ccf4ccf-78a5-4560-ad97-1e016e8ffaf8 tempest-VolumeDependencyTests-1903059066 None] Creating offline snapshot 0fac3eda-f253-4eff-b5e7-fd9827eba3b5 of volume 574a9942-452f-4442-8e8f-b5cedb2ccd0d {{(pid=86310) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 14:51:27 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-32f33f89-7db1-47d7-9246-e3f978187f9b tempest-ProjectReaderTests-1422491147 None] Volume volume-21f19080-c179-4d81-86f7-c69c94b1609c (21f19080-c179-4d81-86f7-c69c94b1609c): created successfully Sep 23 14:51:27 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-32f33f89-7db1-47d7-9246-e3f978187f9b tempest-ProjectReaderTests-1422491147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (005eecc7-f5ef-46d9-9273-4eb2180592f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:27 devstack sudo[104410]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:27 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-32f33f89-7db1-47d7-9246-e3f978187f9b tempest-ProjectReaderTests-1422491147 None] Flow 'volume_create_manager' (bbe9e7d3-5788-4a6b-ad69-2a79231b2f45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:51:27 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[d800d41e-c19a-461d-b351-eca56657fcc1]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:51:27 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-9ccf4ccf-78a5-4560-ad97-1e016e8ffaf8 tempest-VolumeDependencyTests-1903059066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-574a9942-452f-4442-8e8f-b5cedb2ccd0d {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:27 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-49913253-0f31-4090-8c2f-c217976f49b7 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-bfb0a89e-bcc9-4028-8cea-205c5945260d" returned: 0 in 0.303s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:27 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-49913253-0f31-4090-8c2f-c217976f49b7 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Lock "cinder-quobyte-bfb0a89e-bcc9-4028-8cea-205c5945260d" released by "delete_volume" :: held 0.806s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:51:27 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-32f33f89-7db1-47d7-9246-e3f978187f9b tempest-ProjectReaderTests-1422491147 None] Created volume successfully. Sep 23 14:51:27 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-49913253-0f31-4090-8c2f-c217976f49b7 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Created reservations ['ccb631a9-2a87-4f2f-80db-5c6ce5ed74f6', 'bb52b1c7-e7c3-4cff-b0e2-5f7fea217a37', '479185f7-a7a3-46cd-b3f0-b87e3ea4385b', '60be801f-ded2-496a-be03-3e06a5b9e6df'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:51:27 devstack sudo[104414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-574a9942-452f-4442-8e8f-b5cedb2ccd0d Sep 23 14:51:27 devstack sudo[104414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:27 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-49913253-0f31-4090-8c2f-c217976f49b7 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:51:27 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-49913253-0f31-4090-8c2f-c217976f49b7 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:51:27 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-49913253-0f31-4090-8c2f-c217976f49b7 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:51:27 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-49913253-0f31-4090-8c2f-c217976f49b7 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:51:27 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-49913253-0f31-4090-8c2f-c217976f49b7 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:51:27 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-49913253-0f31-4090-8c2f-c217976f49b7 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:27 devstack sudo[104416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:51:27 devstack sudo[104416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:27 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-85864a30-27ff-4eef-86b8-c3b0f604d15f tempest-CinderUnicodeTest-1321322603 None] Acquiring lock "cinder-3f15b442-c08a-4e56-8ba3-4ad44a52cd8b-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:51:27 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-85864a30-27ff-4eef-86b8-c3b0f604d15f tempest-CinderUnicodeTest-1321322603 None] Lock "cinder-3f15b442-c08a-4e56-8ba3-4ad44a52cd8b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:51:27 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-85864a30-27ff-4eef-86b8-c3b0f604d15f tempest-CinderUnicodeTest-1321322603 None] Acquiring lock "cinder-quobyte-3f15b442-c08a-4e56-8ba3-4ad44a52cd8b" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:51:27 devstack sudo[104416]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:27 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-49913253-0f31-4090-8c2f-c217976f49b7 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.293s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:27 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-49913253-0f31-4090-8c2f-c217976f49b7 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:51:27 devstack sudo[104414]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:27 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-49913253-0f31-4090-8c2f-c217976f49b7 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Deleted volume successfully. Sep 23 14:51:27 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-9ccf4ccf-78a5-4560-ad97-1e016e8ffaf8 tempest-VolumeDependencyTests-1903059066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-574a9942-452f-4442-8e8f-b5cedb2ccd0d" returned: 0 in 0.465s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:27 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-9ccf4ccf-78a5-4560-ad97-1e016e8ffaf8 tempest-VolumeDependencyTests-1903059066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-574a9942-452f-4442-8e8f-b5cedb2ccd0d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-574a9942-452f-4442-8e8f-b5cedb2ccd0d.0fac3eda-f253-4eff-b5e7-fd9827eba3b5 1G {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:27 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-85864a30-27ff-4eef-86b8-c3b0f604d15f tempest-CinderUnicodeTest-1321322603 None] Lock "cinder-quobyte-3f15b442-c08a-4e56-8ba3-4ad44a52cd8b" acquired by "delete_volume" :: waited 0.035s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:51:27 devstack sudo[104422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-574a9942-452f-4442-8e8f-b5cedb2ccd0d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-574a9942-452f-4442-8e8f-b5cedb2ccd0d.0fac3eda-f253-4eff-b5e7-fd9827eba3b5 1G Sep 23 14:51:27 devstack sudo[104422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:27 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-49913253-0f31-4090-8c2f-c217976f49b7 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Lock "cinder-bfb0a89e-bcc9-4028-8cea-205c5945260d-delete_volume" released by "delete_volume" :: held 1.487s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:51:27 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ffc30e8-d3b6-4e94-8d03-553f6ca3a8af]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:51:27 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-85864a30-27ff-4eef-86b8-c3b0f604d15f tempest-CinderUnicodeTest-1321322603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-3f15b442-c08a-4e56-8ba3-4ad44a52cd8b {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:27 devstack sudo[104424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-3f15b442-c08a-4e56-8ba3-4ad44a52cd8b Sep 23 14:51:27 devstack sudo[104424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:28 devstack sudo[104422]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:28 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-9ccf4ccf-78a5-4560-ad97-1e016e8ffaf8 tempest-VolumeDependencyTests-1903059066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-574a9942-452f-4442-8e8f-b5cedb2ccd0d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-574a9942-452f-4442-8e8f-b5cedb2ccd0d.0fac3eda-f253-4eff-b5e7-fd9827eba3b5 1G" returned: 0 in 0.472s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:28 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-9ccf4ccf-78a5-4560-ad97-1e016e8ffaf8 tempest-VolumeDependencyTests-1903059066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-574a9942-452f-4442-8e8f-b5cedb2ccd0d -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-574a9942-452f-4442-8e8f-b5cedb2ccd0d.0fac3eda-f253-4eff-b5e7-fd9827eba3b5 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:28 devstack sudo[104446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-574a9942-452f-4442-8e8f-b5cedb2ccd0d -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-574a9942-452f-4442-8e8f-b5cedb2ccd0d.0fac3eda-f253-4eff-b5e7-fd9827eba3b5 Sep 23 14:51:28 devstack sudo[104446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:28 devstack sudo[104424]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:28 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-85864a30-27ff-4eef-86b8-c3b0f604d15f tempest-CinderUnicodeTest-1321322603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-3f15b442-c08a-4e56-8ba3-4ad44a52cd8b" returned: 0 in 0.461s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:28 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-85864a30-27ff-4eef-86b8-c3b0f604d15f tempest-CinderUnicodeTest-1321322603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-3f15b442-c08a-4e56-8ba3-4ad44a52cd8b {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:28 devstack sudo[104468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-3f15b442-c08a-4e56-8ba3-4ad44a52cd8b Sep 23 14:51:28 devstack sudo[104468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:28 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-c4bb2a0a-4f07-466a-b199-7f15c90b3295 tempest-ProjectReaderTests-1422491147 None] Acquiring lock "cinder-21f19080-c179-4d81-86f7-c69c94b1609c-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:51:28 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-c4bb2a0a-4f07-466a-b199-7f15c90b3295 tempest-ProjectReaderTests-1422491147 None] Lock "cinder-21f19080-c179-4d81-86f7-c69c94b1609c-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:51:28 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-c4bb2a0a-4f07-466a-b199-7f15c90b3295 tempest-ProjectReaderTests-1422491147 None] Acquiring lock "cinder-quobyte-21f19080-c179-4d81-86f7-c69c94b1609c" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:51:28 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-c4bb2a0a-4f07-466a-b199-7f15c90b3295 tempest-ProjectReaderTests-1422491147 None] Lock "cinder-quobyte-21f19080-c179-4d81-86f7-c69c94b1609c" acquired by "delete_volume" :: waited 0.019s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:51:28 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-c7075995-0e45-4e7f-bb39-7768ca94d246 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Acquiring lock "cinder-df7c00c6-4ce8-409a-abd8-ddd86bef7bfb-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:51:28 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-c7075995-0e45-4e7f-bb39-7768ca94d246 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Lock "cinder-df7c00c6-4ce8-409a-abd8-ddd86bef7bfb-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:51:28 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[68a3c1f0-b670-4259-b1c4-3a8ea33b31e8]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:51:28 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-c4bb2a0a-4f07-466a-b199-7f15c90b3295 tempest-ProjectReaderTests-1422491147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-21f19080-c179-4d81-86f7-c69c94b1609c {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:28 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-c7075995-0e45-4e7f-bb39-7768ca94d246 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Acquiring lock "cinder-quobyte-df7c00c6-4ce8-409a-abd8-ddd86bef7bfb" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:51:28 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-c7075995-0e45-4e7f-bb39-7768ca94d246 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Lock "cinder-quobyte-df7c00c6-4ce8-409a-abd8-ddd86bef7bfb" acquired by "delete_volume" :: waited 0.026s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:51:28 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdf001b0-0b84-4160-821c-c85d5cda10a8]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:51:28 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-c7075995-0e45-4e7f-bb39-7768ca94d246 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-df7c00c6-4ce8-409a-abd8-ddd86bef7bfb {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:28 devstack sudo[104446]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:28 devstack sudo[104472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-21f19080-c179-4d81-86f7-c69c94b1609c Sep 23 14:51:28 devstack sudo[104472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:28 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-9ccf4ccf-78a5-4560-ad97-1e016e8ffaf8 tempest-VolumeDependencyTests-1903059066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-574a9942-452f-4442-8e8f-b5cedb2ccd0d -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-574a9942-452f-4442-8e8f-b5cedb2ccd0d.0fac3eda-f253-4eff-b5e7-fd9827eba3b5" returned: 0 in 0.471s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:28 devstack cinder-volume[86310]: WARNING cinder.volume.drivers.remotefs [None req-9ccf4ccf-78a5-4560-ad97-1e016e8ffaf8 tempest-VolumeDependencyTests-1903059066 None] /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-574a9942-452f-4442-8e8f-b5cedb2ccd0d.0fac3eda-f253-4eff-b5e7-fd9827eba3b5 is being set with open permissions: ugo+rw Sep 23 14:51:28 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-9ccf4ccf-78a5-4560-ad97-1e016e8ffaf8 tempest-VolumeDependencyTests-1903059066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-574a9942-452f-4442-8e8f-b5cedb2ccd0d.0fac3eda-f253-4eff-b5e7-fd9827eba3b5 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:28 devstack sudo[104476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-574a9942-452f-4442-8e8f-b5cedb2ccd0d.0fac3eda-f253-4eff-b5e7-fd9827eba3b5 Sep 23 14:51:28 devstack sudo[104476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:28 devstack sudo[104474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-df7c00c6-4ce8-409a-abd8-ddd86bef7bfb Sep 23 14:51:28 devstack sudo[104474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:28 devstack sudo[104468]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:28 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-85864a30-27ff-4eef-86b8-c3b0f604d15f tempest-CinderUnicodeTest-1321322603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-3f15b442-c08a-4e56-8ba3-4ad44a52cd8b" returned: 0 in 0.598s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:28 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-85864a30-27ff-4eef-86b8-c3b0f604d15f tempest-CinderUnicodeTest-1321322603 None] Lock "cinder-quobyte-3f15b442-c08a-4e56-8ba3-4ad44a52cd8b" released by "delete_volume" :: held 1.119s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:51:28 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-85864a30-27ff-4eef-86b8-c3b0f604d15f tempest-CinderUnicodeTest-1321322603 None] Created reservations ['7d11450a-78f4-4d10-b2a1-a559e3202371', '1f24f2a7-7d36-4125-85f4-f41f7760cf16', '42f8104a-4ef9-405f-b12f-ec36ba5187e5', 'baf98118-ffc0-4f31-b4d2-fcd2a2df4195'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:51:28 devstack sudo[104472]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:28 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-c4bb2a0a-4f07-466a-b199-7f15c90b3295 tempest-ProjectReaderTests-1422491147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-21f19080-c179-4d81-86f7-c69c94b1609c" returned: 0 in 0.468s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:28 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-c4bb2a0a-4f07-466a-b199-7f15c90b3295 tempest-ProjectReaderTests-1422491147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-21f19080-c179-4d81-86f7-c69c94b1609c {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:28 devstack sudo[104476]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:28 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-9ccf4ccf-78a5-4560-ad97-1e016e8ffaf8 tempest-VolumeDependencyTests-1903059066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-574a9942-452f-4442-8e8f-b5cedb2ccd0d.0fac3eda-f253-4eff-b5e7-fd9827eba3b5" returned: 0 in 0.327s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:28 devstack sudo[104486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-21f19080-c179-4d81-86f7-c69c94b1609c Sep 23 14:51:29 devstack sudo[104486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:29 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-85864a30-27ff-4eef-86b8-c3b0f604d15f tempest-CinderUnicodeTest-1321322603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:51:29 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-85864a30-27ff-4eef-86b8-c3b0f604d15f tempest-CinderUnicodeTest-1321322603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:51:29 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-85864a30-27ff-4eef-86b8-c3b0f604d15f tempest-CinderUnicodeTest-1321322603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:51:29 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-85864a30-27ff-4eef-86b8-c3b0f604d15f tempest-CinderUnicodeTest-1321322603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:51:29 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-85864a30-27ff-4eef-86b8-c3b0f604d15f tempest-CinderUnicodeTest-1321322603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:51:29 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-85864a30-27ff-4eef-86b8-c3b0f604d15f tempest-CinderUnicodeTest-1321322603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:29 devstack sudo[104488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:51:29 devstack sudo[104488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:29 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-9ccf4ccf-78a5-4560-ad97-1e016e8ffaf8 tempest-VolumeDependencyTests-1903059066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-574a9942-452f-4442-8e8f-b5cedb2ccd0d.info {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:29 devstack sudo[104490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-574a9942-452f-4442-8e8f-b5cedb2ccd0d.info Sep 23 14:51:29 devstack sudo[104490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:29 devstack sudo[104474]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:29 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-c7075995-0e45-4e7f-bb39-7768ca94d246 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-df7c00c6-4ce8-409a-abd8-ddd86bef7bfb" returned: 0 in 0.519s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:29 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-c7075995-0e45-4e7f-bb39-7768ca94d246 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-df7c00c6-4ce8-409a-abd8-ddd86bef7bfb {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:29 devstack sudo[104496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-df7c00c6-4ce8-409a-abd8-ddd86bef7bfb Sep 23 14:51:29 devstack sudo[104496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:29 devstack sudo[104486]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:29 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-c4bb2a0a-4f07-466a-b199-7f15c90b3295 tempest-ProjectReaderTests-1422491147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-21f19080-c179-4d81-86f7-c69c94b1609c" returned: 0 in 0.289s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:29 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-c4bb2a0a-4f07-466a-b199-7f15c90b3295 tempest-ProjectReaderTests-1422491147 None] Lock "cinder-quobyte-21f19080-c179-4d81-86f7-c69c94b1609c" released by "delete_volume" :: held 0.862s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:51:29 devstack sudo[104488]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:29 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-85864a30-27ff-4eef-86b8-c3b0f604d15f tempest-CinderUnicodeTest-1321322603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.297s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:29 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-85864a30-27ff-4eef-86b8-c3b0f604d15f tempest-CinderUnicodeTest-1321322603 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:51:29 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-85864a30-27ff-4eef-86b8-c3b0f604d15f tempest-CinderUnicodeTest-1321322603 None] Deleted volume successfully. Sep 23 14:51:29 devstack sudo[104490]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:29 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-9ccf4ccf-78a5-4560-ad97-1e016e8ffaf8 tempest-VolumeDependencyTests-1903059066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-574a9942-452f-4442-8e8f-b5cedb2ccd0d.info" returned: 0 in 0.296s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:29 devstack cinder-volume[86310]: WARNING cinder.volume.drivers.remotefs [None req-9ccf4ccf-78a5-4560-ad97-1e016e8ffaf8 tempest-VolumeDependencyTests-1903059066 None] /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-574a9942-452f-4442-8e8f-b5cedb2ccd0d.info is being set with open permissions: ugo+rw Sep 23 14:51:29 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-9ccf4ccf-78a5-4560-ad97-1e016e8ffaf8 tempest-VolumeDependencyTests-1903059066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-574a9942-452f-4442-8e8f-b5cedb2ccd0d.info {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:29 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-85864a30-27ff-4eef-86b8-c3b0f604d15f tempest-CinderUnicodeTest-1321322603 None] Lock "cinder-3f15b442-c08a-4e56-8ba3-4ad44a52cd8b-delete_volume" released by "delete_volume" :: held 1.721s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:51:29 devstack sudo[104501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-574a9942-452f-4442-8e8f-b5cedb2ccd0d.info Sep 23 14:51:29 devstack sudo[104501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:29 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-c4bb2a0a-4f07-466a-b199-7f15c90b3295 tempest-ProjectReaderTests-1422491147 None] Created reservations ['525c7b6c-8cbc-4012-8d8d-4dcf9a2a6166', '2919715d-b326-40b3-820f-527b1392ec41', '689d6a2d-3387-432f-ae45-c201bf0a35b5', '8099ccf6-f74d-48f1-a53a-b72513d26b94'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:51:29 devstack sudo[104496]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:29 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-c7075995-0e45-4e7f-bb39-7768ca94d246 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-df7c00c6-4ce8-409a-abd8-ddd86bef7bfb" returned: 0 in 0.276s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:29 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-c4bb2a0a-4f07-466a-b199-7f15c90b3295 tempest-ProjectReaderTests-1422491147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:51:29 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-c4bb2a0a-4f07-466a-b199-7f15c90b3295 tempest-ProjectReaderTests-1422491147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:51:29 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-c4bb2a0a-4f07-466a-b199-7f15c90b3295 tempest-ProjectReaderTests-1422491147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:51:29 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-c4bb2a0a-4f07-466a-b199-7f15c90b3295 tempest-ProjectReaderTests-1422491147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:51:29 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-c4bb2a0a-4f07-466a-b199-7f15c90b3295 tempest-ProjectReaderTests-1422491147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:51:29 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-c4bb2a0a-4f07-466a-b199-7f15c90b3295 tempest-ProjectReaderTests-1422491147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:29 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-c7075995-0e45-4e7f-bb39-7768ca94d246 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Lock "cinder-quobyte-df7c00c6-4ce8-409a-abd8-ddd86bef7bfb" released by "delete_volume" :: held 0.869s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:51:29 devstack sudo[104504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:51:29 devstack sudo[104504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:29 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-c7075995-0e45-4e7f-bb39-7768ca94d246 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Created reservations ['f1f61322-8453-4506-83ab-3f4c9cb7788e', 'a678e97a-c743-4ae6-8681-8a80208d0f58', '9eaefc4e-cde4-487c-b020-d832d57fbcd2', 'a43d6cf8-3ccc-445b-b745-adcc39efc117'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:51:29 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-c7075995-0e45-4e7f-bb39-7768ca94d246 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:51:29 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-c7075995-0e45-4e7f-bb39-7768ca94d246 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:51:29 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-c7075995-0e45-4e7f-bb39-7768ca94d246 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:51:29 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-c7075995-0e45-4e7f-bb39-7768ca94d246 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:51:29 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-c7075995-0e45-4e7f-bb39-7768ca94d246 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:51:29 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-c7075995-0e45-4e7f-bb39-7768ca94d246 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:29 devstack sudo[104501]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:29 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-9ccf4ccf-78a5-4560-ad97-1e016e8ffaf8 tempest-VolumeDependencyTests-1903059066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-574a9942-452f-4442-8e8f-b5cedb2ccd0d.info" returned: 0 in 0.321s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:29 devstack sudo[104507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:51:29 devstack sudo[104507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:29 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-9ccf4ccf-78a5-4560-ad97-1e016e8ffaf8 tempest-VolumeDependencyTests-1903059066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.512s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:51:29 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-9ccf4ccf-78a5-4560-ad97-1e016e8ffaf8 tempest-VolumeDependencyTests-1903059066 None] Create snapshot completed successfully Sep 23 14:51:29 devstack sudo[104504]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:29 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-c4bb2a0a-4f07-466a-b199-7f15c90b3295 tempest-ProjectReaderTests-1422491147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.334s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:29 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-c4bb2a0a-4f07-466a-b199-7f15c90b3295 tempest-ProjectReaderTests-1422491147 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:51:29 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-c4bb2a0a-4f07-466a-b199-7f15c90b3295 tempest-ProjectReaderTests-1422491147 None] Deleted volume successfully. Sep 23 14:51:29 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-c4bb2a0a-4f07-466a-b199-7f15c90b3295 tempest-ProjectReaderTests-1422491147 None] Lock "cinder-21f19080-c179-4d81-86f7-c69c94b1609c-delete_volume" released by "delete_volume" :: held 1.487s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:51:29 devstack sudo[104507]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:29 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-c7075995-0e45-4e7f-bb39-7768ca94d246 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.325s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:29 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-c7075995-0e45-4e7f-bb39-7768ca94d246 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:51:29 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-c7075995-0e45-4e7f-bb39-7768ca94d246 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Deleted volume successfully. Sep 23 14:51:30 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-c7075995-0e45-4e7f-bb39-7768ca94d246 tempest-CreateVolumesFromSourceVolumeTest-702571909 None] Lock "cinder-df7c00c6-4ce8-409a-abd8-ddd86bef7bfb-delete_volume" released by "delete_volume" :: held 1.507s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:51:30 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-d41474c6-b035-49a8-93d3-baec5f2b1006 tempest-ProjectReaderTests-1422491147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:51:30 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-d41474c6-b035-49a8-93d3-baec5f2b1006 tempest-ProjectReaderTests-1422491147 None] Flow 'volume_create_manager' (8ddc3d58-8c0c-4787-aa55-c53ea6474f9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:51:30 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-d41474c6-b035-49a8-93d3-baec5f2b1006 tempest-ProjectReaderTests-1422491147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b5b1610-e342-40aa-bac5-cdaee3142dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:30 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-d41474c6-b035-49a8-93d3-baec5f2b1006 tempest-ProjectReaderTests-1422491147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b5b1610-e342-40aa-bac5-cdaee3142dfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:51:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1883875998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6dda924-85f1-4a07-afba-fa5eed34a4d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5480fde18834c20926ef72662381362',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:51:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:51:30Z,use_quota=True,user_id='9c4b6322803a4a9cae974bf15863a243',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:30 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-d41474c6-b035-49a8-93d3-baec5f2b1006 tempest-ProjectReaderTests-1422491147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae011f9b-2d82-4f39-a369-460907fecb5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:30 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-d41474c6-b035-49a8-93d3-baec5f2b1006 tempest-ProjectReaderTests-1422491147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae011f9b-2d82-4f39-a369-460907fecb5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:30 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-d41474c6-b035-49a8-93d3-baec5f2b1006 tempest-ProjectReaderTests-1422491147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e58e3308-6416-4b77-821c-7a72b6f704aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:30 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-d41474c6-b035-49a8-93d3-baec5f2b1006 tempest-ProjectReaderTests-1422491147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e58e3308-6416-4b77-821c-7a72b6f704aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6dda924-85f1-4a07-afba-fa5eed34a4d0', 'volume_name': 'volume-d6dda924-85f1-4a07-afba-fa5eed34a4d0', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:30 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-d41474c6-b035-49a8-93d3-baec5f2b1006 tempest-ProjectReaderTests-1422491147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (613cc589-4a17-4308-821a-3f9d33183765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:30 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-d41474c6-b035-49a8-93d3-baec5f2b1006 tempest-ProjectReaderTests-1422491147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (613cc589-4a17-4308-821a-3f9d33183765) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:30 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-d41474c6-b035-49a8-93d3-baec5f2b1006 tempest-ProjectReaderTests-1422491147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bdd480e-1dc0-43fd-8663-98acfbba6aff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:30 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-d41474c6-b035-49a8-93d3-baec5f2b1006 tempest-ProjectReaderTests-1422491147 None] Volume d6dda924-85f1-4a07-afba-fa5eed34a4d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6dda924-85f1-4a07-afba-fa5eed34a4d0', 'volume_size': 1} Sep 23 14:51:30 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-d41474c6-b035-49a8-93d3-baec5f2b1006 tempest-ProjectReaderTests-1422491147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:51:30 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-d41474c6-b035-49a8-93d3-baec5f2b1006 tempest-ProjectReaderTests-1422491147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:51:30 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-d41474c6-b035-49a8-93d3-baec5f2b1006 tempest-ProjectReaderTests-1422491147 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:51:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1883875998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6dda924-85f1-4a07-afba-fa5eed34a4d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5480fde18834c20926ef72662381362',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:51:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:51:30Z,use_quota=True,user_id='9c4b6322803a4a9cae974bf15863a243',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:51:30 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-d41474c6-b035-49a8-93d3-baec5f2b1006 tempest-ProjectReaderTests-1422491147 None] Creating volume d6dda924-85f1-4a07-afba-fa5eed34a4d0 {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:51:30 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-d41474c6-b035-49a8-93d3-baec5f2b1006 tempest-ProjectReaderTests-1422491147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:51:30 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-d41474c6-b035-49a8-93d3-baec5f2b1006 tempest-ProjectReaderTests-1422491147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:51:30 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-d41474c6-b035-49a8-93d3-baec5f2b1006 tempest-ProjectReaderTests-1422491147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:51:30 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-d41474c6-b035-49a8-93d3-baec5f2b1006 tempest-ProjectReaderTests-1422491147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:51:30 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-d41474c6-b035-49a8-93d3-baec5f2b1006 tempest-ProjectReaderTests-1422491147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:51:30 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-d41474c6-b035-49a8-93d3-baec5f2b1006 tempest-ProjectReaderTests-1422491147 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:51:30 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-d41474c6-b035-49a8-93d3-baec5f2b1006 tempest-ProjectReaderTests-1422491147 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:51:30 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d41474c6-b035-49a8-93d3-baec5f2b1006 tempest-ProjectReaderTests-1422491147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d6dda924-85f1-4a07-afba-fa5eed34a4d0 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:30 devstack sudo[104511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d6dda924-85f1-4a07-afba-fa5eed34a4d0 1073741824 Sep 23 14:51:30 devstack sudo[104511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:30 devstack sudo[104511]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:30 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d41474c6-b035-49a8-93d3-baec5f2b1006 tempest-ProjectReaderTests-1422491147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d6dda924-85f1-4a07-afba-fa5eed34a4d0 1073741824" returned: 0 in 0.557s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:30 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d41474c6-b035-49a8-93d3-baec5f2b1006 tempest-ProjectReaderTests-1422491147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d6dda924-85f1-4a07-afba-fa5eed34a4d0 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:30 devstack sudo[104517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d6dda924-85f1-4a07-afba-fa5eed34a4d0 Sep 23 14:51:30 devstack sudo[104517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:31 devstack sudo[104517]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:31 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d41474c6-b035-49a8-93d3-baec5f2b1006 tempest-ProjectReaderTests-1422491147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d6dda924-85f1-4a07-afba-fa5eed34a4d0" returned: 0 in 0.351s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:31 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-d41474c6-b035-49a8-93d3-baec5f2b1006 tempest-ProjectReaderTests-1422491147 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:51:31 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-d41474c6-b035-49a8-93d3-baec5f2b1006 tempest-ProjectReaderTests-1422491147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:51:31 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-d41474c6-b035-49a8-93d3-baec5f2b1006 tempest-ProjectReaderTests-1422491147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bdd480e-1dc0-43fd-8663-98acfbba6aff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6dda924-85f1-4a07-afba-fa5eed34a4d0', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:31 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-d41474c6-b035-49a8-93d3-baec5f2b1006 tempest-ProjectReaderTests-1422491147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34e18f07-8b90-4756-a1e4-48f047a3e1cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:31 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-d41474c6-b035-49a8-93d3-baec5f2b1006 tempest-ProjectReaderTests-1422491147 None] Volume volume-d6dda924-85f1-4a07-afba-fa5eed34a4d0 (d6dda924-85f1-4a07-afba-fa5eed34a4d0): created successfully Sep 23 14:51:31 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-d41474c6-b035-49a8-93d3-baec5f2b1006 tempest-ProjectReaderTests-1422491147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34e18f07-8b90-4756-a1e4-48f047a3e1cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:31 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-d41474c6-b035-49a8-93d3-baec5f2b1006 tempest-ProjectReaderTests-1422491147 None] Flow 'volume_create_manager' (8ddc3d58-8c0c-4787-aa55-c53ea6474f9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:51:31 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-d41474c6-b035-49a8-93d3-baec5f2b1006 tempest-ProjectReaderTests-1422491147 None] Created volume successfully. Sep 23 14:51:31 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-131fdb15-2ed0-4b98-9a7d-6a73c0622823 tempest-VolumeDependencyTests-1903059066 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:51:31 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-131fdb15-2ed0-4b98-9a7d-6a73c0622823 tempest-VolumeDependencyTests-1903059066 None] Flow 'volume_create_manager' (530d1ee6-9cd7-458f-b33a-440fd67663b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:51:31 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-131fdb15-2ed0-4b98-9a7d-6a73c0622823 tempest-VolumeDependencyTests-1903059066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e1a09ce-d95c-4490-9947-1719833a4b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:31 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-131fdb15-2ed0-4b98-9a7d-6a73c0622823 tempest-VolumeDependencyTests-1903059066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e1a09ce-d95c-4490-9947-1719833a4b0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:51:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-496701846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76f861e7-1efa-423f-93f0-3ecbfe142dfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51f6d28d27a14ac382b6c352bfba59a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:51:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0fac3eda-f253-4eff-b5e7-fd9827eba3b5,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:51:32Z,use_quota=True,user_id='6db0658af1b945869b07813e0165ccb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:31 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-131fdb15-2ed0-4b98-9a7d-6a73c0622823 tempest-VolumeDependencyTests-1903059066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df59f0cd-d881-4c64-9095-e861a3242bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:31 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-131fdb15-2ed0-4b98-9a7d-6a73c0622823 tempest-VolumeDependencyTests-1903059066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df59f0cd-d881-4c64-9095-e861a3242bb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:31 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-131fdb15-2ed0-4b98-9a7d-6a73c0622823 tempest-VolumeDependencyTests-1903059066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4ea3363-edde-4e92-bb74-927e68e75315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:31 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-131fdb15-2ed0-4b98-9a7d-6a73c0622823 tempest-VolumeDependencyTests-1903059066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4ea3363-edde-4e92-bb74-927e68e75315) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '76f861e7-1efa-423f-93f0-3ecbfe142dfa', 'volume_name': 'volume-76f861e7-1efa-423f-93f0-3ecbfe142dfa', 'volume_size': 1, 'snapshot_id': '0fac3eda-f253-4eff-b5e7-fd9827eba3b5'}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:31 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-131fdb15-2ed0-4b98-9a7d-6a73c0622823 tempest-VolumeDependencyTests-1903059066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2b2aa37-f952-48ab-a081-dd2a457f693e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:31 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-131fdb15-2ed0-4b98-9a7d-6a73c0622823 tempest-VolumeDependencyTests-1903059066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2b2aa37-f952-48ab-a081-dd2a457f693e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:31 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-131fdb15-2ed0-4b98-9a7d-6a73c0622823 tempest-VolumeDependencyTests-1903059066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81814798-47d0-4a32-86ab-686c9c3470ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:31 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-131fdb15-2ed0-4b98-9a7d-6a73c0622823 tempest-VolumeDependencyTests-1903059066 None] Volume 76f861e7-1efa-423f-93f0-3ecbfe142dfa: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-76f861e7-1efa-423f-93f0-3ecbfe142dfa', 'volume_size': 1, 'snapshot_id': '0fac3eda-f253-4eff-b5e7-fd9827eba3b5'} Sep 23 14:51:31 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-131fdb15-2ed0-4b98-9a7d-6a73c0622823 tempest-VolumeDependencyTests-1903059066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:51:31 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-131fdb15-2ed0-4b98-9a7d-6a73c0622823 tempest-VolumeDependencyTests-1903059066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:51:31 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-131fdb15-2ed0-4b98-9a7d-6a73c0622823 tempest-VolumeDependencyTests-1903059066 None] Acquiring lock "cinder-quobyte-0fac3eda-f253-4eff-b5e7-fd9827eba3b5-76f861e7-1efa-423f-93f0-3ecbfe142dfa" by "_create_volume_from_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:51:31 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-131fdb15-2ed0-4b98-9a7d-6a73c0622823 tempest-VolumeDependencyTests-1903059066 None] Lock "cinder-quobyte-0fac3eda-f253-4eff-b5e7-fd9827eba3b5-76f861e7-1efa-423f-93f0-3ecbfe142dfa" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:51:31 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-131fdb15-2ed0-4b98-9a7d-6a73c0622823 tempest-VolumeDependencyTests-1903059066 None] Creating volume 76f861e7-1efa-423f-93f0-3ecbfe142dfa from snapshot 0fac3eda-f253-4eff-b5e7-fd9827eba3b5 {{(pid=86310) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 23 14:51:31 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-131fdb15-2ed0-4b98-9a7d-6a73c0622823 tempest-VolumeDependencyTests-1903059066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:51:31 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-131fdb15-2ed0-4b98-9a7d-6a73c0622823 tempest-VolumeDependencyTests-1903059066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:51:31 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-131fdb15-2ed0-4b98-9a7d-6a73c0622823 tempest-VolumeDependencyTests-1903059066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:51:31 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-131fdb15-2ed0-4b98-9a7d-6a73c0622823 tempest-VolumeDependencyTests-1903059066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:51:31 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-131fdb15-2ed0-4b98-9a7d-6a73c0622823 tempest-VolumeDependencyTests-1903059066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:51:31 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-131fdb15-2ed0-4b98-9a7d-6a73c0622823 tempest-VolumeDependencyTests-1903059066 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:51:31 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-131fdb15-2ed0-4b98-9a7d-6a73c0622823 tempest-VolumeDependencyTests-1903059066 None] Acquiring lock "cinder-quobyte-76f861e7-1efa-423f-93f0-3ecbfe142dfa" by "_copy_volume_from_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:51:31 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-131fdb15-2ed0-4b98-9a7d-6a73c0622823 tempest-VolumeDependencyTests-1903059066 None] Lock "cinder-quobyte-76f861e7-1efa-423f-93f0-3ecbfe142dfa" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:51:31 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-131fdb15-2ed0-4b98-9a7d-6a73c0622823 tempest-VolumeDependencyTests-1903059066 None] snapshot: 0fac3eda-f253-4eff-b5e7-fd9827eba3b5, volume: 76f861e7-1efa-423f-93f0-3ecbfe142dfa, {{(pid=86310) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 23 14:51:31 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-131fdb15-2ed0-4b98-9a7d-6a73c0622823 tempest-VolumeDependencyTests-1903059066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:51:31 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-131fdb15-2ed0-4b98-9a7d-6a73c0622823 tempest-VolumeDependencyTests-1903059066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:51:31 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-131fdb15-2ed0-4b98-9a7d-6a73c0622823 tempest-VolumeDependencyTests-1903059066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:51:31 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-131fdb15-2ed0-4b98-9a7d-6a73c0622823 tempest-VolumeDependencyTests-1903059066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:51:31 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-131fdb15-2ed0-4b98-9a7d-6a73c0622823 tempest-VolumeDependencyTests-1903059066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:51:31 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e8fb785-b481-44c2-ad2c-428170eed6eb]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:51:31 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-131fdb15-2ed0-4b98-9a7d-6a73c0622823 tempest-VolumeDependencyTests-1903059066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-574a9942-452f-4442-8e8f-b5cedb2ccd0d.0fac3eda-f253-4eff-b5e7-fd9827eba3b5 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:31 devstack sudo[104520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-574a9942-452f-4442-8e8f-b5cedb2ccd0d.0fac3eda-f253-4eff-b5e7-fd9827eba3b5 Sep 23 14:51:31 devstack sudo[104520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:32 devstack sudo[104520]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:32 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-131fdb15-2ed0-4b98-9a7d-6a73c0622823 tempest-VolumeDependencyTests-1903059066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-574a9942-452f-4442-8e8f-b5cedb2ccd0d.0fac3eda-f253-4eff-b5e7-fd9827eba3b5" returned: 0 in 0.433s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:32 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-131fdb15-2ed0-4b98-9a7d-6a73c0622823 tempest-VolumeDependencyTests-1903059066 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-574a9942-452f-4442-8e8f-b5cedb2ccd0d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 14:51:32 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebabc68e-c527-4c90-b1c7-dace4131e81c]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:51:32 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-131fdb15-2ed0-4b98-9a7d-6a73c0622823 tempest-VolumeDependencyTests-1903059066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-574a9942-452f-4442-8e8f-b5cedb2ccd0d {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:32 devstack sudo[104526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-574a9942-452f-4442-8e8f-b5cedb2ccd0d Sep 23 14:51:32 devstack sudo[104526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:32 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-b16e7d7d-d4b7-42b1-8ff0-56199d2d98a8 tempest-ProjectReaderTests-1422491147 None] Acquiring lock "cinder-d6dda924-85f1-4a07-afba-fa5eed34a4d0-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:51:32 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-b16e7d7d-d4b7-42b1-8ff0-56199d2d98a8 tempest-ProjectReaderTests-1422491147 None] Lock "cinder-d6dda924-85f1-4a07-afba-fa5eed34a4d0-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:51:32 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-b16e7d7d-d4b7-42b1-8ff0-56199d2d98a8 tempest-ProjectReaderTests-1422491147 None] Acquiring lock "cinder-quobyte-d6dda924-85f1-4a07-afba-fa5eed34a4d0" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:51:32 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-b16e7d7d-d4b7-42b1-8ff0-56199d2d98a8 tempest-ProjectReaderTests-1422491147 None] Lock "cinder-quobyte-d6dda924-85f1-4a07-afba-fa5eed34a4d0" acquired by "delete_volume" :: waited 0.025s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:51:32 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3c5ccf4-b5e1-4db0-989d-361f57d99a49]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:51:32 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-b16e7d7d-d4b7-42b1-8ff0-56199d2d98a8 tempest-ProjectReaderTests-1422491147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d6dda924-85f1-4a07-afba-fa5eed34a4d0 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:32 devstack sudo[104528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d6dda924-85f1-4a07-afba-fa5eed34a4d0 Sep 23 14:51:32 devstack sudo[104528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:32 devstack sudo[104526]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:32 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-131fdb15-2ed0-4b98-9a7d-6a73c0622823 tempest-VolumeDependencyTests-1903059066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-574a9942-452f-4442-8e8f-b5cedb2ccd0d" returned: 0 in 0.510s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:32 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-131fdb15-2ed0-4b98-9a7d-6a73c0622823 tempest-VolumeDependencyTests-1903059066 None] will copy from snapshot at /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-574a9942-452f-4442-8e8f-b5cedb2ccd0d {{(pid=86310) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 23 14:51:32 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-131fdb15-2ed0-4b98-9a7d-6a73c0622823 tempest-VolumeDependencyTests-1903059066 None] Creating direct copy from snapshot {{(pid=86310) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 23 14:51:32 devstack cinder-volume[86310]: DEBUG cinder.utils [None req-131fdb15-2ed0-4b98-9a7d-6a73c0622823 tempest-VolumeDependencyTests-1903059066 None] Path /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-76f861e7-1efa-423f-93f0-3ecbfe142dfa not found in is_blk_device check {{(pid=86310) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 23 14:51:32 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-131fdb15-2ed0-4b98-9a7d-6a73c0622823 tempest-VolumeDependencyTests-1903059066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-574a9942-452f-4442-8e8f-b5cedb2ccd0d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-76f861e7-1efa-423f-93f0-3ecbfe142dfa {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:32 devstack sudo[104534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-574a9942-452f-4442-8e8f-b5cedb2ccd0d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-76f861e7-1efa-423f-93f0-3ecbfe142dfa Sep 23 14:51:32 devstack sudo[104534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:33 devstack sudo[104528]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:33 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-b16e7d7d-d4b7-42b1-8ff0-56199d2d98a8 tempest-ProjectReaderTests-1422491147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d6dda924-85f1-4a07-afba-fa5eed34a4d0" returned: 0 in 0.494s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:33 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-b16e7d7d-d4b7-42b1-8ff0-56199d2d98a8 tempest-ProjectReaderTests-1422491147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d6dda924-85f1-4a07-afba-fa5eed34a4d0 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:33 devstack sudo[104544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d6dda924-85f1-4a07-afba-fa5eed34a4d0 Sep 23 14:51:33 devstack sudo[104544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:33 devstack sudo[104544]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:33 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-b16e7d7d-d4b7-42b1-8ff0-56199d2d98a8 tempest-ProjectReaderTests-1422491147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-d6dda924-85f1-4a07-afba-fa5eed34a4d0" returned: 0 in 0.336s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:33 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-b16e7d7d-d4b7-42b1-8ff0-56199d2d98a8 tempest-ProjectReaderTests-1422491147 None] Lock "cinder-quobyte-d6dda924-85f1-4a07-afba-fa5eed34a4d0" released by "delete_volume" :: held 0.915s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:51:33 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-b16e7d7d-d4b7-42b1-8ff0-56199d2d98a8 tempest-ProjectReaderTests-1422491147 None] Created reservations ['bdb7f31f-e523-4e3b-a3b7-84a7769b5d18', '790b6579-4392-4661-b23a-19dfd703dac5', '91d87552-9fd5-4962-a779-b5c31b1172a5', '69d72e49-0c21-4031-9e1e-6df901ba00a9'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:51:33 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-b16e7d7d-d4b7-42b1-8ff0-56199d2d98a8 tempest-ProjectReaderTests-1422491147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:51:33 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-b16e7d7d-d4b7-42b1-8ff0-56199d2d98a8 tempest-ProjectReaderTests-1422491147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:51:33 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-b16e7d7d-d4b7-42b1-8ff0-56199d2d98a8 tempest-ProjectReaderTests-1422491147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:51:33 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-b16e7d7d-d4b7-42b1-8ff0-56199d2d98a8 tempest-ProjectReaderTests-1422491147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:51:33 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-b16e7d7d-d4b7-42b1-8ff0-56199d2d98a8 tempest-ProjectReaderTests-1422491147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:51:33 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-b16e7d7d-d4b7-42b1-8ff0-56199d2d98a8 tempest-ProjectReaderTests-1422491147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:33 devstack sudo[104554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:51:33 devstack sudo[104554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:34 devstack sudo[104554]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:34 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-b16e7d7d-d4b7-42b1-8ff0-56199d2d98a8 tempest-ProjectReaderTests-1422491147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.659s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:34 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-b16e7d7d-d4b7-42b1-8ff0-56199d2d98a8 tempest-ProjectReaderTests-1422491147 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:51:34 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-b16e7d7d-d4b7-42b1-8ff0-56199d2d98a8 tempest-ProjectReaderTests-1422491147 None] Deleted volume successfully. Sep 23 14:51:34 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-b16e7d7d-d4b7-42b1-8ff0-56199d2d98a8 tempest-ProjectReaderTests-1422491147 None] Lock "cinder-d6dda924-85f1-4a07-afba-fa5eed34a4d0-delete_volume" released by "delete_volume" :: held 2.059s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:51:41 devstack sudo[104534]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:41 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-131fdb15-2ed0-4b98-9a7d-6a73c0622823 tempest-VolumeDependencyTests-1903059066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-574a9942-452f-4442-8e8f-b5cedb2ccd0d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-76f861e7-1efa-423f-93f0-3ecbfe142dfa" returned: 0 in 8.880s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:41 devstack cinder-volume[86310]: DEBUG cinder.image.image_utils [None req-131fdb15-2ed0-4b98-9a7d-6a73c0622823 tempest-VolumeDependencyTests-1903059066 None] Image conversion details: src /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-574a9942-452f-4442-8e8f-b5cedb2ccd0d, size 1024.00 MB, duration 8.88 sec, destination /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-76f861e7-1efa-423f-93f0-3ecbfe142dfa {{(pid=86310) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 14:51:41 devstack cinder-volume[86310]: INFO cinder.image.image_utils [None req-131fdb15-2ed0-4b98-9a7d-6a73c0622823 tempest-VolumeDependencyTests-1903059066 None] Converted 1024.00 MB image at 115.28 MB/s Sep 23 14:51:41 devstack cinder-volume[86310]: WARNING cinder.volume.drivers.remotefs [None req-131fdb15-2ed0-4b98-9a7d-6a73c0622823 tempest-VolumeDependencyTests-1903059066 None] /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-76f861e7-1efa-423f-93f0-3ecbfe142dfa is being set with open permissions: ugo+rw Sep 23 14:51:41 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-131fdb15-2ed0-4b98-9a7d-6a73c0622823 tempest-VolumeDependencyTests-1903059066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-76f861e7-1efa-423f-93f0-3ecbfe142dfa {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:41 devstack sudo[104565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-76f861e7-1efa-423f-93f0-3ecbfe142dfa Sep 23 14:51:41 devstack sudo[104565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:41 devstack sudo[104565]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:41 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-131fdb15-2ed0-4b98-9a7d-6a73c0622823 tempest-VolumeDependencyTests-1903059066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-76f861e7-1efa-423f-93f0-3ecbfe142dfa" returned: 0 in 0.323s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:42 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-131fdb15-2ed0-4b98-9a7d-6a73c0622823 tempest-VolumeDependencyTests-1903059066 None] Lock "cinder-quobyte-76f861e7-1efa-423f-93f0-3ecbfe142dfa" released by "_copy_volume_from_snapshot" :: held 10.258s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:51:42 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-131fdb15-2ed0-4b98-9a7d-6a73c0622823 tempest-VolumeDependencyTests-1903059066 None] Lock "cinder-quobyte-0fac3eda-f253-4eff-b5e7-fd9827eba3b5-76f861e7-1efa-423f-93f0-3ecbfe142dfa" released by "_create_volume_from_snapshot" :: held 10.333s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:51:42 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-131fdb15-2ed0-4b98-9a7d-6a73c0622823 tempest-VolumeDependencyTests-1903059066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.349s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:51:42 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-131fdb15-2ed0-4b98-9a7d-6a73c0622823 tempest-VolumeDependencyTests-1903059066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81814798-47d0-4a32-86ab-686c9c3470ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76f861e7-1efa-423f-93f0-3ecbfe142dfa', 'volume_size': 1, 'snapshot_id': '0fac3eda-f253-4eff-b5e7-fd9827eba3b5'}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:42 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-131fdb15-2ed0-4b98-9a7d-6a73c0622823 tempest-VolumeDependencyTests-1903059066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fd14db7-d435-42d9-99db-e4236a37c53a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:42 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-131fdb15-2ed0-4b98-9a7d-6a73c0622823 tempest-VolumeDependencyTests-1903059066 None] Volume volume-76f861e7-1efa-423f-93f0-3ecbfe142dfa (76f861e7-1efa-423f-93f0-3ecbfe142dfa): created successfully Sep 23 14:51:42 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-131fdb15-2ed0-4b98-9a7d-6a73c0622823 tempest-VolumeDependencyTests-1903059066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fd14db7-d435-42d9-99db-e4236a37c53a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:42 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-131fdb15-2ed0-4b98-9a7d-6a73c0622823 tempest-VolumeDependencyTests-1903059066 None] Flow 'volume_create_manager' (530d1ee6-9cd7-458f-b33a-440fd67663b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:51:42 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-131fdb15-2ed0-4b98-9a7d-6a73c0622823 tempest-VolumeDependencyTests-1903059066 None] Created volume successfully. Sep 23 14:51:42 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-e90b6fa4-86d7-4096-8908-84a457f7462e tempest-VolumeDependencyTests-1903059066 None] Acquiring lock "cinder-0fac3eda-f253-4eff-b5e7-fd9827eba3b5-delete_snapshot" by "delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:51:42 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-e90b6fa4-86d7-4096-8908-84a457f7462e tempest-VolumeDependencyTests-1903059066 None] Lock "cinder-0fac3eda-f253-4eff-b5e7-fd9827eba3b5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:51:42 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-e90b6fa4-86d7-4096-8908-84a457f7462e tempest-VolumeDependencyTests-1903059066 None] Acquiring lock "cinder-quobyte-574a9942-452f-4442-8e8f-b5cedb2ccd0d" by "delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:51:42 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-e90b6fa4-86d7-4096-8908-84a457f7462e tempest-VolumeDependencyTests-1903059066 None] Lock "cinder-quobyte-574a9942-452f-4442-8e8f-b5cedb2ccd0d" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:51:42 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-e90b6fa4-86d7-4096-8908-84a457f7462e tempest-VolumeDependencyTests-1903059066 None] Acquiring lock "cinder-quobyte-0fac3eda-f253-4eff-b5e7-fd9827eba3b5" by "_delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:51:42 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-e90b6fa4-86d7-4096-8908-84a457f7462e tempest-VolumeDependencyTests-1903059066 None] Lock "cinder-quobyte-0fac3eda-f253-4eff-b5e7-fd9827eba3b5" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:51:42 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-e90b6fa4-86d7-4096-8908-84a457f7462e tempest-VolumeDependencyTests-1903059066 None] Deleting offline snapshot 0fac3eda-f253-4eff-b5e7-fd9827eba3b5 of volume 574a9942-452f-4442-8e8f-b5cedb2ccd0d {{(pid=86310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 14:51:43 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-e90b6fa4-86d7-4096-8908-84a457f7462e tempest-VolumeDependencyTests-1903059066 None] snapshot_file for this snap is: volume-574a9942-452f-4442-8e8f-b5cedb2ccd0d.0fac3eda-f253-4eff-b5e7-fd9827eba3b5 {{(pid=86310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 14:51:43 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[0644769e-11f2-42fa-b8de-9b5affa7ecf5]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:51:43 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-e90b6fa4-86d7-4096-8908-84a457f7462e tempest-VolumeDependencyTests-1903059066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-574a9942-452f-4442-8e8f-b5cedb2ccd0d.0fac3eda-f253-4eff-b5e7-fd9827eba3b5 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:43 devstack sudo[104569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-574a9942-452f-4442-8e8f-b5cedb2ccd0d.0fac3eda-f253-4eff-b5e7-fd9827eba3b5 Sep 23 14:51:43 devstack sudo[104569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:43 devstack sudo[104569]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:43 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-e90b6fa4-86d7-4096-8908-84a457f7462e tempest-VolumeDependencyTests-1903059066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-574a9942-452f-4442-8e8f-b5cedb2ccd0d.0fac3eda-f253-4eff-b5e7-fd9827eba3b5" returned: 0 in 0.470s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:43 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-e90b6fa4-86d7-4096-8908-84a457f7462e tempest-VolumeDependencyTests-1903059066 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-574a9942-452f-4442-8e8f-b5cedb2ccd0d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 14:51:43 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb4b41b-4b05-4bdc-869b-3aa409cd3b1a]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:51:43 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-e90b6fa4-86d7-4096-8908-84a457f7462e tempest-VolumeDependencyTests-1903059066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-574a9942-452f-4442-8e8f-b5cedb2ccd0d {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:43 devstack sudo[104574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-574a9942-452f-4442-8e8f-b5cedb2ccd0d Sep 23 14:51:43 devstack sudo[104574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:43 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-92ac51ca-e93f-460b-a783-fcdb3f445b97 tempest-ProjectMemberTests-700601358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:51:43 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-92ac51ca-e93f-460b-a783-fcdb3f445b97 tempest-ProjectMemberTests-700601358 None] Flow 'volume_create_manager' (d2f80797-1149-4ce7-97a4-0da68322732f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:51:43 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-92ac51ca-e93f-460b-a783-fcdb3f445b97 tempest-ProjectMemberTests-700601358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf13df0b-6618-4306-9251-61dc2c182cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:43 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-92ac51ca-e93f-460b-a783-fcdb3f445b97 tempest-ProjectMemberTests-700601358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf13df0b-6618-4306-9251-61dc2c182cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:51:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1036124862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43b1ae93-73a1-4a57-bb2f-d48a68025748,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96e82c6bd57443b895414c81e35dd400',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:51:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:51:44Z,use_quota=True,user_id='ec53ea8e97044f789c6e4da593a5da06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:43 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-92ac51ca-e93f-460b-a783-fcdb3f445b97 tempest-ProjectMemberTests-700601358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbaa4944-5f48-41e6-969e-1f0445b0edea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:43 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-92ac51ca-e93f-460b-a783-fcdb3f445b97 tempest-ProjectMemberTests-700601358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbaa4944-5f48-41e6-969e-1f0445b0edea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:43 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-92ac51ca-e93f-460b-a783-fcdb3f445b97 tempest-ProjectMemberTests-700601358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38eb61d1-8c57-4514-b23b-bc9d04c63854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:43 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-92ac51ca-e93f-460b-a783-fcdb3f445b97 tempest-ProjectMemberTests-700601358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38eb61d1-8c57-4514-b23b-bc9d04c63854) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43b1ae93-73a1-4a57-bb2f-d48a68025748', 'volume_name': 'volume-43b1ae93-73a1-4a57-bb2f-d48a68025748', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:43 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-92ac51ca-e93f-460b-a783-fcdb3f445b97 tempest-ProjectMemberTests-700601358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4e6b138-eac7-4a0b-ab57-3c70a6bf65cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:43 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-92ac51ca-e93f-460b-a783-fcdb3f445b97 tempest-ProjectMemberTests-700601358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4e6b138-eac7-4a0b-ab57-3c70a6bf65cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:43 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-92ac51ca-e93f-460b-a783-fcdb3f445b97 tempest-ProjectMemberTests-700601358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36b26dc2-c19d-41ce-9a87-7585d8a143ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:43 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-92ac51ca-e93f-460b-a783-fcdb3f445b97 tempest-ProjectMemberTests-700601358 None] Volume 43b1ae93-73a1-4a57-bb2f-d48a68025748: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43b1ae93-73a1-4a57-bb2f-d48a68025748', 'volume_size': 1} Sep 23 14:51:43 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-92ac51ca-e93f-460b-a783-fcdb3f445b97 tempest-ProjectMemberTests-700601358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:51:43 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-92ac51ca-e93f-460b-a783-fcdb3f445b97 tempest-ProjectMemberTests-700601358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:51:43 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-92ac51ca-e93f-460b-a783-fcdb3f445b97 tempest-ProjectMemberTests-700601358 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:51:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1036124862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43b1ae93-73a1-4a57-bb2f-d48a68025748,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96e82c6bd57443b895414c81e35dd400',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:51:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:51:44Z,use_quota=True,user_id='ec53ea8e97044f789c6e4da593a5da06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:51:43 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-92ac51ca-e93f-460b-a783-fcdb3f445b97 tempest-ProjectMemberTests-700601358 None] Creating volume 43b1ae93-73a1-4a57-bb2f-d48a68025748 {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:51:43 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-92ac51ca-e93f-460b-a783-fcdb3f445b97 tempest-ProjectMemberTests-700601358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:51:43 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-92ac51ca-e93f-460b-a783-fcdb3f445b97 tempest-ProjectMemberTests-700601358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:51:43 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-92ac51ca-e93f-460b-a783-fcdb3f445b97 tempest-ProjectMemberTests-700601358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:51:43 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-92ac51ca-e93f-460b-a783-fcdb3f445b97 tempest-ProjectMemberTests-700601358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:51:43 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-92ac51ca-e93f-460b-a783-fcdb3f445b97 tempest-ProjectMemberTests-700601358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:51:43 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-92ac51ca-e93f-460b-a783-fcdb3f445b97 tempest-ProjectMemberTests-700601358 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:51:43 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-92ac51ca-e93f-460b-a783-fcdb3f445b97 tempest-ProjectMemberTests-700601358 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:51:43 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-92ac51ca-e93f-460b-a783-fcdb3f445b97 tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-43b1ae93-73a1-4a57-bb2f-d48a68025748 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:44 devstack sudo[104578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-43b1ae93-73a1-4a57-bb2f-d48a68025748 1073741824 Sep 23 14:51:44 devstack sudo[104578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:44 devstack sudo[104574]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:44 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-e90b6fa4-86d7-4096-8908-84a457f7462e tempest-VolumeDependencyTests-1903059066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-574a9942-452f-4442-8e8f-b5cedb2ccd0d" returned: 0 in 0.602s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:44 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-e90b6fa4-86d7-4096-8908-84a457f7462e tempest-VolumeDependencyTests-1903059066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-574a9942-452f-4442-8e8f-b5cedb2ccd0d.0fac3eda-f253-4eff-b5e7-fd9827eba3b5 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:44 devstack sudo[104582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-574a9942-452f-4442-8e8f-b5cedb2ccd0d.0fac3eda-f253-4eff-b5e7-fd9827eba3b5 Sep 23 14:51:44 devstack sudo[104582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:44 devstack sudo[104578]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:44 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-92ac51ca-e93f-460b-a783-fcdb3f445b97 tempest-ProjectMemberTests-700601358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-43b1ae93-73a1-4a57-bb2f-d48a68025748 1073741824" returned: 0 in 0.529s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:44 devstack sudo[104582]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:44 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-e90b6fa4-86d7-4096-8908-84a457f7462e tempest-VolumeDependencyTests-1903059066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-574a9942-452f-4442-8e8f-b5cedb2ccd0d.0fac3eda-f253-4eff-b5e7-fd9827eba3b5" returned: 0 in 0.379s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:44 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-e90b6fa4-86d7-4096-8908-84a457f7462e tempest-VolumeDependencyTests-1903059066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-574a9942-452f-4442-8e8f-b5cedb2ccd0d.0fac3eda-f253-4eff-b5e7-fd9827eba3b5 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:44 devstack sudo[104591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-574a9942-452f-4442-8e8f-b5cedb2ccd0d.0fac3eda-f253-4eff-b5e7-fd9827eba3b5 Sep 23 14:51:44 devstack sudo[104591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:44 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-92ac51ca-e93f-460b-a783-fcdb3f445b97 tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-43b1ae93-73a1-4a57-bb2f-d48a68025748 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:44 devstack sudo[104593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-43b1ae93-73a1-4a57-bb2f-d48a68025748 Sep 23 14:51:44 devstack sudo[104593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:44 devstack sudo[104591]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:44 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-e90b6fa4-86d7-4096-8908-84a457f7462e tempest-VolumeDependencyTests-1903059066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-574a9942-452f-4442-8e8f-b5cedb2ccd0d.0fac3eda-f253-4eff-b5e7-fd9827eba3b5" returned: 0 in 0.265s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:44 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-e90b6fa4-86d7-4096-8908-84a457f7462e tempest-VolumeDependencyTests-1903059066 None] Lock "cinder-quobyte-0fac3eda-f253-4eff-b5e7-fd9827eba3b5" released by "_delete_snapshot" :: held 1.872s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:51:44 devstack sudo[104593]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:44 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-e90b6fa4-86d7-4096-8908-84a457f7462e tempest-VolumeDependencyTests-1903059066 None] Lock "cinder-quobyte-574a9942-452f-4442-8e8f-b5cedb2ccd0d" released by "delete_snapshot" :: held 1.900s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:51:44 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-92ac51ca-e93f-460b-a783-fcdb3f445b97 tempest-ProjectMemberTests-700601358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-43b1ae93-73a1-4a57-bb2f-d48a68025748" returned: 0 in 0.305s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:44 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-92ac51ca-e93f-460b-a783-fcdb3f445b97 tempest-ProjectMemberTests-700601358 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:51:44 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-92ac51ca-e93f-460b-a783-fcdb3f445b97 tempest-ProjectMemberTests-700601358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:51:44 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-92ac51ca-e93f-460b-a783-fcdb3f445b97 tempest-ProjectMemberTests-700601358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36b26dc2-c19d-41ce-9a87-7585d8a143ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43b1ae93-73a1-4a57-bb2f-d48a68025748', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:44 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-92ac51ca-e93f-460b-a783-fcdb3f445b97 tempest-ProjectMemberTests-700601358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42b1af49-48f0-4ac0-b1b0-b382ed90fd6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:44 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-92ac51ca-e93f-460b-a783-fcdb3f445b97 tempest-ProjectMemberTests-700601358 None] Volume volume-43b1ae93-73a1-4a57-bb2f-d48a68025748 (43b1ae93-73a1-4a57-bb2f-d48a68025748): created successfully Sep 23 14:51:44 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-92ac51ca-e93f-460b-a783-fcdb3f445b97 tempest-ProjectMemberTests-700601358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42b1af49-48f0-4ac0-b1b0-b382ed90fd6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:44 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-92ac51ca-e93f-460b-a783-fcdb3f445b97 tempest-ProjectMemberTests-700601358 None] Flow 'volume_create_manager' (d2f80797-1149-4ce7-97a4-0da68322732f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:51:44 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-92ac51ca-e93f-460b-a783-fcdb3f445b97 tempest-ProjectMemberTests-700601358 None] Created volume successfully. Sep 23 14:51:44 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-e90b6fa4-86d7-4096-8908-84a457f7462e tempest-VolumeDependencyTests-1903059066 None] Created reservations ['e1a5ed99-fe2a-4559-a5ac-43770f411db9', '8a590c07-0a85-42dc-af94-41855df5a5cd', '7af000af-e88d-4de7-b3b6-a117905c958e', '3b1839db-3f01-4d9b-a426-f575fa19b259'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:51:45 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-e90b6fa4-86d7-4096-8908-84a457f7462e tempest-VolumeDependencyTests-1903059066 None] Delete snapshot completed successfully. Sep 23 14:51:45 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-e90b6fa4-86d7-4096-8908-84a457f7462e tempest-VolumeDependencyTests-1903059066 None] Lock "cinder-0fac3eda-f253-4eff-b5e7-fd9827eba3b5-delete_snapshot" released by "delete_snapshot" :: held 2.118s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:51:45 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-85aafcd1-b930-4af2-81e7-cedb8ce28086 tempest-VolumeDependencyTests-1903059066 None] Acquiring lock "cinder-574a9942-452f-4442-8e8f-b5cedb2ccd0d-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:51:45 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-85aafcd1-b930-4af2-81e7-cedb8ce28086 tempest-VolumeDependencyTests-1903059066 None] Lock "cinder-574a9942-452f-4442-8e8f-b5cedb2ccd0d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:51:45 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-85aafcd1-b930-4af2-81e7-cedb8ce28086 tempest-VolumeDependencyTests-1903059066 None] Acquiring lock "cinder-quobyte-574a9942-452f-4442-8e8f-b5cedb2ccd0d" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:51:45 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-85aafcd1-b930-4af2-81e7-cedb8ce28086 tempest-VolumeDependencyTests-1903059066 None] Lock "cinder-quobyte-574a9942-452f-4442-8e8f-b5cedb2ccd0d" acquired by "delete_volume" :: waited 0.018s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:51:45 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd3623d7-0328-42fa-bc8a-7cc6fa028b2c]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:51:45 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-85aafcd1-b930-4af2-81e7-cedb8ce28086 tempest-VolumeDependencyTests-1903059066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-574a9942-452f-4442-8e8f-b5cedb2ccd0d {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:45 devstack sudo[104597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-574a9942-452f-4442-8e8f-b5cedb2ccd0d Sep 23 14:51:45 devstack sudo[104597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:45 devstack sudo[104597]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:45 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-85aafcd1-b930-4af2-81e7-cedb8ce28086 tempest-VolumeDependencyTests-1903059066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-574a9942-452f-4442-8e8f-b5cedb2ccd0d" returned: 0 in 0.393s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:45 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-85aafcd1-b930-4af2-81e7-cedb8ce28086 tempest-VolumeDependencyTests-1903059066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-574a9942-452f-4442-8e8f-b5cedb2ccd0d {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:45 devstack sudo[104602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-574a9942-452f-4442-8e8f-b5cedb2ccd0d Sep 23 14:51:45 devstack sudo[104602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:45 devstack sudo[104602]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:45 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-85aafcd1-b930-4af2-81e7-cedb8ce28086 tempest-VolumeDependencyTests-1903059066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-574a9942-452f-4442-8e8f-b5cedb2ccd0d" returned: 0 in 0.275s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:45 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-85aafcd1-b930-4af2-81e7-cedb8ce28086 tempest-VolumeDependencyTests-1903059066 None] Lock "cinder-quobyte-574a9942-452f-4442-8e8f-b5cedb2ccd0d" released by "delete_volume" :: held 0.760s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:51:46 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-85aafcd1-b930-4af2-81e7-cedb8ce28086 tempest-VolumeDependencyTests-1903059066 None] Created reservations ['4313c0ae-ef4d-4886-9eaf-255153d77a97', 'd2712ee8-57a9-4bb3-bace-e5318a824b23', 'c9603a14-72ca-4d10-b5a3-32a64ad73ef6', '782c8495-638b-4f45-823a-09125641b752'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:51:46 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-85aafcd1-b930-4af2-81e7-cedb8ce28086 tempest-VolumeDependencyTests-1903059066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:51:46 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-85aafcd1-b930-4af2-81e7-cedb8ce28086 tempest-VolumeDependencyTests-1903059066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:51:46 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-85aafcd1-b930-4af2-81e7-cedb8ce28086 tempest-VolumeDependencyTests-1903059066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:51:46 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-85aafcd1-b930-4af2-81e7-cedb8ce28086 tempest-VolumeDependencyTests-1903059066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:51:46 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-85aafcd1-b930-4af2-81e7-cedb8ce28086 tempest-VolumeDependencyTests-1903059066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:51:46 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-85aafcd1-b930-4af2-81e7-cedb8ce28086 tempest-VolumeDependencyTests-1903059066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:46 devstack sudo[104605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:51:46 devstack sudo[104605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:46 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-96312f86-b831-4cdd-be33-b259a01a4617 tempest-VolumeDependencyTests-1903059066 None] Acquiring lock "cinder-76f861e7-1efa-423f-93f0-3ecbfe142dfa-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:51:46 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-96312f86-b831-4cdd-be33-b259a01a4617 tempest-VolumeDependencyTests-1903059066 None] Lock "cinder-76f861e7-1efa-423f-93f0-3ecbfe142dfa-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:51:46 devstack sudo[104605]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:46 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-85aafcd1-b930-4af2-81e7-cedb8ce28086 tempest-VolumeDependencyTests-1903059066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.324s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:46 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-85aafcd1-b930-4af2-81e7-cedb8ce28086 tempest-VolumeDependencyTests-1903059066 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:51:46 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-96312f86-b831-4cdd-be33-b259a01a4617 tempest-VolumeDependencyTests-1903059066 None] Acquiring lock "cinder-quobyte-76f861e7-1efa-423f-93f0-3ecbfe142dfa" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:51:46 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-85aafcd1-b930-4af2-81e7-cedb8ce28086 tempest-VolumeDependencyTests-1903059066 None] Deleted volume successfully. Sep 23 14:51:46 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-96312f86-b831-4cdd-be33-b259a01a4617 tempest-VolumeDependencyTests-1903059066 None] Lock "cinder-quobyte-76f861e7-1efa-423f-93f0-3ecbfe142dfa" acquired by "delete_volume" :: waited 0.022s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:51:46 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f348da-ad14-4cb8-a5be-65aab15d5b62]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:51:46 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-85aafcd1-b930-4af2-81e7-cedb8ce28086 tempest-VolumeDependencyTests-1903059066 None] Lock "cinder-574a9942-452f-4442-8e8f-b5cedb2ccd0d-delete_volume" released by "delete_volume" :: held 1.388s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:51:46 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-96312f86-b831-4cdd-be33-b259a01a4617 tempest-VolumeDependencyTests-1903059066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-76f861e7-1efa-423f-93f0-3ecbfe142dfa {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:46 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-a413e891-f52d-48b1-bddb-62dac59d62fa tempest-ProjectMemberTests-700601358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:51:46 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-a413e891-f52d-48b1-bddb-62dac59d62fa tempest-ProjectMemberTests-700601358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:51:46 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-a413e891-f52d-48b1-bddb-62dac59d62fa tempest-ProjectMemberTests-700601358 None] Creating offline snapshot 38ccfebc-147e-4ed1-ba08-d6562555708a of volume 43b1ae93-73a1-4a57-bb2f-d48a68025748 {{(pid=86310) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 14:51:46 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[2415467e-af78-46ed-8df5-3928ec7cfb86]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:51:46 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a413e891-f52d-48b1-bddb-62dac59d62fa tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-43b1ae93-73a1-4a57-bb2f-d48a68025748 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:46 devstack sudo[104608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-76f861e7-1efa-423f-93f0-3ecbfe142dfa Sep 23 14:51:46 devstack sudo[104608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:46 devstack sudo[104609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-43b1ae93-73a1-4a57-bb2f-d48a68025748 Sep 23 14:51:46 devstack sudo[104609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:46 devstack sudo[104608]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:46 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-96312f86-b831-4cdd-be33-b259a01a4617 tempest-VolumeDependencyTests-1903059066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-76f861e7-1efa-423f-93f0-3ecbfe142dfa" returned: 0 in 0.387s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:46 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-96312f86-b831-4cdd-be33-b259a01a4617 tempest-VolumeDependencyTests-1903059066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-76f861e7-1efa-423f-93f0-3ecbfe142dfa {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:46 devstack sudo[104615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-76f861e7-1efa-423f-93f0-3ecbfe142dfa Sep 23 14:51:46 devstack sudo[104615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:47 devstack sudo[104609]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:47 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a413e891-f52d-48b1-bddb-62dac59d62fa tempest-ProjectMemberTests-700601358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-43b1ae93-73a1-4a57-bb2f-d48a68025748" returned: 0 in 0.431s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:47 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a413e891-f52d-48b1-bddb-62dac59d62fa tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-43b1ae93-73a1-4a57-bb2f-d48a68025748,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-43b1ae93-73a1-4a57-bb2f-d48a68025748.38ccfebc-147e-4ed1-ba08-d6562555708a 1G {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:47 devstack sudo[104620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-43b1ae93-73a1-4a57-bb2f-d48a68025748,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-43b1ae93-73a1-4a57-bb2f-d48a68025748.38ccfebc-147e-4ed1-ba08-d6562555708a 1G Sep 23 14:51:47 devstack sudo[104620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:47 devstack sudo[104615]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:47 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-96312f86-b831-4cdd-be33-b259a01a4617 tempest-VolumeDependencyTests-1903059066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-76f861e7-1efa-423f-93f0-3ecbfe142dfa" returned: 0 in 0.264s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:47 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-96312f86-b831-4cdd-be33-b259a01a4617 tempest-VolumeDependencyTests-1903059066 None] Lock "cinder-quobyte-76f861e7-1efa-423f-93f0-3ecbfe142dfa" released by "delete_volume" :: held 0.714s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:51:47 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-96312f86-b831-4cdd-be33-b259a01a4617 tempest-VolumeDependencyTests-1903059066 None] Created reservations ['bb920ca2-8beb-4ed9-823c-0eda87d5106c', '20137102-5aaa-4d8c-803b-90f37940c359', '80f3cde3-a0a5-4873-b939-21084593c20b', 'f001ac5b-2e47-467b-9102-bf3de346cf6f'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:51:47 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-96312f86-b831-4cdd-be33-b259a01a4617 tempest-VolumeDependencyTests-1903059066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:51:47 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-96312f86-b831-4cdd-be33-b259a01a4617 tempest-VolumeDependencyTests-1903059066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:51:47 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-96312f86-b831-4cdd-be33-b259a01a4617 tempest-VolumeDependencyTests-1903059066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:51:47 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-96312f86-b831-4cdd-be33-b259a01a4617 tempest-VolumeDependencyTests-1903059066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:51:47 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-96312f86-b831-4cdd-be33-b259a01a4617 tempest-VolumeDependencyTests-1903059066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:51:47 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-96312f86-b831-4cdd-be33-b259a01a4617 tempest-VolumeDependencyTests-1903059066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:47 devstack sudo[104625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:51:47 devstack sudo[104625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:47 devstack sudo[104620]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:47 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a413e891-f52d-48b1-bddb-62dac59d62fa tempest-ProjectMemberTests-700601358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-43b1ae93-73a1-4a57-bb2f-d48a68025748,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-43b1ae93-73a1-4a57-bb2f-d48a68025748.38ccfebc-147e-4ed1-ba08-d6562555708a 1G" returned: 0 in 0.566s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:47 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a413e891-f52d-48b1-bddb-62dac59d62fa tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43b1ae93-73a1-4a57-bb2f-d48a68025748 -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-43b1ae93-73a1-4a57-bb2f-d48a68025748.38ccfebc-147e-4ed1-ba08-d6562555708a {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:47 devstack sudo[104625]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:47 devstack sudo[104630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43b1ae93-73a1-4a57-bb2f-d48a68025748 -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-43b1ae93-73a1-4a57-bb2f-d48a68025748.38ccfebc-147e-4ed1-ba08-d6562555708a Sep 23 14:51:47 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-96312f86-b831-4cdd-be33-b259a01a4617 tempest-VolumeDependencyTests-1903059066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.318s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:47 devstack sudo[104630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:47 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-96312f86-b831-4cdd-be33-b259a01a4617 tempest-VolumeDependencyTests-1903059066 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:51:47 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-96312f86-b831-4cdd-be33-b259a01a4617 tempest-VolumeDependencyTests-1903059066 None] Deleted volume successfully. Sep 23 14:51:47 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-96312f86-b831-4cdd-be33-b259a01a4617 tempest-VolumeDependencyTests-1903059066 None] Lock "cinder-76f861e7-1efa-423f-93f0-3ecbfe142dfa-delete_volume" released by "delete_volume" :: held 1.306s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:51:47 devstack sudo[104630]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:47 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a413e891-f52d-48b1-bddb-62dac59d62fa tempest-ProjectMemberTests-700601358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43b1ae93-73a1-4a57-bb2f-d48a68025748 -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-43b1ae93-73a1-4a57-bb2f-d48a68025748.38ccfebc-147e-4ed1-ba08-d6562555708a" returned: 0 in 0.350s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:47 devstack cinder-volume[86310]: WARNING cinder.volume.drivers.remotefs [None req-a413e891-f52d-48b1-bddb-62dac59d62fa tempest-ProjectMemberTests-700601358 None] /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-43b1ae93-73a1-4a57-bb2f-d48a68025748.38ccfebc-147e-4ed1-ba08-d6562555708a is being set with open permissions: ugo+rw Sep 23 14:51:47 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a413e891-f52d-48b1-bddb-62dac59d62fa tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-43b1ae93-73a1-4a57-bb2f-d48a68025748.38ccfebc-147e-4ed1-ba08-d6562555708a {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:48 devstack sudo[104635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-43b1ae93-73a1-4a57-bb2f-d48a68025748.38ccfebc-147e-4ed1-ba08-d6562555708a Sep 23 14:51:48 devstack sudo[104635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:48 devstack sudo[104635]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:48 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a413e891-f52d-48b1-bddb-62dac59d62fa tempest-ProjectMemberTests-700601358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-43b1ae93-73a1-4a57-bb2f-d48a68025748.38ccfebc-147e-4ed1-ba08-d6562555708a" returned: 0 in 0.307s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:48 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a413e891-f52d-48b1-bddb-62dac59d62fa tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-43b1ae93-73a1-4a57-bb2f-d48a68025748.info {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:48 devstack sudo[104638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-43b1ae93-73a1-4a57-bb2f-d48a68025748.info Sep 23 14:51:48 devstack sudo[104638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:48 devstack sudo[104638]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:48 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a413e891-f52d-48b1-bddb-62dac59d62fa tempest-ProjectMemberTests-700601358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-43b1ae93-73a1-4a57-bb2f-d48a68025748.info" returned: 0 in 0.319s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:48 devstack cinder-volume[86310]: WARNING cinder.volume.drivers.remotefs [None req-a413e891-f52d-48b1-bddb-62dac59d62fa tempest-ProjectMemberTests-700601358 None] /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-43b1ae93-73a1-4a57-bb2f-d48a68025748.info is being set with open permissions: ugo+rw Sep 23 14:51:48 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a413e891-f52d-48b1-bddb-62dac59d62fa tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-43b1ae93-73a1-4a57-bb2f-d48a68025748.info {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:48 devstack sudo[104641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-43b1ae93-73a1-4a57-bb2f-d48a68025748.info Sep 23 14:51:48 devstack sudo[104641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:48 devstack sudo[104641]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:48 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a413e891-f52d-48b1-bddb-62dac59d62fa tempest-ProjectMemberTests-700601358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-43b1ae93-73a1-4a57-bb2f-d48a68025748.info" returned: 0 in 0.285s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:48 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-a413e891-f52d-48b1-bddb-62dac59d62fa tempest-ProjectMemberTests-700601358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.378s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:51:48 devstack cinder-volume[86310]: DEBUG dbcounter [-] [86310] Writing DB stats cinder:SELECT=243,cinder:UPDATE=314,cinder:INSERT=82,cinder:DELETE=32 {{(pid=86310) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 14:51:48 devstack cinder-volume[86310]: DEBUG dbcounter [-] [86310] Writing DB stats cinder:UPDATE=337,cinder:SELECT=226,cinder:INSERT=89,cinder:DELETE=26 {{(pid=86310) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 14:51:49 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-a413e891-f52d-48b1-bddb-62dac59d62fa tempest-ProjectMemberTests-700601358 None] Create snapshot completed successfully Sep 23 14:51:49 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-48acf3f3-ff5c-44b2-b264-21613e085f56 tempest-ProjectMemberTests-700601358 None] Acquiring lock "cinder-38ccfebc-147e-4ed1-ba08-d6562555708a-delete_snapshot" by "delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:51:49 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-48acf3f3-ff5c-44b2-b264-21613e085f56 tempest-ProjectMemberTests-700601358 None] Lock "cinder-38ccfebc-147e-4ed1-ba08-d6562555708a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:51:49 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-48acf3f3-ff5c-44b2-b264-21613e085f56 tempest-ProjectMemberTests-700601358 None] Acquiring lock "cinder-quobyte-43b1ae93-73a1-4a57-bb2f-d48a68025748" by "delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:51:49 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-48acf3f3-ff5c-44b2-b264-21613e085f56 tempest-ProjectMemberTests-700601358 None] Lock "cinder-quobyte-43b1ae93-73a1-4a57-bb2f-d48a68025748" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:51:49 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-48acf3f3-ff5c-44b2-b264-21613e085f56 tempest-ProjectMemberTests-700601358 None] Acquiring lock "cinder-quobyte-38ccfebc-147e-4ed1-ba08-d6562555708a" by "_delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:51:49 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-48acf3f3-ff5c-44b2-b264-21613e085f56 tempest-ProjectMemberTests-700601358 None] Lock "cinder-quobyte-38ccfebc-147e-4ed1-ba08-d6562555708a" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:51:49 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-48acf3f3-ff5c-44b2-b264-21613e085f56 tempest-ProjectMemberTests-700601358 None] Deleting offline snapshot 38ccfebc-147e-4ed1-ba08-d6562555708a of volume 43b1ae93-73a1-4a57-bb2f-d48a68025748 {{(pid=86310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 14:51:49 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-48acf3f3-ff5c-44b2-b264-21613e085f56 tempest-ProjectMemberTests-700601358 None] snapshot_file for this snap is: volume-43b1ae93-73a1-4a57-bb2f-d48a68025748.38ccfebc-147e-4ed1-ba08-d6562555708a {{(pid=86310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 14:51:50 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a25356f-f790-4c26-a8e6-923e42f13b9a]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:51:50 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-48acf3f3-ff5c-44b2-b264-21613e085f56 tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-43b1ae93-73a1-4a57-bb2f-d48a68025748.38ccfebc-147e-4ed1-ba08-d6562555708a {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:50 devstack sudo[104644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-43b1ae93-73a1-4a57-bb2f-d48a68025748.38ccfebc-147e-4ed1-ba08-d6562555708a Sep 23 14:51:50 devstack sudo[104644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:50 devstack sudo[104644]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:50 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-48acf3f3-ff5c-44b2-b264-21613e085f56 tempest-ProjectMemberTests-700601358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-43b1ae93-73a1-4a57-bb2f-d48a68025748.38ccfebc-147e-4ed1-ba08-d6562555708a" returned: 0 in 0.441s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:50 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-48acf3f3-ff5c-44b2-b264-21613e085f56 tempest-ProjectMemberTests-700601358 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-43b1ae93-73a1-4a57-bb2f-d48a68025748(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 14:51:50 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[d27829fb-2aec-49f7-9371-13ba313d44cd]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:51:50 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-48acf3f3-ff5c-44b2-b264-21613e085f56 tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-43b1ae93-73a1-4a57-bb2f-d48a68025748 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:50 devstack sudo[104649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-43b1ae93-73a1-4a57-bb2f-d48a68025748 Sep 23 14:51:50 devstack sudo[104649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:50 devstack sudo[104649]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:50 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-48acf3f3-ff5c-44b2-b264-21613e085f56 tempest-ProjectMemberTests-700601358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-43b1ae93-73a1-4a57-bb2f-d48a68025748" returned: 0 in 0.429s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:50 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-48acf3f3-ff5c-44b2-b264-21613e085f56 tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-43b1ae93-73a1-4a57-bb2f-d48a68025748.38ccfebc-147e-4ed1-ba08-d6562555708a {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:50 devstack sudo[104654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-43b1ae93-73a1-4a57-bb2f-d48a68025748.38ccfebc-147e-4ed1-ba08-d6562555708a Sep 23 14:51:50 devstack sudo[104654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:51 devstack sudo[104654]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-48acf3f3-ff5c-44b2-b264-21613e085f56 tempest-ProjectMemberTests-700601358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-43b1ae93-73a1-4a57-bb2f-d48a68025748.38ccfebc-147e-4ed1-ba08-d6562555708a" returned: 0 in 0.487s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-48acf3f3-ff5c-44b2-b264-21613e085f56 tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-43b1ae93-73a1-4a57-bb2f-d48a68025748.38ccfebc-147e-4ed1-ba08-d6562555708a {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:51 devstack sudo[104659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-43b1ae93-73a1-4a57-bb2f-d48a68025748.38ccfebc-147e-4ed1-ba08-d6562555708a Sep 23 14:51:51 devstack sudo[104659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:51 devstack cinder-volume[86310]: DEBUG oslo_service.periodic_task [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86310) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 14:51:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:51:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:51:51 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:51:51 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:51:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:51:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:51 devstack sudo[104661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:51:51 devstack sudo[104661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:51 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-04611e53-3ef0-4957-b68f-bdf2db70eb01 tempest-ProjectAdminTests-801507664 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.4513206481934, 'free_capacity_gb': 1775.4513206481934, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86310) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 23 14:51:51 devstack sudo[104659]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-48acf3f3-ff5c-44b2-b264-21613e085f56 tempest-ProjectMemberTests-700601358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-43b1ae93-73a1-4a57-bb2f-d48a68025748.38ccfebc-147e-4ed1-ba08-d6562555708a" returned: 0 in 0.461s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:51 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-48acf3f3-ff5c-44b2-b264-21613e085f56 tempest-ProjectMemberTests-700601358 None] Lock "cinder-quobyte-38ccfebc-147e-4ed1-ba08-d6562555708a" released by "_delete_snapshot" :: held 2.064s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:51:51 devstack sudo[104661]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.483s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:51 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:51:52 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-48acf3f3-ff5c-44b2-b264-21613e085f56 tempest-ProjectMemberTests-700601358 None] Lock "cinder-quobyte-43b1ae93-73a1-4a57-bb2f-d48a68025748" released by "delete_snapshot" :: held 2.112s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:51:52 devstack cinder-volume[86310]: DEBUG oslo_service.periodic_task [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Running periodic task VolumeManager._thread_info {{(pid=86310) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 14:51:52 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] thread count: 28 {{(pid=86310) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 14:51:52 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] thread info: [<_MainThread(MainThread, started 128854208852096)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86310) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 14:51:52 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-48acf3f3-ff5c-44b2-b264-21613e085f56 tempest-ProjectMemberTests-700601358 None] Created reservations ['b21a5ea1-9cf7-48db-882c-0f91f3af1863', 'caec6255-4a09-412c-9b36-ceaf565909d5', 'bfeaa735-0fad-4bec-9bcd-2ef2387b154e', 'c00a4770-a4c7-46b6-9742-7f3d679ebe24'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:51:52 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-48acf3f3-ff5c-44b2-b264-21613e085f56 tempest-ProjectMemberTests-700601358 None] Delete snapshot completed successfully. Sep 23 14:51:52 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-48acf3f3-ff5c-44b2-b264-21613e085f56 tempest-ProjectMemberTests-700601358 None] Lock "cinder-38ccfebc-147e-4ed1-ba08-d6562555708a-delete_snapshot" released by "delete_snapshot" :: held 2.325s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:51:53 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-8f0ae203-a4c3-45d0-a547-16a3dacdb62a tempest-ProjectMemberTests-700601358 None] Acquiring lock "cinder-43b1ae93-73a1-4a57-bb2f-d48a68025748-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:51:53 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-8f0ae203-a4c3-45d0-a547-16a3dacdb62a tempest-ProjectMemberTests-700601358 None] Lock "cinder-43b1ae93-73a1-4a57-bb2f-d48a68025748-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:51:53 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-8f0ae203-a4c3-45d0-a547-16a3dacdb62a tempest-ProjectMemberTests-700601358 None] Acquiring lock "cinder-quobyte-43b1ae93-73a1-4a57-bb2f-d48a68025748" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:51:53 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-8f0ae203-a4c3-45d0-a547-16a3dacdb62a tempest-ProjectMemberTests-700601358 None] Lock "cinder-quobyte-43b1ae93-73a1-4a57-bb2f-d48a68025748" acquired by "delete_volume" :: waited 0.021s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:51:53 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[24280b3b-ca25-4bbb-a0ac-9925ccc6a4af]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:51:53 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8f0ae203-a4c3-45d0-a547-16a3dacdb62a tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-43b1ae93-73a1-4a57-bb2f-d48a68025748 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:53 devstack sudo[104666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-43b1ae93-73a1-4a57-bb2f-d48a68025748 Sep 23 14:51:53 devstack sudo[104666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:53 devstack sudo[104666]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:53 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8f0ae203-a4c3-45d0-a547-16a3dacdb62a tempest-ProjectMemberTests-700601358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-43b1ae93-73a1-4a57-bb2f-d48a68025748" returned: 0 in 0.436s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:53 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8f0ae203-a4c3-45d0-a547-16a3dacdb62a tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-43b1ae93-73a1-4a57-bb2f-d48a68025748 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:53 devstack sudo[104671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-43b1ae93-73a1-4a57-bb2f-d48a68025748 Sep 23 14:51:53 devstack sudo[104671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:54 devstack sudo[104671]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:54 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8f0ae203-a4c3-45d0-a547-16a3dacdb62a tempest-ProjectMemberTests-700601358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-43b1ae93-73a1-4a57-bb2f-d48a68025748" returned: 0 in 0.306s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:54 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-8f0ae203-a4c3-45d0-a547-16a3dacdb62a tempest-ProjectMemberTests-700601358 None] Lock "cinder-quobyte-43b1ae93-73a1-4a57-bb2f-d48a68025748" released by "delete_volume" :: held 0.840s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:51:54 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-8f0ae203-a4c3-45d0-a547-16a3dacdb62a tempest-ProjectMemberTests-700601358 None] Created reservations ['768c2b57-c09f-4507-9d89-eaf1f6a0b5a5', '0b16ff4d-ce0b-4524-b19c-256495e262bc', 'd778cb45-1f12-4236-827d-a97c60d4edc4', '96c8a124-c6a0-48d6-b2ed-b44ac9d16c7b'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:51:54 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-8f0ae203-a4c3-45d0-a547-16a3dacdb62a tempest-ProjectMemberTests-700601358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:51:54 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-8f0ae203-a4c3-45d0-a547-16a3dacdb62a tempest-ProjectMemberTests-700601358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:51:54 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-8f0ae203-a4c3-45d0-a547-16a3dacdb62a tempest-ProjectMemberTests-700601358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:51:54 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-8f0ae203-a4c3-45d0-a547-16a3dacdb62a tempest-ProjectMemberTests-700601358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:51:54 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-8f0ae203-a4c3-45d0-a547-16a3dacdb62a tempest-ProjectMemberTests-700601358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:51:54 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8f0ae203-a4c3-45d0-a547-16a3dacdb62a tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:54 devstack sudo[104674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:51:54 devstack sudo[104674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:54 devstack sudo[104674]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:54 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8f0ae203-a4c3-45d0-a547-16a3dacdb62a tempest-ProjectMemberTests-700601358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.309s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:54 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-8f0ae203-a4c3-45d0-a547-16a3dacdb62a tempest-ProjectMemberTests-700601358 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:51:54 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-8f0ae203-a4c3-45d0-a547-16a3dacdb62a tempest-ProjectMemberTests-700601358 None] Deleted volume successfully. Sep 23 14:51:54 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-8f0ae203-a4c3-45d0-a547-16a3dacdb62a tempest-ProjectMemberTests-700601358 None] Lock "cinder-43b1ae93-73a1-4a57-bb2f-d48a68025748-delete_volume" released by "delete_volume" :: held 1.507s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:51:54 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-1385614a-5a5a-48b0-8044-4115cacfe3a5 tempest-ProjectMemberTests-700601358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:51:54 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-1385614a-5a5a-48b0-8044-4115cacfe3a5 tempest-ProjectMemberTests-700601358 None] Flow 'volume_create_manager' (8601a005-f003-48eb-a399-4c66e02d16f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:51:54 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-1385614a-5a5a-48b0-8044-4115cacfe3a5 tempest-ProjectMemberTests-700601358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (428730bf-cf7e-45d7-bcc4-c657e8b6c5f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:54 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-1385614a-5a5a-48b0-8044-4115cacfe3a5 tempest-ProjectMemberTests-700601358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (428730bf-cf7e-45d7-bcc4-c657e8b6c5f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:51:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-730119494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5b39d6d-ac55-4353-b3ba-5bcf9fbf2d76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96e82c6bd57443b895414c81e35dd400',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:51:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:51:55Z,use_quota=True,user_id='ec53ea8e97044f789c6e4da593a5da06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:54 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-1385614a-5a5a-48b0-8044-4115cacfe3a5 tempest-ProjectMemberTests-700601358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73518f87-7eea-4756-bb52-ee5533ff735c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:54 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-1385614a-5a5a-48b0-8044-4115cacfe3a5 tempest-ProjectMemberTests-700601358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73518f87-7eea-4756-bb52-ee5533ff735c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:54 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-1385614a-5a5a-48b0-8044-4115cacfe3a5 tempest-ProjectMemberTests-700601358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bec1b719-8e81-4c10-b00f-24c727018a49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:55 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-1385614a-5a5a-48b0-8044-4115cacfe3a5 tempest-ProjectMemberTests-700601358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bec1b719-8e81-4c10-b00f-24c727018a49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5b39d6d-ac55-4353-b3ba-5bcf9fbf2d76', 'volume_name': 'volume-e5b39d6d-ac55-4353-b3ba-5bcf9fbf2d76', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:55 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-1385614a-5a5a-48b0-8044-4115cacfe3a5 tempest-ProjectMemberTests-700601358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66d1f4d9-6264-4ff6-bfe3-f13594e0534f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:55 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-1385614a-5a5a-48b0-8044-4115cacfe3a5 tempest-ProjectMemberTests-700601358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66d1f4d9-6264-4ff6-bfe3-f13594e0534f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:55 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-1385614a-5a5a-48b0-8044-4115cacfe3a5 tempest-ProjectMemberTests-700601358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d4118d4-d7ac-4393-a957-84a524cd5075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:55 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-1385614a-5a5a-48b0-8044-4115cacfe3a5 tempest-ProjectMemberTests-700601358 None] Volume e5b39d6d-ac55-4353-b3ba-5bcf9fbf2d76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5b39d6d-ac55-4353-b3ba-5bcf9fbf2d76', 'volume_size': 1} Sep 23 14:51:55 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-1385614a-5a5a-48b0-8044-4115cacfe3a5 tempest-ProjectMemberTests-700601358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:51:55 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-1385614a-5a5a-48b0-8044-4115cacfe3a5 tempest-ProjectMemberTests-700601358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:51:55 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-1385614a-5a5a-48b0-8044-4115cacfe3a5 tempest-ProjectMemberTests-700601358 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:51:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-730119494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5b39d6d-ac55-4353-b3ba-5bcf9fbf2d76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96e82c6bd57443b895414c81e35dd400',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:51:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:51:55Z,use_quota=True,user_id='ec53ea8e97044f789c6e4da593a5da06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:51:55 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-1385614a-5a5a-48b0-8044-4115cacfe3a5 tempest-ProjectMemberTests-700601358 None] Creating volume e5b39d6d-ac55-4353-b3ba-5bcf9fbf2d76 {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:51:55 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-1385614a-5a5a-48b0-8044-4115cacfe3a5 tempest-ProjectMemberTests-700601358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:51:55 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-1385614a-5a5a-48b0-8044-4115cacfe3a5 tempest-ProjectMemberTests-700601358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:51:55 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-1385614a-5a5a-48b0-8044-4115cacfe3a5 tempest-ProjectMemberTests-700601358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:51:55 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-1385614a-5a5a-48b0-8044-4115cacfe3a5 tempest-ProjectMemberTests-700601358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:51:55 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-1385614a-5a5a-48b0-8044-4115cacfe3a5 tempest-ProjectMemberTests-700601358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:51:55 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-1385614a-5a5a-48b0-8044-4115cacfe3a5 tempest-ProjectMemberTests-700601358 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:51:55 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-1385614a-5a5a-48b0-8044-4115cacfe3a5 tempest-ProjectMemberTests-700601358 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:51:55 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-1385614a-5a5a-48b0-8044-4115cacfe3a5 tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e5b39d6d-ac55-4353-b3ba-5bcf9fbf2d76 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:55 devstack sudo[104677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e5b39d6d-ac55-4353-b3ba-5bcf9fbf2d76 1073741824 Sep 23 14:51:55 devstack sudo[104677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:55 devstack sudo[104677]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:55 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-1385614a-5a5a-48b0-8044-4115cacfe3a5 tempest-ProjectMemberTests-700601358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e5b39d6d-ac55-4353-b3ba-5bcf9fbf2d76 1073741824" returned: 0 in 0.613s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:55 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-1385614a-5a5a-48b0-8044-4115cacfe3a5 tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e5b39d6d-ac55-4353-b3ba-5bcf9fbf2d76 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:55 devstack sudo[104683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e5b39d6d-ac55-4353-b3ba-5bcf9fbf2d76 Sep 23 14:51:55 devstack sudo[104683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:55 devstack sudo[104683]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:55 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-1385614a-5a5a-48b0-8044-4115cacfe3a5 tempest-ProjectMemberTests-700601358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e5b39d6d-ac55-4353-b3ba-5bcf9fbf2d76" returned: 0 in 0.269s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:55 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-1385614a-5a5a-48b0-8044-4115cacfe3a5 tempest-ProjectMemberTests-700601358 None] <== create_volume: return (948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:51:55 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-1385614a-5a5a-48b0-8044-4115cacfe3a5 tempest-ProjectMemberTests-700601358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.950s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:51:55 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-1385614a-5a5a-48b0-8044-4115cacfe3a5 tempest-ProjectMemberTests-700601358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d4118d4-d7ac-4393-a957-84a524cd5075) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5b39d6d-ac55-4353-b3ba-5bcf9fbf2d76', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:55 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-1385614a-5a5a-48b0-8044-4115cacfe3a5 tempest-ProjectMemberTests-700601358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (748fe0eb-71e7-49ee-a14c-ea3dd8fb881d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:51:56 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-1385614a-5a5a-48b0-8044-4115cacfe3a5 tempest-ProjectMemberTests-700601358 None] Volume volume-e5b39d6d-ac55-4353-b3ba-5bcf9fbf2d76 (e5b39d6d-ac55-4353-b3ba-5bcf9fbf2d76): created successfully Sep 23 14:51:56 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-1385614a-5a5a-48b0-8044-4115cacfe3a5 tempest-ProjectMemberTests-700601358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (748fe0eb-71e7-49ee-a14c-ea3dd8fb881d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:51:56 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-1385614a-5a5a-48b0-8044-4115cacfe3a5 tempest-ProjectMemberTests-700601358 None] Flow 'volume_create_manager' (8601a005-f003-48eb-a399-4c66e02d16f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:51:56 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-1385614a-5a5a-48b0-8044-4115cacfe3a5 tempest-ProjectMemberTests-700601358 None] Created volume successfully. Sep 23 14:51:57 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-b30facbb-7376-4302-82f2-2e4f16291153 tempest-ProjectMemberTests-700601358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:51:57 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-b30facbb-7376-4302-82f2-2e4f16291153 tempest-ProjectMemberTests-700601358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:51:57 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-b30facbb-7376-4302-82f2-2e4f16291153 tempest-ProjectMemberTests-700601358 None] Creating offline snapshot 20cce8f5-bc18-4fdb-8e5d-9509a755b612 of volume e5b39d6d-ac55-4353-b3ba-5bcf9fbf2d76 {{(pid=86310) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 14:51:57 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ca3c74e-4535-40ba-b35b-13e1d5d51af1]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:51:57 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-b30facbb-7376-4302-82f2-2e4f16291153 tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e5b39d6d-ac55-4353-b3ba-5bcf9fbf2d76 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:57 devstack sudo[104686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e5b39d6d-ac55-4353-b3ba-5bcf9fbf2d76 Sep 23 14:51:57 devstack sudo[104686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:57 devstack sudo[104686]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:57 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-b30facbb-7376-4302-82f2-2e4f16291153 tempest-ProjectMemberTests-700601358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e5b39d6d-ac55-4353-b3ba-5bcf9fbf2d76" returned: 0 in 0.513s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:57 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-b30facbb-7376-4302-82f2-2e4f16291153 tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e5b39d6d-ac55-4353-b3ba-5bcf9fbf2d76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e5b39d6d-ac55-4353-b3ba-5bcf9fbf2d76.20cce8f5-bc18-4fdb-8e5d-9509a755b612 1G {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:57 devstack sudo[104691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e5b39d6d-ac55-4353-b3ba-5bcf9fbf2d76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e5b39d6d-ac55-4353-b3ba-5bcf9fbf2d76.20cce8f5-bc18-4fdb-8e5d-9509a755b612 1G Sep 23 14:51:57 devstack sudo[104691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:58 devstack sudo[104691]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:58 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-b30facbb-7376-4302-82f2-2e4f16291153 tempest-ProjectMemberTests-700601358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e5b39d6d-ac55-4353-b3ba-5bcf9fbf2d76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e5b39d6d-ac55-4353-b3ba-5bcf9fbf2d76.20cce8f5-bc18-4fdb-8e5d-9509a755b612 1G" returned: 0 in 0.514s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:58 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-b30facbb-7376-4302-82f2-2e4f16291153 tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5b39d6d-ac55-4353-b3ba-5bcf9fbf2d76 -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e5b39d6d-ac55-4353-b3ba-5bcf9fbf2d76.20cce8f5-bc18-4fdb-8e5d-9509a755b612 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:58 devstack sudo[104697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5b39d6d-ac55-4353-b3ba-5bcf9fbf2d76 -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e5b39d6d-ac55-4353-b3ba-5bcf9fbf2d76.20cce8f5-bc18-4fdb-8e5d-9509a755b612 Sep 23 14:51:58 devstack sudo[104697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:58 devstack sudo[104697]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:58 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-b30facbb-7376-4302-82f2-2e4f16291153 tempest-ProjectMemberTests-700601358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5b39d6d-ac55-4353-b3ba-5bcf9fbf2d76 -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e5b39d6d-ac55-4353-b3ba-5bcf9fbf2d76.20cce8f5-bc18-4fdb-8e5d-9509a755b612" returned: 0 in 0.344s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:58 devstack cinder-volume[86310]: WARNING cinder.volume.drivers.remotefs [None req-b30facbb-7376-4302-82f2-2e4f16291153 tempest-ProjectMemberTests-700601358 None] /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e5b39d6d-ac55-4353-b3ba-5bcf9fbf2d76.20cce8f5-bc18-4fdb-8e5d-9509a755b612 is being set with open permissions: ugo+rw Sep 23 14:51:58 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-b30facbb-7376-4302-82f2-2e4f16291153 tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e5b39d6d-ac55-4353-b3ba-5bcf9fbf2d76.20cce8f5-bc18-4fdb-8e5d-9509a755b612 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:58 devstack sudo[104702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e5b39d6d-ac55-4353-b3ba-5bcf9fbf2d76.20cce8f5-bc18-4fdb-8e5d-9509a755b612 Sep 23 14:51:58 devstack sudo[104702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:58 devstack sudo[104702]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:58 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-b30facbb-7376-4302-82f2-2e4f16291153 tempest-ProjectMemberTests-700601358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e5b39d6d-ac55-4353-b3ba-5bcf9fbf2d76.20cce8f5-bc18-4fdb-8e5d-9509a755b612" returned: 0 in 0.288s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:58 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-b30facbb-7376-4302-82f2-2e4f16291153 tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e5b39d6d-ac55-4353-b3ba-5bcf9fbf2d76.info {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:58 devstack sudo[104706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e5b39d6d-ac55-4353-b3ba-5bcf9fbf2d76.info Sep 23 14:51:58 devstack sudo[104706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:59 devstack sudo[104706]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:59 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-b30facbb-7376-4302-82f2-2e4f16291153 tempest-ProjectMemberTests-700601358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e5b39d6d-ac55-4353-b3ba-5bcf9fbf2d76.info" returned: 0 in 0.330s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:59 devstack cinder-volume[86310]: WARNING cinder.volume.drivers.remotefs [None req-b30facbb-7376-4302-82f2-2e4f16291153 tempest-ProjectMemberTests-700601358 None] /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e5b39d6d-ac55-4353-b3ba-5bcf9fbf2d76.info is being set with open permissions: ugo+rw Sep 23 14:51:59 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-b30facbb-7376-4302-82f2-2e4f16291153 tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e5b39d6d-ac55-4353-b3ba-5bcf9fbf2d76.info {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:51:59 devstack sudo[104709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e5b39d6d-ac55-4353-b3ba-5bcf9fbf2d76.info Sep 23 14:51:59 devstack sudo[104709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:51:59 devstack sudo[104709]: pam_unix(sudo:session): session closed for user root Sep 23 14:51:59 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-b30facbb-7376-4302-82f2-2e4f16291153 tempest-ProjectMemberTests-700601358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e5b39d6d-ac55-4353-b3ba-5bcf9fbf2d76.info" returned: 0 in 0.248s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:51:59 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-b30facbb-7376-4302-82f2-2e4f16291153 tempest-ProjectMemberTests-700601358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.369s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:51:59 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-b30facbb-7376-4302-82f2-2e4f16291153 tempest-ProjectMemberTests-700601358 None] Create snapshot completed successfully Sep 23 14:52:00 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-066ba8f2-7cd2-4bd8-b419-246f6a6ddcf0 tempest-ProjectMemberTests-700601358 None] Acquiring lock "cinder-20cce8f5-bc18-4fdb-8e5d-9509a755b612-delete_snapshot" by "delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:52:00 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-066ba8f2-7cd2-4bd8-b419-246f6a6ddcf0 tempest-ProjectMemberTests-700601358 None] Lock "cinder-20cce8f5-bc18-4fdb-8e5d-9509a755b612-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:52:00 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-066ba8f2-7cd2-4bd8-b419-246f6a6ddcf0 tempest-ProjectMemberTests-700601358 None] Acquiring lock "cinder-quobyte-e5b39d6d-ac55-4353-b3ba-5bcf9fbf2d76" by "delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:52:00 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-066ba8f2-7cd2-4bd8-b419-246f6a6ddcf0 tempest-ProjectMemberTests-700601358 None] Lock "cinder-quobyte-e5b39d6d-ac55-4353-b3ba-5bcf9fbf2d76" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:52:00 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-066ba8f2-7cd2-4bd8-b419-246f6a6ddcf0 tempest-ProjectMemberTests-700601358 None] Acquiring lock "cinder-quobyte-20cce8f5-bc18-4fdb-8e5d-9509a755b612" by "_delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:52:00 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-066ba8f2-7cd2-4bd8-b419-246f6a6ddcf0 tempest-ProjectMemberTests-700601358 None] Lock "cinder-quobyte-20cce8f5-bc18-4fdb-8e5d-9509a755b612" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:52:00 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-066ba8f2-7cd2-4bd8-b419-246f6a6ddcf0 tempest-ProjectMemberTests-700601358 None] Deleting offline snapshot 20cce8f5-bc18-4fdb-8e5d-9509a755b612 of volume e5b39d6d-ac55-4353-b3ba-5bcf9fbf2d76 {{(pid=86310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 14:52:00 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-066ba8f2-7cd2-4bd8-b419-246f6a6ddcf0 tempest-ProjectMemberTests-700601358 None] snapshot_file for this snap is: volume-e5b39d6d-ac55-4353-b3ba-5bcf9fbf2d76.20cce8f5-bc18-4fdb-8e5d-9509a755b612 {{(pid=86310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 14:52:00 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[a220b3a8-6cf1-4b07-b3f6-c59b2b281090]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:52:00 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-066ba8f2-7cd2-4bd8-b419-246f6a6ddcf0 tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e5b39d6d-ac55-4353-b3ba-5bcf9fbf2d76.20cce8f5-bc18-4fdb-8e5d-9509a755b612 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:00 devstack sudo[104712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e5b39d6d-ac55-4353-b3ba-5bcf9fbf2d76.20cce8f5-bc18-4fdb-8e5d-9509a755b612 Sep 23 14:52:00 devstack sudo[104712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:00 devstack sudo[104712]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:00 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-066ba8f2-7cd2-4bd8-b419-246f6a6ddcf0 tempest-ProjectMemberTests-700601358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e5b39d6d-ac55-4353-b3ba-5bcf9fbf2d76.20cce8f5-bc18-4fdb-8e5d-9509a755b612" returned: 0 in 0.428s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:00 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-066ba8f2-7cd2-4bd8-b419-246f6a6ddcf0 tempest-ProjectMemberTests-700601358 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e5b39d6d-ac55-4353-b3ba-5bcf9fbf2d76(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 14:52:00 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc1547ec-a95c-4bad-884d-99ccceb38529]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:52:00 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-066ba8f2-7cd2-4bd8-b419-246f6a6ddcf0 tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e5b39d6d-ac55-4353-b3ba-5bcf9fbf2d76 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:01 devstack sudo[104717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e5b39d6d-ac55-4353-b3ba-5bcf9fbf2d76 Sep 23 14:52:01 devstack sudo[104717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:01 devstack sudo[104717]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:01 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-066ba8f2-7cd2-4bd8-b419-246f6a6ddcf0 tempest-ProjectMemberTests-700601358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e5b39d6d-ac55-4353-b3ba-5bcf9fbf2d76" returned: 0 in 0.606s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:01 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-066ba8f2-7cd2-4bd8-b419-246f6a6ddcf0 tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e5b39d6d-ac55-4353-b3ba-5bcf9fbf2d76.20cce8f5-bc18-4fdb-8e5d-9509a755b612 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:01 devstack sudo[104722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e5b39d6d-ac55-4353-b3ba-5bcf9fbf2d76.20cce8f5-bc18-4fdb-8e5d-9509a755b612 Sep 23 14:52:01 devstack sudo[104722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:02 devstack sudo[104722]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:02 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-066ba8f2-7cd2-4bd8-b419-246f6a6ddcf0 tempest-ProjectMemberTests-700601358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e5b39d6d-ac55-4353-b3ba-5bcf9fbf2d76.20cce8f5-bc18-4fdb-8e5d-9509a755b612" returned: 0 in 0.478s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:02 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-066ba8f2-7cd2-4bd8-b419-246f6a6ddcf0 tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e5b39d6d-ac55-4353-b3ba-5bcf9fbf2d76.20cce8f5-bc18-4fdb-8e5d-9509a755b612 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:02 devstack sudo[104728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e5b39d6d-ac55-4353-b3ba-5bcf9fbf2d76.20cce8f5-bc18-4fdb-8e5d-9509a755b612 Sep 23 14:52:02 devstack sudo[104728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:02 devstack sudo[104728]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:02 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-066ba8f2-7cd2-4bd8-b419-246f6a6ddcf0 tempest-ProjectMemberTests-700601358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e5b39d6d-ac55-4353-b3ba-5bcf9fbf2d76.20cce8f5-bc18-4fdb-8e5d-9509a755b612" returned: 0 in 0.287s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:02 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-066ba8f2-7cd2-4bd8-b419-246f6a6ddcf0 tempest-ProjectMemberTests-700601358 None] Lock "cinder-quobyte-20cce8f5-bc18-4fdb-8e5d-9509a755b612" released by "_delete_snapshot" :: held 1.950s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:52:02 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-066ba8f2-7cd2-4bd8-b419-246f6a6ddcf0 tempest-ProjectMemberTests-700601358 None] Lock "cinder-quobyte-e5b39d6d-ac55-4353-b3ba-5bcf9fbf2d76" released by "delete_snapshot" :: held 1.979s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:52:02 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-066ba8f2-7cd2-4bd8-b419-246f6a6ddcf0 tempest-ProjectMemberTests-700601358 None] Created reservations ['1e8b8027-7f13-4258-b429-913aed5049ca', '2db86f93-bf2c-42ce-a8e3-a760375d23fd', 'a745a550-2f60-41fd-9fa9-cb0f4b829716', '384f5913-184d-490c-b39a-248e50a7ace3'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:52:02 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-066ba8f2-7cd2-4bd8-b419-246f6a6ddcf0 tempest-ProjectMemberTests-700601358 None] Delete snapshot completed successfully. Sep 23 14:52:02 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-066ba8f2-7cd2-4bd8-b419-246f6a6ddcf0 tempest-ProjectMemberTests-700601358 None] Lock "cinder-20cce8f5-bc18-4fdb-8e5d-9509a755b612-delete_snapshot" released by "delete_snapshot" :: held 2.181s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:52:02 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-a8f41b85-5c97-4585-b03b-b1e7c57c7a57 tempest-ProjectMemberTests-700601358 None] Acquiring lock "cinder-e5b39d6d-ac55-4353-b3ba-5bcf9fbf2d76-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:52:02 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-a8f41b85-5c97-4585-b03b-b1e7c57c7a57 tempest-ProjectMemberTests-700601358 None] Lock "cinder-e5b39d6d-ac55-4353-b3ba-5bcf9fbf2d76-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:52:02 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-a8f41b85-5c97-4585-b03b-b1e7c57c7a57 tempest-ProjectMemberTests-700601358 None] Acquiring lock "cinder-quobyte-e5b39d6d-ac55-4353-b3ba-5bcf9fbf2d76" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:52:02 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-a8f41b85-5c97-4585-b03b-b1e7c57c7a57 tempest-ProjectMemberTests-700601358 None] Lock "cinder-quobyte-e5b39d6d-ac55-4353-b3ba-5bcf9fbf2d76" acquired by "delete_volume" :: waited 0.022s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:52:02 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd97650f-7dda-41a7-9931-b0c8d0089993]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:52:02 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a8f41b85-5c97-4585-b03b-b1e7c57c7a57 tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e5b39d6d-ac55-4353-b3ba-5bcf9fbf2d76 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:03 devstack sudo[104732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e5b39d6d-ac55-4353-b3ba-5bcf9fbf2d76 Sep 23 14:52:03 devstack sudo[104732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:03 devstack sudo[104732]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:03 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a8f41b85-5c97-4585-b03b-b1e7c57c7a57 tempest-ProjectMemberTests-700601358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e5b39d6d-ac55-4353-b3ba-5bcf9fbf2d76" returned: 0 in 0.478s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:03 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a8f41b85-5c97-4585-b03b-b1e7c57c7a57 tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e5b39d6d-ac55-4353-b3ba-5bcf9fbf2d76 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:03 devstack sudo[104738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e5b39d6d-ac55-4353-b3ba-5bcf9fbf2d76 Sep 23 14:52:03 devstack sudo[104738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:03 devstack sudo[104738]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:03 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a8f41b85-5c97-4585-b03b-b1e7c57c7a57 tempest-ProjectMemberTests-700601358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-e5b39d6d-ac55-4353-b3ba-5bcf9fbf2d76" returned: 0 in 0.292s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:03 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-a8f41b85-5c97-4585-b03b-b1e7c57c7a57 tempest-ProjectMemberTests-700601358 None] Lock "cinder-quobyte-e5b39d6d-ac55-4353-b3ba-5bcf9fbf2d76" released by "delete_volume" :: held 0.868s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:52:03 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-a8f41b85-5c97-4585-b03b-b1e7c57c7a57 tempest-ProjectMemberTests-700601358 None] Created reservations ['11d59bd3-e9af-41ed-b853-a6b14424c463', '25257b4f-c570-4808-8bae-3725246d0e8d', 'dd5e8100-f39a-4960-ac95-5a96051a14b2', '832b2fff-f164-4b87-b756-18e7f8149d34'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:52:03 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-a8f41b85-5c97-4585-b03b-b1e7c57c7a57 tempest-ProjectMemberTests-700601358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:52:03 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-a8f41b85-5c97-4585-b03b-b1e7c57c7a57 tempest-ProjectMemberTests-700601358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:52:03 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-a8f41b85-5c97-4585-b03b-b1e7c57c7a57 tempest-ProjectMemberTests-700601358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:52:03 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-a8f41b85-5c97-4585-b03b-b1e7c57c7a57 tempest-ProjectMemberTests-700601358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:52:03 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-a8f41b85-5c97-4585-b03b-b1e7c57c7a57 tempest-ProjectMemberTests-700601358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:52:03 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a8f41b85-5c97-4585-b03b-b1e7c57c7a57 tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:03 devstack sudo[104741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:52:03 devstack sudo[104741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:04 devstack sudo[104741]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:04 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a8f41b85-5c97-4585-b03b-b1e7c57c7a57 tempest-ProjectMemberTests-700601358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.395s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:04 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-a8f41b85-5c97-4585-b03b-b1e7c57c7a57 tempest-ProjectMemberTests-700601358 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:52:04 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-a8f41b85-5c97-4585-b03b-b1e7c57c7a57 tempest-ProjectMemberTests-700601358 None] Deleted volume successfully. Sep 23 14:52:04 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-a8f41b85-5c97-4585-b03b-b1e7c57c7a57 tempest-ProjectMemberTests-700601358 None] Lock "cinder-e5b39d6d-ac55-4353-b3ba-5bcf9fbf2d76-delete_volume" released by "delete_volume" :: held 1.592s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:52:04 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9be6bf5-873d-4473-a814-d3a6f4f2bda2 tempest-ProjectMemberTests-700601358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:52:04 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-b9be6bf5-873d-4473-a814-d3a6f4f2bda2 tempest-ProjectMemberTests-700601358 None] Flow 'volume_create_manager' (07c23010-54d4-43c7-90fd-e559009ccf23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:52:04 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-b9be6bf5-873d-4473-a814-d3a6f4f2bda2 tempest-ProjectMemberTests-700601358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cff7835f-13f3-498b-b693-32641e1c4b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:52:04 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-b9be6bf5-873d-4473-a814-d3a6f4f2bda2 tempest-ProjectMemberTests-700601358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cff7835f-13f3-498b-b693-32641e1c4b34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:52:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1439749660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29e77fd8-996e-4e11-ad15-3f67d19c39d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96e82c6bd57443b895414c81e35dd400',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:52:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:52:05Z,use_quota=True,user_id='ec53ea8e97044f789c6e4da593a5da06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:52:04 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-b9be6bf5-873d-4473-a814-d3a6f4f2bda2 tempest-ProjectMemberTests-700601358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (534bf384-3b2b-43d4-8677-b961bcf18071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:52:04 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-b9be6bf5-873d-4473-a814-d3a6f4f2bda2 tempest-ProjectMemberTests-700601358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (534bf384-3b2b-43d4-8677-b961bcf18071) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:52:04 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-b9be6bf5-873d-4473-a814-d3a6f4f2bda2 tempest-ProjectMemberTests-700601358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6676b27a-b023-41ba-ae8a-26fecc92789f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:52:04 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-b9be6bf5-873d-4473-a814-d3a6f4f2bda2 tempest-ProjectMemberTests-700601358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6676b27a-b023-41ba-ae8a-26fecc92789f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29e77fd8-996e-4e11-ad15-3f67d19c39d6', 'volume_name': 'volume-29e77fd8-996e-4e11-ad15-3f67d19c39d6', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:52:04 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-b9be6bf5-873d-4473-a814-d3a6f4f2bda2 tempest-ProjectMemberTests-700601358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b41cf29b-74e1-4117-9a18-a6d2fa4d890c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:52:04 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-b9be6bf5-873d-4473-a814-d3a6f4f2bda2 tempest-ProjectMemberTests-700601358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b41cf29b-74e1-4117-9a18-a6d2fa4d890c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:52:04 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-b9be6bf5-873d-4473-a814-d3a6f4f2bda2 tempest-ProjectMemberTests-700601358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (608b0880-be04-422c-aee7-cad591408781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:52:04 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-b9be6bf5-873d-4473-a814-d3a6f4f2bda2 tempest-ProjectMemberTests-700601358 None] Volume 29e77fd8-996e-4e11-ad15-3f67d19c39d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29e77fd8-996e-4e11-ad15-3f67d19c39d6', 'volume_size': 1} Sep 23 14:52:04 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-b9be6bf5-873d-4473-a814-d3a6f4f2bda2 tempest-ProjectMemberTests-700601358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:52:04 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-b9be6bf5-873d-4473-a814-d3a6f4f2bda2 tempest-ProjectMemberTests-700601358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:52:04 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-b9be6bf5-873d-4473-a814-d3a6f4f2bda2 tempest-ProjectMemberTests-700601358 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:52:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1439749660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29e77fd8-996e-4e11-ad15-3f67d19c39d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96e82c6bd57443b895414c81e35dd400',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:52:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:52:05Z,use_quota=True,user_id='ec53ea8e97044f789c6e4da593a5da06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:52:04 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-b9be6bf5-873d-4473-a814-d3a6f4f2bda2 tempest-ProjectMemberTests-700601358 None] Creating volume 29e77fd8-996e-4e11-ad15-3f67d19c39d6 {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:52:04 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-b9be6bf5-873d-4473-a814-d3a6f4f2bda2 tempest-ProjectMemberTests-700601358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:52:04 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-b9be6bf5-873d-4473-a814-d3a6f4f2bda2 tempest-ProjectMemberTests-700601358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:52:04 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-b9be6bf5-873d-4473-a814-d3a6f4f2bda2 tempest-ProjectMemberTests-700601358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:52:04 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-b9be6bf5-873d-4473-a814-d3a6f4f2bda2 tempest-ProjectMemberTests-700601358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:52:04 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-b9be6bf5-873d-4473-a814-d3a6f4f2bda2 tempest-ProjectMemberTests-700601358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:52:04 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-b9be6bf5-873d-4473-a814-d3a6f4f2bda2 tempest-ProjectMemberTests-700601358 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:52:04 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-b9be6bf5-873d-4473-a814-d3a6f4f2bda2 tempest-ProjectMemberTests-700601358 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:52:04 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-b9be6bf5-873d-4473-a814-d3a6f4f2bda2 tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-29e77fd8-996e-4e11-ad15-3f67d19c39d6 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:04 devstack sudo[104744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-29e77fd8-996e-4e11-ad15-3f67d19c39d6 1073741824 Sep 23 14:52:04 devstack sudo[104744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:05 devstack sudo[104744]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:05 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-b9be6bf5-873d-4473-a814-d3a6f4f2bda2 tempest-ProjectMemberTests-700601358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-29e77fd8-996e-4e11-ad15-3f67d19c39d6 1073741824" returned: 0 in 0.616s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:05 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-b9be6bf5-873d-4473-a814-d3a6f4f2bda2 tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-29e77fd8-996e-4e11-ad15-3f67d19c39d6 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:05 devstack sudo[104750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-29e77fd8-996e-4e11-ad15-3f67d19c39d6 Sep 23 14:52:05 devstack sudo[104750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:05 devstack sudo[104750]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:05 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-b9be6bf5-873d-4473-a814-d3a6f4f2bda2 tempest-ProjectMemberTests-700601358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-29e77fd8-996e-4e11-ad15-3f67d19c39d6" returned: 0 in 0.321s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:05 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-b9be6bf5-873d-4473-a814-d3a6f4f2bda2 tempest-ProjectMemberTests-700601358 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:52:05 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-b9be6bf5-873d-4473-a814-d3a6f4f2bda2 tempest-ProjectMemberTests-700601358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:52:05 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-b9be6bf5-873d-4473-a814-d3a6f4f2bda2 tempest-ProjectMemberTests-700601358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (608b0880-be04-422c-aee7-cad591408781) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29e77fd8-996e-4e11-ad15-3f67d19c39d6', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:52:05 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-b9be6bf5-873d-4473-a814-d3a6f4f2bda2 tempest-ProjectMemberTests-700601358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3015a18c-1781-404c-91ab-decaaa5b3c20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:52:05 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-b9be6bf5-873d-4473-a814-d3a6f4f2bda2 tempest-ProjectMemberTests-700601358 None] Volume volume-29e77fd8-996e-4e11-ad15-3f67d19c39d6 (29e77fd8-996e-4e11-ad15-3f67d19c39d6): created successfully Sep 23 14:52:05 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-b9be6bf5-873d-4473-a814-d3a6f4f2bda2 tempest-ProjectMemberTests-700601358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3015a18c-1781-404c-91ab-decaaa5b3c20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:52:05 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-b9be6bf5-873d-4473-a814-d3a6f4f2bda2 tempest-ProjectMemberTests-700601358 None] Flow 'volume_create_manager' (07c23010-54d4-43c7-90fd-e559009ccf23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:52:05 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-b9be6bf5-873d-4473-a814-d3a6f4f2bda2 tempest-ProjectMemberTests-700601358 None] Created volume successfully. Sep 23 14:52:06 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-fddebf8e-5d0a-4091-96e8-5a00d91c62b7 tempest-ProjectMemberTests-700601358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:52:06 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-fddebf8e-5d0a-4091-96e8-5a00d91c62b7 tempest-ProjectMemberTests-700601358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:52:07 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-fddebf8e-5d0a-4091-96e8-5a00d91c62b7 tempest-ProjectMemberTests-700601358 None] Creating offline snapshot 3d4242e0-5984-49c3-84be-9758a0b7b611 of volume 29e77fd8-996e-4e11-ad15-3f67d19c39d6 {{(pid=86310) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 14:52:07 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[11d73712-7004-43f0-a790-89a0ba82e593]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:52:07 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-fddebf8e-5d0a-4091-96e8-5a00d91c62b7 tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-29e77fd8-996e-4e11-ad15-3f67d19c39d6 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:07 devstack sudo[104754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-29e77fd8-996e-4e11-ad15-3f67d19c39d6 Sep 23 14:52:07 devstack sudo[104754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:07 devstack sudo[104754]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:07 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-fddebf8e-5d0a-4091-96e8-5a00d91c62b7 tempest-ProjectMemberTests-700601358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-29e77fd8-996e-4e11-ad15-3f67d19c39d6" returned: 0 in 0.494s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:07 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-fddebf8e-5d0a-4091-96e8-5a00d91c62b7 tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-29e77fd8-996e-4e11-ad15-3f67d19c39d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-29e77fd8-996e-4e11-ad15-3f67d19c39d6.3d4242e0-5984-49c3-84be-9758a0b7b611 1G {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:07 devstack sudo[104759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-29e77fd8-996e-4e11-ad15-3f67d19c39d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-29e77fd8-996e-4e11-ad15-3f67d19c39d6.3d4242e0-5984-49c3-84be-9758a0b7b611 1G Sep 23 14:52:07 devstack sudo[104759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:08 devstack sudo[104759]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:08 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-fddebf8e-5d0a-4091-96e8-5a00d91c62b7 tempest-ProjectMemberTests-700601358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-29e77fd8-996e-4e11-ad15-3f67d19c39d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-29e77fd8-996e-4e11-ad15-3f67d19c39d6.3d4242e0-5984-49c3-84be-9758a0b7b611 1G" returned: 0 in 0.539s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:08 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-fddebf8e-5d0a-4091-96e8-5a00d91c62b7 tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29e77fd8-996e-4e11-ad15-3f67d19c39d6 -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-29e77fd8-996e-4e11-ad15-3f67d19c39d6.3d4242e0-5984-49c3-84be-9758a0b7b611 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:08 devstack sudo[104765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29e77fd8-996e-4e11-ad15-3f67d19c39d6 -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-29e77fd8-996e-4e11-ad15-3f67d19c39d6.3d4242e0-5984-49c3-84be-9758a0b7b611 Sep 23 14:52:08 devstack sudo[104765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:08 devstack sudo[104765]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:08 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-fddebf8e-5d0a-4091-96e8-5a00d91c62b7 tempest-ProjectMemberTests-700601358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29e77fd8-996e-4e11-ad15-3f67d19c39d6 -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-29e77fd8-996e-4e11-ad15-3f67d19c39d6.3d4242e0-5984-49c3-84be-9758a0b7b611" returned: 0 in 0.339s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:08 devstack cinder-volume[86310]: WARNING cinder.volume.drivers.remotefs [None req-fddebf8e-5d0a-4091-96e8-5a00d91c62b7 tempest-ProjectMemberTests-700601358 None] /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-29e77fd8-996e-4e11-ad15-3f67d19c39d6.3d4242e0-5984-49c3-84be-9758a0b7b611 is being set with open permissions: ugo+rw Sep 23 14:52:08 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-fddebf8e-5d0a-4091-96e8-5a00d91c62b7 tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-29e77fd8-996e-4e11-ad15-3f67d19c39d6.3d4242e0-5984-49c3-84be-9758a0b7b611 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:08 devstack sudo[104771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-29e77fd8-996e-4e11-ad15-3f67d19c39d6.3d4242e0-5984-49c3-84be-9758a0b7b611 Sep 23 14:52:08 devstack sudo[104771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:08 devstack sudo[104771]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:08 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-fddebf8e-5d0a-4091-96e8-5a00d91c62b7 tempest-ProjectMemberTests-700601358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-29e77fd8-996e-4e11-ad15-3f67d19c39d6.3d4242e0-5984-49c3-84be-9758a0b7b611" returned: 0 in 0.269s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:08 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-fddebf8e-5d0a-4091-96e8-5a00d91c62b7 tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-29e77fd8-996e-4e11-ad15-3f67d19c39d6.info {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:08 devstack sudo[104774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-29e77fd8-996e-4e11-ad15-3f67d19c39d6.info Sep 23 14:52:08 devstack sudo[104774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:09 devstack sudo[104774]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:09 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-fddebf8e-5d0a-4091-96e8-5a00d91c62b7 tempest-ProjectMemberTests-700601358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-29e77fd8-996e-4e11-ad15-3f67d19c39d6.info" returned: 0 in 0.319s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:09 devstack cinder-volume[86310]: WARNING cinder.volume.drivers.remotefs [None req-fddebf8e-5d0a-4091-96e8-5a00d91c62b7 tempest-ProjectMemberTests-700601358 None] /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-29e77fd8-996e-4e11-ad15-3f67d19c39d6.info is being set with open permissions: ugo+rw Sep 23 14:52:09 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-fddebf8e-5d0a-4091-96e8-5a00d91c62b7 tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-29e77fd8-996e-4e11-ad15-3f67d19c39d6.info {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:09 devstack sudo[104777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-29e77fd8-996e-4e11-ad15-3f67d19c39d6.info Sep 23 14:52:09 devstack sudo[104777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:09 devstack sudo[104777]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:09 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-fddebf8e-5d0a-4091-96e8-5a00d91c62b7 tempest-ProjectMemberTests-700601358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-29e77fd8-996e-4e11-ad15-3f67d19c39d6.info" returned: 0 in 0.338s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:09 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-fddebf8e-5d0a-4091-96e8-5a00d91c62b7 tempest-ProjectMemberTests-700601358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.411s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:52:09 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-fddebf8e-5d0a-4091-96e8-5a00d91c62b7 tempest-ProjectMemberTests-700601358 None] Create snapshot completed successfully Sep 23 14:52:10 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-ecbdc913-cd9a-4710-800a-bb82cef0aeab tempest-ProjectMemberTests-700601358 None] Acquiring lock "cinder-3d4242e0-5984-49c3-84be-9758a0b7b611-delete_snapshot" by "delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:52:10 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-ecbdc913-cd9a-4710-800a-bb82cef0aeab tempest-ProjectMemberTests-700601358 None] Lock "cinder-3d4242e0-5984-49c3-84be-9758a0b7b611-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:52:10 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-ecbdc913-cd9a-4710-800a-bb82cef0aeab tempest-ProjectMemberTests-700601358 None] Acquiring lock "cinder-quobyte-29e77fd8-996e-4e11-ad15-3f67d19c39d6" by "delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:52:10 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-ecbdc913-cd9a-4710-800a-bb82cef0aeab tempest-ProjectMemberTests-700601358 None] Lock "cinder-quobyte-29e77fd8-996e-4e11-ad15-3f67d19c39d6" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:52:10 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-ecbdc913-cd9a-4710-800a-bb82cef0aeab tempest-ProjectMemberTests-700601358 None] Acquiring lock "cinder-quobyte-3d4242e0-5984-49c3-84be-9758a0b7b611" by "_delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:52:10 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-ecbdc913-cd9a-4710-800a-bb82cef0aeab tempest-ProjectMemberTests-700601358 None] Lock "cinder-quobyte-3d4242e0-5984-49c3-84be-9758a0b7b611" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:52:10 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-ecbdc913-cd9a-4710-800a-bb82cef0aeab tempest-ProjectMemberTests-700601358 None] Deleting offline snapshot 3d4242e0-5984-49c3-84be-9758a0b7b611 of volume 29e77fd8-996e-4e11-ad15-3f67d19c39d6 {{(pid=86310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 14:52:10 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-ecbdc913-cd9a-4710-800a-bb82cef0aeab tempest-ProjectMemberTests-700601358 None] snapshot_file for this snap is: volume-29e77fd8-996e-4e11-ad15-3f67d19c39d6.3d4242e0-5984-49c3-84be-9758a0b7b611 {{(pid=86310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 14:52:10 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[8594375c-03d4-48d4-8267-9e612e7f5837]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:52:10 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ecbdc913-cd9a-4710-800a-bb82cef0aeab tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-29e77fd8-996e-4e11-ad15-3f67d19c39d6.3d4242e0-5984-49c3-84be-9758a0b7b611 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:10 devstack sudo[104780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-29e77fd8-996e-4e11-ad15-3f67d19c39d6.3d4242e0-5984-49c3-84be-9758a0b7b611 Sep 23 14:52:10 devstack sudo[104780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:10 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-b63f7e0d-e4a4-48af-9330-2a91d8d07674 tempest-SnapshotDependencyTests-1749138146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:52:10 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-b63f7e0d-e4a4-48af-9330-2a91d8d07674 tempest-SnapshotDependencyTests-1749138146 None] Flow 'volume_create_manager' (023e5e73-06c2-473c-ae19-7dd7f02132a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:52:10 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-b63f7e0d-e4a4-48af-9330-2a91d8d07674 tempest-SnapshotDependencyTests-1749138146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b525612-72ae-4be3-a9f6-f46d82417402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:52:10 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-b63f7e0d-e4a4-48af-9330-2a91d8d07674 tempest-SnapshotDependencyTests-1749138146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b525612-72ae-4be3-a9f6-f46d82417402) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:52:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1308327567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69b96242-74f5-4401-9ebc-09d94bfb91c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45b22bbfac2f475ea8c935148fac9630',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:52:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:52:10Z,use_quota=True,user_id='d7f7daf36cde42f98a75e72aec050a9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:52:10 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-b63f7e0d-e4a4-48af-9330-2a91d8d07674 tempest-SnapshotDependencyTests-1749138146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc04f606-4c07-4f7d-a3bd-0fffc85d2cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:52:10 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-b63f7e0d-e4a4-48af-9330-2a91d8d07674 tempest-SnapshotDependencyTests-1749138146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc04f606-4c07-4f7d-a3bd-0fffc85d2cfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:52:10 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-b63f7e0d-e4a4-48af-9330-2a91d8d07674 tempest-SnapshotDependencyTests-1749138146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (734a7e02-66be-46db-bb7f-5422cf479a40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:52:10 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-b63f7e0d-e4a4-48af-9330-2a91d8d07674 tempest-SnapshotDependencyTests-1749138146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (734a7e02-66be-46db-bb7f-5422cf479a40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69b96242-74f5-4401-9ebc-09d94bfb91c6', 'volume_name': 'volume-69b96242-74f5-4401-9ebc-09d94bfb91c6', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:52:10 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-b63f7e0d-e4a4-48af-9330-2a91d8d07674 tempest-SnapshotDependencyTests-1749138146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a0b83a6-0fbd-4661-9d5f-03404b584e85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:52:10 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-b63f7e0d-e4a4-48af-9330-2a91d8d07674 tempest-SnapshotDependencyTests-1749138146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a0b83a6-0fbd-4661-9d5f-03404b584e85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:52:10 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-b63f7e0d-e4a4-48af-9330-2a91d8d07674 tempest-SnapshotDependencyTests-1749138146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dc41087-9b4f-48f7-8c83-523795583e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:52:10 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-b63f7e0d-e4a4-48af-9330-2a91d8d07674 tempest-SnapshotDependencyTests-1749138146 None] Volume 69b96242-74f5-4401-9ebc-09d94bfb91c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69b96242-74f5-4401-9ebc-09d94bfb91c6', 'volume_size': 1} Sep 23 14:52:10 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-b63f7e0d-e4a4-48af-9330-2a91d8d07674 tempest-SnapshotDependencyTests-1749138146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:52:10 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-b63f7e0d-e4a4-48af-9330-2a91d8d07674 tempest-SnapshotDependencyTests-1749138146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:52:10 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-b63f7e0d-e4a4-48af-9330-2a91d8d07674 tempest-SnapshotDependencyTests-1749138146 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:52:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1308327567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69b96242-74f5-4401-9ebc-09d94bfb91c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45b22bbfac2f475ea8c935148fac9630',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:52:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:52:10Z,use_quota=True,user_id='d7f7daf36cde42f98a75e72aec050a9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:52:10 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-b63f7e0d-e4a4-48af-9330-2a91d8d07674 tempest-SnapshotDependencyTests-1749138146 None] Creating volume 69b96242-74f5-4401-9ebc-09d94bfb91c6 {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:52:10 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-b63f7e0d-e4a4-48af-9330-2a91d8d07674 tempest-SnapshotDependencyTests-1749138146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:52:10 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-b63f7e0d-e4a4-48af-9330-2a91d8d07674 tempest-SnapshotDependencyTests-1749138146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:52:10 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-b63f7e0d-e4a4-48af-9330-2a91d8d07674 tempest-SnapshotDependencyTests-1749138146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:52:10 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-b63f7e0d-e4a4-48af-9330-2a91d8d07674 tempest-SnapshotDependencyTests-1749138146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:52:10 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-b63f7e0d-e4a4-48af-9330-2a91d8d07674 tempest-SnapshotDependencyTests-1749138146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:52:10 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-b63f7e0d-e4a4-48af-9330-2a91d8d07674 tempest-SnapshotDependencyTests-1749138146 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:52:10 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-b63f7e0d-e4a4-48af-9330-2a91d8d07674 tempest-SnapshotDependencyTests-1749138146 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:52:10 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-b63f7e0d-e4a4-48af-9330-2a91d8d07674 tempest-SnapshotDependencyTests-1749138146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-69b96242-74f5-4401-9ebc-09d94bfb91c6 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:10 devstack sudo[104782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-69b96242-74f5-4401-9ebc-09d94bfb91c6 1073741824 Sep 23 14:52:10 devstack sudo[104782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:10 devstack sudo[104780]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:10 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ecbdc913-cd9a-4710-800a-bb82cef0aeab tempest-ProjectMemberTests-700601358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-29e77fd8-996e-4e11-ad15-3f67d19c39d6.3d4242e0-5984-49c3-84be-9758a0b7b611" returned: 0 in 0.417s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:10 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-ecbdc913-cd9a-4710-800a-bb82cef0aeab tempest-ProjectMemberTests-700601358 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29e77fd8-996e-4e11-ad15-3f67d19c39d6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 14:52:10 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[478756a9-f326-47a7-b4f0-310558b82fe4]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:52:10 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ecbdc913-cd9a-4710-800a-bb82cef0aeab tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-29e77fd8-996e-4e11-ad15-3f67d19c39d6 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:10 devstack sudo[104788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-29e77fd8-996e-4e11-ad15-3f67d19c39d6 Sep 23 14:52:10 devstack sudo[104788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:11 devstack sudo[104782]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:11 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-b63f7e0d-e4a4-48af-9330-2a91d8d07674 tempest-SnapshotDependencyTests-1749138146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-69b96242-74f5-4401-9ebc-09d94bfb91c6 1073741824" returned: 0 in 0.411s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:11 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-b63f7e0d-e4a4-48af-9330-2a91d8d07674 tempest-SnapshotDependencyTests-1749138146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-69b96242-74f5-4401-9ebc-09d94bfb91c6 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:11 devstack sudo[104795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-69b96242-74f5-4401-9ebc-09d94bfb91c6 Sep 23 14:52:11 devstack sudo[104795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:11 devstack sudo[104788]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:11 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ecbdc913-cd9a-4710-800a-bb82cef0aeab tempest-ProjectMemberTests-700601358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-29e77fd8-996e-4e11-ad15-3f67d19c39d6" returned: 0 in 0.403s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:11 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ecbdc913-cd9a-4710-800a-bb82cef0aeab tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-29e77fd8-996e-4e11-ad15-3f67d19c39d6.3d4242e0-5984-49c3-84be-9758a0b7b611 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:11 devstack sudo[104800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-29e77fd8-996e-4e11-ad15-3f67d19c39d6.3d4242e0-5984-49c3-84be-9758a0b7b611 Sep 23 14:52:11 devstack sudo[104800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:11 devstack sudo[104795]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:11 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-b63f7e0d-e4a4-48af-9330-2a91d8d07674 tempest-SnapshotDependencyTests-1749138146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-69b96242-74f5-4401-9ebc-09d94bfb91c6" returned: 0 in 0.272s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:11 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-b63f7e0d-e4a4-48af-9330-2a91d8d07674 tempest-SnapshotDependencyTests-1749138146 None] <== create_volume: return (724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:52:11 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-b63f7e0d-e4a4-48af-9330-2a91d8d07674 tempest-SnapshotDependencyTests-1749138146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.728s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:52:11 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-b63f7e0d-e4a4-48af-9330-2a91d8d07674 tempest-SnapshotDependencyTests-1749138146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dc41087-9b4f-48f7-8c83-523795583e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69b96242-74f5-4401-9ebc-09d94bfb91c6', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:52:11 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-b63f7e0d-e4a4-48af-9330-2a91d8d07674 tempest-SnapshotDependencyTests-1749138146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dee97eaa-4da3-4925-8346-2268b4c8336a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:52:11 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-b63f7e0d-e4a4-48af-9330-2a91d8d07674 tempest-SnapshotDependencyTests-1749138146 None] Volume volume-69b96242-74f5-4401-9ebc-09d94bfb91c6 (69b96242-74f5-4401-9ebc-09d94bfb91c6): created successfully Sep 23 14:52:11 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-b63f7e0d-e4a4-48af-9330-2a91d8d07674 tempest-SnapshotDependencyTests-1749138146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dee97eaa-4da3-4925-8346-2268b4c8336a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:52:11 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-b63f7e0d-e4a4-48af-9330-2a91d8d07674 tempest-SnapshotDependencyTests-1749138146 None] Flow 'volume_create_manager' (023e5e73-06c2-473c-ae19-7dd7f02132a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:52:11 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-b63f7e0d-e4a4-48af-9330-2a91d8d07674 tempest-SnapshotDependencyTests-1749138146 None] Created volume successfully. Sep 23 14:52:11 devstack sudo[104800]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:11 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ecbdc913-cd9a-4710-800a-bb82cef0aeab tempest-ProjectMemberTests-700601358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-29e77fd8-996e-4e11-ad15-3f67d19c39d6.3d4242e0-5984-49c3-84be-9758a0b7b611" returned: 0 in 0.389s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:11 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ecbdc913-cd9a-4710-800a-bb82cef0aeab tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-29e77fd8-996e-4e11-ad15-3f67d19c39d6.3d4242e0-5984-49c3-84be-9758a0b7b611 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:11 devstack sudo[104806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-29e77fd8-996e-4e11-ad15-3f67d19c39d6.3d4242e0-5984-49c3-84be-9758a0b7b611 Sep 23 14:52:11 devstack sudo[104806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:11 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-ac2fbb94-7e74-447d-94b9-8610c4d91f7c tempest-SnapshotDependencyTests-1749138146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:52:11 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-ac2fbb94-7e74-447d-94b9-8610c4d91f7c tempest-SnapshotDependencyTests-1749138146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:52:11 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-ac2fbb94-7e74-447d-94b9-8610c4d91f7c tempest-SnapshotDependencyTests-1749138146 None] Creating offline snapshot f7c9e24c-71e4-4d13-989a-482ce7b20b39 of volume 69b96242-74f5-4401-9ebc-09d94bfb91c6 {{(pid=86310) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 14:52:11 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[8403bfd9-6f98-4856-9d7d-2e1bc47e0277]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:52:11 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ac2fbb94-7e74-447d-94b9-8610c4d91f7c tempest-SnapshotDependencyTests-1749138146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-69b96242-74f5-4401-9ebc-09d94bfb91c6 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:11 devstack sudo[104806]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:11 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ecbdc913-cd9a-4710-800a-bb82cef0aeab tempest-ProjectMemberTests-700601358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-29e77fd8-996e-4e11-ad15-3f67d19c39d6.3d4242e0-5984-49c3-84be-9758a0b7b611" returned: 0 in 0.286s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:11 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-ecbdc913-cd9a-4710-800a-bb82cef0aeab tempest-ProjectMemberTests-700601358 None] Lock "cinder-quobyte-3d4242e0-5984-49c3-84be-9758a0b7b611" released by "_delete_snapshot" :: held 1.629s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:52:11 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-ecbdc913-cd9a-4710-800a-bb82cef0aeab tempest-ProjectMemberTests-700601358 None] Lock "cinder-quobyte-29e77fd8-996e-4e11-ad15-3f67d19c39d6" released by "delete_snapshot" :: held 1.669s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:52:11 devstack sudo[104808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-69b96242-74f5-4401-9ebc-09d94bfb91c6 Sep 23 14:52:11 devstack sudo[104808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:11 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-ecbdc913-cd9a-4710-800a-bb82cef0aeab tempest-ProjectMemberTests-700601358 None] Created reservations ['0744a26d-ef98-4f3a-9659-eaa73a9681df', '314e5467-cbdf-4422-8e46-d2cd780b184e', '946994a7-bf89-475e-99ac-22a46efb9ecd', '73194e92-db97-4f77-84ac-02530f2446b7'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:52:12 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-ecbdc913-cd9a-4710-800a-bb82cef0aeab tempest-ProjectMemberTests-700601358 None] Delete snapshot completed successfully. Sep 23 14:52:12 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-ecbdc913-cd9a-4710-800a-bb82cef0aeab tempest-ProjectMemberTests-700601358 None] Lock "cinder-3d4242e0-5984-49c3-84be-9758a0b7b611-delete_snapshot" released by "delete_snapshot" :: held 1.806s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:52:12 devstack sudo[104808]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:12 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ac2fbb94-7e74-447d-94b9-8610c4d91f7c tempest-SnapshotDependencyTests-1749138146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-69b96242-74f5-4401-9ebc-09d94bfb91c6" returned: 0 in 0.391s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:12 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ac2fbb94-7e74-447d-94b9-8610c4d91f7c tempest-SnapshotDependencyTests-1749138146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-69b96242-74f5-4401-9ebc-09d94bfb91c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-69b96242-74f5-4401-9ebc-09d94bfb91c6.f7c9e24c-71e4-4d13-989a-482ce7b20b39 1G {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:12 devstack sudo[104814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-69b96242-74f5-4401-9ebc-09d94bfb91c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-69b96242-74f5-4401-9ebc-09d94bfb91c6.f7c9e24c-71e4-4d13-989a-482ce7b20b39 1G Sep 23 14:52:12 devstack sudo[104814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:12 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-7f5e5d6e-76e1-412e-a056-068f90e8799e tempest-ProjectMemberTests-700601358 None] Acquiring lock "cinder-29e77fd8-996e-4e11-ad15-3f67d19c39d6-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:52:12 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-7f5e5d6e-76e1-412e-a056-068f90e8799e tempest-ProjectMemberTests-700601358 None] Lock "cinder-29e77fd8-996e-4e11-ad15-3f67d19c39d6-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:52:12 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-7f5e5d6e-76e1-412e-a056-068f90e8799e tempest-ProjectMemberTests-700601358 None] Acquiring lock "cinder-quobyte-29e77fd8-996e-4e11-ad15-3f67d19c39d6" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:52:12 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-7f5e5d6e-76e1-412e-a056-068f90e8799e tempest-ProjectMemberTests-700601358 None] Lock "cinder-quobyte-29e77fd8-996e-4e11-ad15-3f67d19c39d6" acquired by "delete_volume" :: waited 0.015s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:52:12 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[a501abe7-53e4-4670-aed3-e13c5e3257c2]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:52:12 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-7f5e5d6e-76e1-412e-a056-068f90e8799e tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-29e77fd8-996e-4e11-ad15-3f67d19c39d6 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:12 devstack sudo[104814]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:12 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ac2fbb94-7e74-447d-94b9-8610c4d91f7c tempest-SnapshotDependencyTests-1749138146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-69b96242-74f5-4401-9ebc-09d94bfb91c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-69b96242-74f5-4401-9ebc-09d94bfb91c6.f7c9e24c-71e4-4d13-989a-482ce7b20b39 1G" returned: 0 in 0.460s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:12 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ac2fbb94-7e74-447d-94b9-8610c4d91f7c tempest-SnapshotDependencyTests-1749138146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69b96242-74f5-4401-9ebc-09d94bfb91c6 -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-69b96242-74f5-4401-9ebc-09d94bfb91c6.f7c9e24c-71e4-4d13-989a-482ce7b20b39 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:12 devstack sudo[104819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-29e77fd8-996e-4e11-ad15-3f67d19c39d6 Sep 23 14:52:12 devstack sudo[104819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:12 devstack sudo[104820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69b96242-74f5-4401-9ebc-09d94bfb91c6 -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-69b96242-74f5-4401-9ebc-09d94bfb91c6.f7c9e24c-71e4-4d13-989a-482ce7b20b39 Sep 23 14:52:12 devstack sudo[104820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:12 devstack sudo[104819]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:12 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-7f5e5d6e-76e1-412e-a056-068f90e8799e tempest-ProjectMemberTests-700601358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-29e77fd8-996e-4e11-ad15-3f67d19c39d6" returned: 0 in 0.385s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:12 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-7f5e5d6e-76e1-412e-a056-068f90e8799e tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-29e77fd8-996e-4e11-ad15-3f67d19c39d6 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:12 devstack sudo[104820]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:12 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ac2fbb94-7e74-447d-94b9-8610c4d91f7c tempest-SnapshotDependencyTests-1749138146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69b96242-74f5-4401-9ebc-09d94bfb91c6 -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-69b96242-74f5-4401-9ebc-09d94bfb91c6.f7c9e24c-71e4-4d13-989a-482ce7b20b39" returned: 0 in 0.303s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:12 devstack cinder-volume[86310]: WARNING cinder.volume.drivers.remotefs [None req-ac2fbb94-7e74-447d-94b9-8610c4d91f7c tempest-SnapshotDependencyTests-1749138146 None] /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-69b96242-74f5-4401-9ebc-09d94bfb91c6.f7c9e24c-71e4-4d13-989a-482ce7b20b39 is being set with open permissions: ugo+rw Sep 23 14:52:12 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ac2fbb94-7e74-447d-94b9-8610c4d91f7c tempest-SnapshotDependencyTests-1749138146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-69b96242-74f5-4401-9ebc-09d94bfb91c6.f7c9e24c-71e4-4d13-989a-482ce7b20b39 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:12 devstack sudo[104830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-29e77fd8-996e-4e11-ad15-3f67d19c39d6 Sep 23 14:52:12 devstack sudo[104830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:12 devstack sudo[104832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-69b96242-74f5-4401-9ebc-09d94bfb91c6.f7c9e24c-71e4-4d13-989a-482ce7b20b39 Sep 23 14:52:12 devstack sudo[104832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:13 devstack sudo[104830]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:13 devstack sudo[104832]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:13 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-7f5e5d6e-76e1-412e-a056-068f90e8799e tempest-ProjectMemberTests-700601358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-29e77fd8-996e-4e11-ad15-3f67d19c39d6" returned: 0 in 0.264s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:13 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ac2fbb94-7e74-447d-94b9-8610c4d91f7c tempest-SnapshotDependencyTests-1749138146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-69b96242-74f5-4401-9ebc-09d94bfb91c6.f7c9e24c-71e4-4d13-989a-482ce7b20b39" returned: 0 in 0.256s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:13 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-7f5e5d6e-76e1-412e-a056-068f90e8799e tempest-ProjectMemberTests-700601358 None] Lock "cinder-quobyte-29e77fd8-996e-4e11-ad15-3f67d19c39d6" released by "delete_volume" :: held 0.723s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:52:13 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ac2fbb94-7e74-447d-94b9-8610c4d91f7c tempest-SnapshotDependencyTests-1749138146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-69b96242-74f5-4401-9ebc-09d94bfb91c6.info {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:13 devstack sudo[104836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-69b96242-74f5-4401-9ebc-09d94bfb91c6.info Sep 23 14:52:13 devstack sudo[104836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:13 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-7f5e5d6e-76e1-412e-a056-068f90e8799e tempest-ProjectMemberTests-700601358 None] Created reservations ['e8ed0913-4d90-46a9-a8f5-e35b81cd98f2', 'a6351b5a-71b9-4680-861e-c271a96535cb', 'c0e595f5-6871-4d4f-b23b-12c654641fdf', '602f17c2-907d-4600-8c04-758fd9b4acbc'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:52:13 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-7f5e5d6e-76e1-412e-a056-068f90e8799e tempest-ProjectMemberTests-700601358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:52:13 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-7f5e5d6e-76e1-412e-a056-068f90e8799e tempest-ProjectMemberTests-700601358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:52:13 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-7f5e5d6e-76e1-412e-a056-068f90e8799e tempest-ProjectMemberTests-700601358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:52:13 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-7f5e5d6e-76e1-412e-a056-068f90e8799e tempest-ProjectMemberTests-700601358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:52:13 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-7f5e5d6e-76e1-412e-a056-068f90e8799e tempest-ProjectMemberTests-700601358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:52:13 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-7f5e5d6e-76e1-412e-a056-068f90e8799e tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:13 devstack sudo[104838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:52:13 devstack sudo[104838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:13 devstack sudo[104836]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:13 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ac2fbb94-7e74-447d-94b9-8610c4d91f7c tempest-SnapshotDependencyTests-1749138146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-69b96242-74f5-4401-9ebc-09d94bfb91c6.info" returned: 0 in 0.266s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:13 devstack cinder-volume[86310]: WARNING cinder.volume.drivers.remotefs [None req-ac2fbb94-7e74-447d-94b9-8610c4d91f7c tempest-SnapshotDependencyTests-1749138146 None] /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-69b96242-74f5-4401-9ebc-09d94bfb91c6.info is being set with open permissions: ugo+rw Sep 23 14:52:13 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ac2fbb94-7e74-447d-94b9-8610c4d91f7c tempest-SnapshotDependencyTests-1749138146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-69b96242-74f5-4401-9ebc-09d94bfb91c6.info {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:13 devstack sudo[104841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-69b96242-74f5-4401-9ebc-09d94bfb91c6.info Sep 23 14:52:13 devstack sudo[104841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:13 devstack sudo[104838]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:13 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-7f5e5d6e-76e1-412e-a056-068f90e8799e tempest-ProjectMemberTests-700601358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.251s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:13 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-7f5e5d6e-76e1-412e-a056-068f90e8799e tempest-ProjectMemberTests-700601358 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:52:13 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-7f5e5d6e-76e1-412e-a056-068f90e8799e tempest-ProjectMemberTests-700601358 None] Deleted volume successfully. Sep 23 14:52:13 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-7f5e5d6e-76e1-412e-a056-068f90e8799e tempest-ProjectMemberTests-700601358 None] Lock "cinder-29e77fd8-996e-4e11-ad15-3f67d19c39d6-delete_volume" released by "delete_volume" :: held 1.198s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:52:13 devstack sudo[104841]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:13 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ac2fbb94-7e74-447d-94b9-8610c4d91f7c tempest-SnapshotDependencyTests-1749138146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-69b96242-74f5-4401-9ebc-09d94bfb91c6.info" returned: 0 in 0.277s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:13 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-ac2fbb94-7e74-447d-94b9-8610c4d91f7c tempest-SnapshotDependencyTests-1749138146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.059s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:52:13 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-ac2fbb94-7e74-447d-94b9-8610c4d91f7c tempest-SnapshotDependencyTests-1749138146 None] Create snapshot completed successfully Sep 23 14:52:14 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-afb307bf-c7ab-42ee-835f-1d619da40e7b tempest-ProjectMemberTests-700601358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:52:14 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-afb307bf-c7ab-42ee-835f-1d619da40e7b tempest-ProjectMemberTests-700601358 None] Flow 'volume_create_manager' (93b18c68-d2e1-4dd5-b9f7-30b6ccb546ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:52:14 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-afb307bf-c7ab-42ee-835f-1d619da40e7b tempest-ProjectMemberTests-700601358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f0e5a99-641f-4400-b52c-8ee96945929e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:52:14 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-afb307bf-c7ab-42ee-835f-1d619da40e7b tempest-ProjectMemberTests-700601358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f0e5a99-641f-4400-b52c-8ee96945929e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:52:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-253299149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e5bcebb-b83b-4207-a7ff-ccea157beee4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96e82c6bd57443b895414c81e35dd400',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:52:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:52:14Z,use_quota=True,user_id='ec53ea8e97044f789c6e4da593a5da06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:52:14 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-afb307bf-c7ab-42ee-835f-1d619da40e7b tempest-ProjectMemberTests-700601358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71a2d3e8-c93d-4cd9-be47-402b66393d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:52:14 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-afb307bf-c7ab-42ee-835f-1d619da40e7b tempest-ProjectMemberTests-700601358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71a2d3e8-c93d-4cd9-be47-402b66393d41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:52:14 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-afb307bf-c7ab-42ee-835f-1d619da40e7b tempest-ProjectMemberTests-700601358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd9524ba-c1be-4ce1-ab36-0a6bd48d46c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:52:14 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-afb307bf-c7ab-42ee-835f-1d619da40e7b tempest-ProjectMemberTests-700601358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd9524ba-c1be-4ce1-ab36-0a6bd48d46c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e5bcebb-b83b-4207-a7ff-ccea157beee4', 'volume_name': 'volume-4e5bcebb-b83b-4207-a7ff-ccea157beee4', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:52:14 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-afb307bf-c7ab-42ee-835f-1d619da40e7b tempest-ProjectMemberTests-700601358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35bf010b-970f-451e-b013-ba14ffa6606e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:52:14 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-afb307bf-c7ab-42ee-835f-1d619da40e7b tempest-ProjectMemberTests-700601358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35bf010b-970f-451e-b013-ba14ffa6606e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:52:14 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-afb307bf-c7ab-42ee-835f-1d619da40e7b tempest-ProjectMemberTests-700601358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1b6178b-7b1b-46e2-bbc6-648a4247d16d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:52:14 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-afb307bf-c7ab-42ee-835f-1d619da40e7b tempest-ProjectMemberTests-700601358 None] Volume 4e5bcebb-b83b-4207-a7ff-ccea157beee4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e5bcebb-b83b-4207-a7ff-ccea157beee4', 'volume_size': 1} Sep 23 14:52:14 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-afb307bf-c7ab-42ee-835f-1d619da40e7b tempest-ProjectMemberTests-700601358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:52:14 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-afb307bf-c7ab-42ee-835f-1d619da40e7b tempest-ProjectMemberTests-700601358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:52:14 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-afb307bf-c7ab-42ee-835f-1d619da40e7b tempest-ProjectMemberTests-700601358 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:52:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-253299149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e5bcebb-b83b-4207-a7ff-ccea157beee4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96e82c6bd57443b895414c81e35dd400',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:52:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:52:14Z,use_quota=True,user_id='ec53ea8e97044f789c6e4da593a5da06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:52:14 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-afb307bf-c7ab-42ee-835f-1d619da40e7b tempest-ProjectMemberTests-700601358 None] Creating volume 4e5bcebb-b83b-4207-a7ff-ccea157beee4 {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:52:14 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-afb307bf-c7ab-42ee-835f-1d619da40e7b tempest-ProjectMemberTests-700601358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:52:14 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-afb307bf-c7ab-42ee-835f-1d619da40e7b tempest-ProjectMemberTests-700601358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:52:14 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-afb307bf-c7ab-42ee-835f-1d619da40e7b tempest-ProjectMemberTests-700601358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:52:14 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-afb307bf-c7ab-42ee-835f-1d619da40e7b tempest-ProjectMemberTests-700601358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:52:14 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-afb307bf-c7ab-42ee-835f-1d619da40e7b tempest-ProjectMemberTests-700601358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:52:14 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-afb307bf-c7ab-42ee-835f-1d619da40e7b tempest-ProjectMemberTests-700601358 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:52:14 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-afb307bf-c7ab-42ee-835f-1d619da40e7b tempest-ProjectMemberTests-700601358 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:52:14 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-afb307bf-c7ab-42ee-835f-1d619da40e7b tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4e5bcebb-b83b-4207-a7ff-ccea157beee4 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:14 devstack sudo[104845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4e5bcebb-b83b-4207-a7ff-ccea157beee4 1073741824 Sep 23 14:52:14 devstack sudo[104845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:14 devstack sudo[104845]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:14 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-afb307bf-c7ab-42ee-835f-1d619da40e7b tempest-ProjectMemberTests-700601358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4e5bcebb-b83b-4207-a7ff-ccea157beee4 1073741824" returned: 0 in 0.412s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:14 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-afb307bf-c7ab-42ee-835f-1d619da40e7b tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4e5bcebb-b83b-4207-a7ff-ccea157beee4 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:14 devstack sudo[104851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4e5bcebb-b83b-4207-a7ff-ccea157beee4 Sep 23 14:52:14 devstack sudo[104851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:14 devstack sudo[104851]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:14 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-afb307bf-c7ab-42ee-835f-1d619da40e7b tempest-ProjectMemberTests-700601358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4e5bcebb-b83b-4207-a7ff-ccea157beee4" returned: 0 in 0.245s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:14 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-afb307bf-c7ab-42ee-835f-1d619da40e7b tempest-ProjectMemberTests-700601358 None] <== create_volume: return (698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:52:14 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-afb307bf-c7ab-42ee-835f-1d619da40e7b tempest-ProjectMemberTests-700601358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.701s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:52:14 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-afb307bf-c7ab-42ee-835f-1d619da40e7b tempest-ProjectMemberTests-700601358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1b6178b-7b1b-46e2-bbc6-648a4247d16d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e5bcebb-b83b-4207-a7ff-ccea157beee4', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:52:14 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-afb307bf-c7ab-42ee-835f-1d619da40e7b tempest-ProjectMemberTests-700601358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c97ad02-ba8d-4399-bd0b-de35380ab500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:52:14 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-afb307bf-c7ab-42ee-835f-1d619da40e7b tempest-ProjectMemberTests-700601358 None] Volume volume-4e5bcebb-b83b-4207-a7ff-ccea157beee4 (4e5bcebb-b83b-4207-a7ff-ccea157beee4): created successfully Sep 23 14:52:14 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-afb307bf-c7ab-42ee-835f-1d619da40e7b tempest-ProjectMemberTests-700601358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c97ad02-ba8d-4399-bd0b-de35380ab500) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:52:14 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-afb307bf-c7ab-42ee-835f-1d619da40e7b tempest-ProjectMemberTests-700601358 None] Flow 'volume_create_manager' (93b18c68-d2e1-4dd5-b9f7-30b6ccb546ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:52:14 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-afb307bf-c7ab-42ee-835f-1d619da40e7b tempest-ProjectMemberTests-700601358 None] Created volume successfully. Sep 23 14:52:15 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-08283a1d-a55d-43cf-8e10-19de1d436f43 tempest-ProjectMemberTests-700601358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:52:15 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-08283a1d-a55d-43cf-8e10-19de1d436f43 tempest-ProjectMemberTests-700601358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:52:15 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-08283a1d-a55d-43cf-8e10-19de1d436f43 tempest-ProjectMemberTests-700601358 None] Creating offline snapshot 2446ba1d-c781-4664-af85-8466fc7cc153 of volume 4e5bcebb-b83b-4207-a7ff-ccea157beee4 {{(pid=86310) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 14:52:15 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c00c451-079b-48b8-914e-a858c0db833f]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:52:15 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-08283a1d-a55d-43cf-8e10-19de1d436f43 tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4e5bcebb-b83b-4207-a7ff-ccea157beee4 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:15 devstack sudo[104854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4e5bcebb-b83b-4207-a7ff-ccea157beee4 Sep 23 14:52:15 devstack sudo[104854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:15 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f181d08-3fe0-4613-b14b-95ad901d9be9 tempest-SnapshotDependencyTests-1749138146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:52:15 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-9f181d08-3fe0-4613-b14b-95ad901d9be9 tempest-SnapshotDependencyTests-1749138146 None] Flow 'volume_create_manager' (a4d88d45-829f-4457-9a42-8baec931ca00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:52:15 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-9f181d08-3fe0-4613-b14b-95ad901d9be9 tempest-SnapshotDependencyTests-1749138146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a0bd6a3-9a7b-4396-a60a-b7dde8acd218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:52:15 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-9f181d08-3fe0-4613-b14b-95ad901d9be9 tempest-SnapshotDependencyTests-1749138146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a0bd6a3-9a7b-4396-a60a-b7dde8acd218) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:52:15Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64d116a9-5a4a-4a82-98a4-3aba2f683a9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45b22bbfac2f475ea8c935148fac9630',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:52:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f7c9e24c-71e4-4d13-989a-482ce7b20b39,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:52:15Z,use_quota=True,user_id='d7f7daf36cde42f98a75e72aec050a9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:52:15 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-9f181d08-3fe0-4613-b14b-95ad901d9be9 tempest-SnapshotDependencyTests-1749138146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea2ed885-f905-437a-99c9-caa018ea53e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:52:15 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-9f181d08-3fe0-4613-b14b-95ad901d9be9 tempest-SnapshotDependencyTests-1749138146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea2ed885-f905-437a-99c9-caa018ea53e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:52:15 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-9f181d08-3fe0-4613-b14b-95ad901d9be9 tempest-SnapshotDependencyTests-1749138146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ba0c166-8da8-43a1-9c61-5155f9da43b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:52:15 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-9f181d08-3fe0-4613-b14b-95ad901d9be9 tempest-SnapshotDependencyTests-1749138146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ba0c166-8da8-43a1-9c61-5155f9da43b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '64d116a9-5a4a-4a82-98a4-3aba2f683a9f', 'volume_name': 'volume-64d116a9-5a4a-4a82-98a4-3aba2f683a9f', 'volume_size': 1, 'snapshot_id': 'f7c9e24c-71e4-4d13-989a-482ce7b20b39'}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:52:15 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-9f181d08-3fe0-4613-b14b-95ad901d9be9 tempest-SnapshotDependencyTests-1749138146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9babcf15-d9d7-4eb1-93a2-6a66160e38cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:52:15 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-9f181d08-3fe0-4613-b14b-95ad901d9be9 tempest-SnapshotDependencyTests-1749138146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9babcf15-d9d7-4eb1-93a2-6a66160e38cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:52:15 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-9f181d08-3fe0-4613-b14b-95ad901d9be9 tempest-SnapshotDependencyTests-1749138146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fede91b8-7739-4850-ad9b-9cec081a566b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:52:15 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-9f181d08-3fe0-4613-b14b-95ad901d9be9 tempest-SnapshotDependencyTests-1749138146 None] Volume 64d116a9-5a4a-4a82-98a4-3aba2f683a9f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-64d116a9-5a4a-4a82-98a4-3aba2f683a9f', 'volume_size': 1, 'snapshot_id': 'f7c9e24c-71e4-4d13-989a-482ce7b20b39'} Sep 23 14:52:15 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-9f181d08-3fe0-4613-b14b-95ad901d9be9 tempest-SnapshotDependencyTests-1749138146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:52:15 devstack sudo[104854]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:15 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-08283a1d-a55d-43cf-8e10-19de1d436f43 tempest-ProjectMemberTests-700601358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4e5bcebb-b83b-4207-a7ff-ccea157beee4" returned: 0 in 0.374s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:15 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-08283a1d-a55d-43cf-8e10-19de1d436f43 tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4e5bcebb-b83b-4207-a7ff-ccea157beee4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4e5bcebb-b83b-4207-a7ff-ccea157beee4.2446ba1d-c781-4664-af85-8466fc7cc153 1G {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:15 devstack sudo[104859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4e5bcebb-b83b-4207-a7ff-ccea157beee4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4e5bcebb-b83b-4207-a7ff-ccea157beee4.2446ba1d-c781-4664-af85-8466fc7cc153 1G Sep 23 14:52:15 devstack sudo[104859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:16 devstack sudo[104859]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:16 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-08283a1d-a55d-43cf-8e10-19de1d436f43 tempest-ProjectMemberTests-700601358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4e5bcebb-b83b-4207-a7ff-ccea157beee4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4e5bcebb-b83b-4207-a7ff-ccea157beee4.2446ba1d-c781-4664-af85-8466fc7cc153 1G" returned: 0 in 0.407s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:16 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-08283a1d-a55d-43cf-8e10-19de1d436f43 tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e5bcebb-b83b-4207-a7ff-ccea157beee4 -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4e5bcebb-b83b-4207-a7ff-ccea157beee4.2446ba1d-c781-4664-af85-8466fc7cc153 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:16 devstack sudo[104864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e5bcebb-b83b-4207-a7ff-ccea157beee4 -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4e5bcebb-b83b-4207-a7ff-ccea157beee4.2446ba1d-c781-4664-af85-8466fc7cc153 Sep 23 14:52:16 devstack sudo[104864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:16 devstack sudo[104864]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:16 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-08283a1d-a55d-43cf-8e10-19de1d436f43 tempest-ProjectMemberTests-700601358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e5bcebb-b83b-4207-a7ff-ccea157beee4 -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4e5bcebb-b83b-4207-a7ff-ccea157beee4.2446ba1d-c781-4664-af85-8466fc7cc153" returned: 0 in 0.291s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:16 devstack cinder-volume[86310]: WARNING cinder.volume.drivers.remotefs [None req-08283a1d-a55d-43cf-8e10-19de1d436f43 tempest-ProjectMemberTests-700601358 None] /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4e5bcebb-b83b-4207-a7ff-ccea157beee4.2446ba1d-c781-4664-af85-8466fc7cc153 is being set with open permissions: ugo+rw Sep 23 14:52:16 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-08283a1d-a55d-43cf-8e10-19de1d436f43 tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4e5bcebb-b83b-4207-a7ff-ccea157beee4.2446ba1d-c781-4664-af85-8466fc7cc153 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:16 devstack sudo[104869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4e5bcebb-b83b-4207-a7ff-ccea157beee4.2446ba1d-c781-4664-af85-8466fc7cc153 Sep 23 14:52:16 devstack sudo[104869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:16 devstack sudo[104869]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:16 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-08283a1d-a55d-43cf-8e10-19de1d436f43 tempest-ProjectMemberTests-700601358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4e5bcebb-b83b-4207-a7ff-ccea157beee4.2446ba1d-c781-4664-af85-8466fc7cc153" returned: 0 in 0.263s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:16 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-08283a1d-a55d-43cf-8e10-19de1d436f43 tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4e5bcebb-b83b-4207-a7ff-ccea157beee4.info {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:16 devstack sudo[104872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4e5bcebb-b83b-4207-a7ff-ccea157beee4.info Sep 23 14:52:16 devstack sudo[104872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:16 devstack sudo[104872]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:16 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-08283a1d-a55d-43cf-8e10-19de1d436f43 tempest-ProjectMemberTests-700601358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4e5bcebb-b83b-4207-a7ff-ccea157beee4.info" returned: 0 in 0.266s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:16 devstack cinder-volume[86310]: WARNING cinder.volume.drivers.remotefs [None req-08283a1d-a55d-43cf-8e10-19de1d436f43 tempest-ProjectMemberTests-700601358 None] /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4e5bcebb-b83b-4207-a7ff-ccea157beee4.info is being set with open permissions: ugo+rw Sep 23 14:52:16 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-08283a1d-a55d-43cf-8e10-19de1d436f43 tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4e5bcebb-b83b-4207-a7ff-ccea157beee4.info {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:16 devstack sudo[104875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4e5bcebb-b83b-4207-a7ff-ccea157beee4.info Sep 23 14:52:16 devstack sudo[104875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:17 devstack sudo[104875]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-08283a1d-a55d-43cf-8e10-19de1d436f43 tempest-ProjectMemberTests-700601358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4e5bcebb-b83b-4207-a7ff-ccea157beee4.info" returned: 0 in 0.240s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-08283a1d-a55d-43cf-8e10-19de1d436f43 tempest-ProjectMemberTests-700601358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.939s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:52:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-9f181d08-3fe0-4613-b14b-95ad901d9be9 tempest-SnapshotDependencyTests-1749138146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.593s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:52:17 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-9f181d08-3fe0-4613-b14b-95ad901d9be9 tempest-SnapshotDependencyTests-1749138146 None] Acquiring lock "cinder-quobyte-f7c9e24c-71e4-4d13-989a-482ce7b20b39-64d116a9-5a4a-4a82-98a4-3aba2f683a9f" by "_create_volume_from_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:52:17 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-9f181d08-3fe0-4613-b14b-95ad901d9be9 tempest-SnapshotDependencyTests-1749138146 None] Lock "cinder-quobyte-f7c9e24c-71e4-4d13-989a-482ce7b20b39-64d116a9-5a4a-4a82-98a4-3aba2f683a9f" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:52:17 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-9f181d08-3fe0-4613-b14b-95ad901d9be9 tempest-SnapshotDependencyTests-1749138146 None] Creating volume 64d116a9-5a4a-4a82-98a4-3aba2f683a9f from snapshot f7c9e24c-71e4-4d13-989a-482ce7b20b39 {{(pid=86310) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 23 14:52:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-9f181d08-3fe0-4613-b14b-95ad901d9be9 tempest-SnapshotDependencyTests-1749138146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:52:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-9f181d08-3fe0-4613-b14b-95ad901d9be9 tempest-SnapshotDependencyTests-1749138146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:52:17 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-9f181d08-3fe0-4613-b14b-95ad901d9be9 tempest-SnapshotDependencyTests-1749138146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:52:17 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-9f181d08-3fe0-4613-b14b-95ad901d9be9 tempest-SnapshotDependencyTests-1749138146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:52:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-9f181d08-3fe0-4613-b14b-95ad901d9be9 tempest-SnapshotDependencyTests-1749138146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:52:17 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-9f181d08-3fe0-4613-b14b-95ad901d9be9 tempest-SnapshotDependencyTests-1749138146 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:52:17 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-9f181d08-3fe0-4613-b14b-95ad901d9be9 tempest-SnapshotDependencyTests-1749138146 None] Acquiring lock "cinder-quobyte-64d116a9-5a4a-4a82-98a4-3aba2f683a9f" by "_copy_volume_from_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:52:17 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-08283a1d-a55d-43cf-8e10-19de1d436f43 tempest-ProjectMemberTests-700601358 None] Create snapshot completed successfully Sep 23 14:52:17 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-9f181d08-3fe0-4613-b14b-95ad901d9be9 tempest-SnapshotDependencyTests-1749138146 None] Lock "cinder-quobyte-64d116a9-5a4a-4a82-98a4-3aba2f683a9f" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:52:17 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-9f181d08-3fe0-4613-b14b-95ad901d9be9 tempest-SnapshotDependencyTests-1749138146 None] snapshot: f7c9e24c-71e4-4d13-989a-482ce7b20b39, volume: 64d116a9-5a4a-4a82-98a4-3aba2f683a9f, {{(pid=86310) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 23 14:52:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-9f181d08-3fe0-4613-b14b-95ad901d9be9 tempest-SnapshotDependencyTests-1749138146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:52:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-9f181d08-3fe0-4613-b14b-95ad901d9be9 tempest-SnapshotDependencyTests-1749138146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:52:17 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-9f181d08-3fe0-4613-b14b-95ad901d9be9 tempest-SnapshotDependencyTests-1749138146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:52:17 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-9f181d08-3fe0-4613-b14b-95ad901d9be9 tempest-SnapshotDependencyTests-1749138146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:52:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-9f181d08-3fe0-4613-b14b-95ad901d9be9 tempest-SnapshotDependencyTests-1749138146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:52:17 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[369c250e-e395-4c3a-86ed-a68590b2edea]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:52:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-9f181d08-3fe0-4613-b14b-95ad901d9be9 tempest-SnapshotDependencyTests-1749138146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-69b96242-74f5-4401-9ebc-09d94bfb91c6.f7c9e24c-71e4-4d13-989a-482ce7b20b39 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:17 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-09dd2adf-5284-44bf-843a-083b6f5a6cbe tempest-ProjectMemberTests-700601358 None] Acquiring lock "cinder-2446ba1d-c781-4664-af85-8466fc7cc153-delete_snapshot" by "delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:52:17 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-09dd2adf-5284-44bf-843a-083b6f5a6cbe tempest-ProjectMemberTests-700601358 None] Lock "cinder-2446ba1d-c781-4664-af85-8466fc7cc153-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:52:17 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-09dd2adf-5284-44bf-843a-083b6f5a6cbe tempest-ProjectMemberTests-700601358 None] Acquiring lock "cinder-quobyte-4e5bcebb-b83b-4207-a7ff-ccea157beee4" by "delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:52:17 devstack sudo[104878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-69b96242-74f5-4401-9ebc-09d94bfb91c6.f7c9e24c-71e4-4d13-989a-482ce7b20b39 Sep 23 14:52:17 devstack sudo[104878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:17 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-09dd2adf-5284-44bf-843a-083b6f5a6cbe tempest-ProjectMemberTests-700601358 None] Lock "cinder-quobyte-4e5bcebb-b83b-4207-a7ff-ccea157beee4" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:52:17 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-09dd2adf-5284-44bf-843a-083b6f5a6cbe tempest-ProjectMemberTests-700601358 None] Acquiring lock "cinder-quobyte-2446ba1d-c781-4664-af85-8466fc7cc153" by "_delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:52:17 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-09dd2adf-5284-44bf-843a-083b6f5a6cbe tempest-ProjectMemberTests-700601358 None] Lock "cinder-quobyte-2446ba1d-c781-4664-af85-8466fc7cc153" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:52:17 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-09dd2adf-5284-44bf-843a-083b6f5a6cbe tempest-ProjectMemberTests-700601358 None] Deleting offline snapshot 2446ba1d-c781-4664-af85-8466fc7cc153 of volume 4e5bcebb-b83b-4207-a7ff-ccea157beee4 {{(pid=86310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 14:52:17 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-09dd2adf-5284-44bf-843a-083b6f5a6cbe tempest-ProjectMemberTests-700601358 None] snapshot_file for this snap is: volume-4e5bcebb-b83b-4207-a7ff-ccea157beee4.2446ba1d-c781-4664-af85-8466fc7cc153 {{(pid=86310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 14:52:17 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[482927c7-6c8f-4385-8549-2b589b3d04e0]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:52:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-09dd2adf-5284-44bf-843a-083b6f5a6cbe tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4e5bcebb-b83b-4207-a7ff-ccea157beee4.2446ba1d-c781-4664-af85-8466fc7cc153 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:17 devstack sudo[104880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4e5bcebb-b83b-4207-a7ff-ccea157beee4.2446ba1d-c781-4664-af85-8466fc7cc153 Sep 23 14:52:17 devstack sudo[104880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:17 devstack sudo[104878]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-9f181d08-3fe0-4613-b14b-95ad901d9be9 tempest-SnapshotDependencyTests-1749138146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-69b96242-74f5-4401-9ebc-09d94bfb91c6.f7c9e24c-71e4-4d13-989a-482ce7b20b39" returned: 0 in 0.380s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:17 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-9f181d08-3fe0-4613-b14b-95ad901d9be9 tempest-SnapshotDependencyTests-1749138146 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69b96242-74f5-4401-9ebc-09d94bfb91c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 14:52:17 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d6d910-01c7-4ee9-96dc-e8258f6dc2a8]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:52:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-9f181d08-3fe0-4613-b14b-95ad901d9be9 tempest-SnapshotDependencyTests-1749138146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-69b96242-74f5-4401-9ebc-09d94bfb91c6 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:17 devstack sudo[104885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-69b96242-74f5-4401-9ebc-09d94bfb91c6 Sep 23 14:52:17 devstack sudo[104885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:17 devstack sudo[104880]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-09dd2adf-5284-44bf-843a-083b6f5a6cbe tempest-ProjectMemberTests-700601358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4e5bcebb-b83b-4207-a7ff-ccea157beee4.2446ba1d-c781-4664-af85-8466fc7cc153" returned: 0 in 0.380s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:17 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-09dd2adf-5284-44bf-843a-083b6f5a6cbe tempest-ProjectMemberTests-700601358 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e5bcebb-b83b-4207-a7ff-ccea157beee4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 14:52:17 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ee59bb2-6b8d-4303-8ad0-ffb0e72c55b6]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:52:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-09dd2adf-5284-44bf-843a-083b6f5a6cbe tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4e5bcebb-b83b-4207-a7ff-ccea157beee4 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:18 devstack sudo[104890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4e5bcebb-b83b-4207-a7ff-ccea157beee4 Sep 23 14:52:18 devstack sudo[104890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:18 devstack sudo[104885]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:18 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-9f181d08-3fe0-4613-b14b-95ad901d9be9 tempest-SnapshotDependencyTests-1749138146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-69b96242-74f5-4401-9ebc-09d94bfb91c6" returned: 0 in 0.376s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:18 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-9f181d08-3fe0-4613-b14b-95ad901d9be9 tempest-SnapshotDependencyTests-1749138146 None] will copy from snapshot at /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-69b96242-74f5-4401-9ebc-09d94bfb91c6 {{(pid=86310) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 23 14:52:18 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-9f181d08-3fe0-4613-b14b-95ad901d9be9 tempest-SnapshotDependencyTests-1749138146 None] Creating direct copy from snapshot {{(pid=86310) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 23 14:52:18 devstack cinder-volume[86310]: DEBUG cinder.utils [None req-9f181d08-3fe0-4613-b14b-95ad901d9be9 tempest-SnapshotDependencyTests-1749138146 None] Path /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-64d116a9-5a4a-4a82-98a4-3aba2f683a9f not found in is_blk_device check {{(pid=86310) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 23 14:52:18 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-9f181d08-3fe0-4613-b14b-95ad901d9be9 tempest-SnapshotDependencyTests-1749138146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-69b96242-74f5-4401-9ebc-09d94bfb91c6 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-64d116a9-5a4a-4a82-98a4-3aba2f683a9f {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:18 devstack sudo[104895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-69b96242-74f5-4401-9ebc-09d94bfb91c6 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-64d116a9-5a4a-4a82-98a4-3aba2f683a9f Sep 23 14:52:18 devstack sudo[104895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:18 devstack sudo[104890]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:18 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-09dd2adf-5284-44bf-843a-083b6f5a6cbe tempest-ProjectMemberTests-700601358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4e5bcebb-b83b-4207-a7ff-ccea157beee4" returned: 0 in 0.371s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:18 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-09dd2adf-5284-44bf-843a-083b6f5a6cbe tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4e5bcebb-b83b-4207-a7ff-ccea157beee4.2446ba1d-c781-4664-af85-8466fc7cc153 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:18 devstack sudo[104900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4e5bcebb-b83b-4207-a7ff-ccea157beee4.2446ba1d-c781-4664-af85-8466fc7cc153 Sep 23 14:52:18 devstack sudo[104900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:18 devstack sudo[104900]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:18 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-09dd2adf-5284-44bf-843a-083b6f5a6cbe tempest-ProjectMemberTests-700601358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4e5bcebb-b83b-4207-a7ff-ccea157beee4.2446ba1d-c781-4664-af85-8466fc7cc153" returned: 0 in 0.562s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:18 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-09dd2adf-5284-44bf-843a-083b6f5a6cbe tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4e5bcebb-b83b-4207-a7ff-ccea157beee4.2446ba1d-c781-4664-af85-8466fc7cc153 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:18 devstack sudo[104916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4e5bcebb-b83b-4207-a7ff-ccea157beee4.2446ba1d-c781-4664-af85-8466fc7cc153 Sep 23 14:52:18 devstack sudo[104916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:19 devstack sudo[104916]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:19 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-09dd2adf-5284-44bf-843a-083b6f5a6cbe tempest-ProjectMemberTests-700601358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4e5bcebb-b83b-4207-a7ff-ccea157beee4.2446ba1d-c781-4664-af85-8466fc7cc153" returned: 0 in 0.358s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:19 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-09dd2adf-5284-44bf-843a-083b6f5a6cbe tempest-ProjectMemberTests-700601358 None] Lock "cinder-quobyte-2446ba1d-c781-4664-af85-8466fc7cc153" released by "_delete_snapshot" :: held 1.831s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:52:19 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-09dd2adf-5284-44bf-843a-083b6f5a6cbe tempest-ProjectMemberTests-700601358 None] Lock "cinder-quobyte-4e5bcebb-b83b-4207-a7ff-ccea157beee4" released by "delete_snapshot" :: held 1.863s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:52:19 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-09dd2adf-5284-44bf-843a-083b6f5a6cbe tempest-ProjectMemberTests-700601358 None] Created reservations ['4a3159e9-af18-4e3c-ad28-2d3acfb4414f', '3a0151b2-4114-4262-afb1-ea9d0e5db2ab', '77cc98c2-5c89-4988-8b39-b912b10302b6', 'd1cffdfa-bccc-4651-b822-afcb975ac6d9'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:52:19 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-09dd2adf-5284-44bf-843a-083b6f5a6cbe tempest-ProjectMemberTests-700601358 None] Delete snapshot completed successfully. Sep 23 14:52:19 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-09dd2adf-5284-44bf-843a-083b6f5a6cbe tempest-ProjectMemberTests-700601358 None] Lock "cinder-2446ba1d-c781-4664-af85-8466fc7cc153-delete_snapshot" released by "delete_snapshot" :: held 2.128s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:52:19 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-4b62b13a-ad30-42a2-aa76-74204aaa3e44 tempest-ProjectMemberTests-700601358 None] Acquiring lock "cinder-4e5bcebb-b83b-4207-a7ff-ccea157beee4-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:52:19 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-4b62b13a-ad30-42a2-aa76-74204aaa3e44 tempest-ProjectMemberTests-700601358 None] Lock "cinder-4e5bcebb-b83b-4207-a7ff-ccea157beee4-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:52:19 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-4b62b13a-ad30-42a2-aa76-74204aaa3e44 tempest-ProjectMemberTests-700601358 None] Acquiring lock "cinder-quobyte-4e5bcebb-b83b-4207-a7ff-ccea157beee4" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:52:19 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-4b62b13a-ad30-42a2-aa76-74204aaa3e44 tempest-ProjectMemberTests-700601358 None] Lock "cinder-quobyte-4e5bcebb-b83b-4207-a7ff-ccea157beee4" acquired by "delete_volume" :: waited 0.029s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:52:19 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[b16ae5ec-3eca-453b-b331-4ab30fcadf51]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:52:19 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-4b62b13a-ad30-42a2-aa76-74204aaa3e44 tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4e5bcebb-b83b-4207-a7ff-ccea157beee4 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:20 devstack sudo[104920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4e5bcebb-b83b-4207-a7ff-ccea157beee4 Sep 23 14:52:20 devstack sudo[104920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:20 devstack sudo[104920]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:20 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-4b62b13a-ad30-42a2-aa76-74204aaa3e44 tempest-ProjectMemberTests-700601358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4e5bcebb-b83b-4207-a7ff-ccea157beee4" returned: 0 in 0.567s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:20 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-4b62b13a-ad30-42a2-aa76-74204aaa3e44 tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4e5bcebb-b83b-4207-a7ff-ccea157beee4 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:20 devstack sudo[104925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4e5bcebb-b83b-4207-a7ff-ccea157beee4 Sep 23 14:52:20 devstack sudo[104925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:20 devstack sudo[104925]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:20 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-4b62b13a-ad30-42a2-aa76-74204aaa3e44 tempest-ProjectMemberTests-700601358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4e5bcebb-b83b-4207-a7ff-ccea157beee4" returned: 0 in 0.390s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:20 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-4b62b13a-ad30-42a2-aa76-74204aaa3e44 tempest-ProjectMemberTests-700601358 None] Lock "cinder-quobyte-4e5bcebb-b83b-4207-a7ff-ccea157beee4" released by "delete_volume" :: held 1.107s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:52:21 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-4b62b13a-ad30-42a2-aa76-74204aaa3e44 tempest-ProjectMemberTests-700601358 None] Created reservations ['2e5797d8-e384-4b89-95da-39845b31797d', '532a9707-df14-4c62-aff1-c442fa40dbcd', 'f6afad7a-87d2-42af-b446-796c15e4a49a', '142b6864-b03c-4cae-b243-a5cf3aaa0701'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:52:21 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-4b62b13a-ad30-42a2-aa76-74204aaa3e44 tempest-ProjectMemberTests-700601358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:52:21 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-4b62b13a-ad30-42a2-aa76-74204aaa3e44 tempest-ProjectMemberTests-700601358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:52:21 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-4b62b13a-ad30-42a2-aa76-74204aaa3e44 tempest-ProjectMemberTests-700601358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:52:21 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-4b62b13a-ad30-42a2-aa76-74204aaa3e44 tempest-ProjectMemberTests-700601358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:52:21 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-4b62b13a-ad30-42a2-aa76-74204aaa3e44 tempest-ProjectMemberTests-700601358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:52:21 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-4b62b13a-ad30-42a2-aa76-74204aaa3e44 tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:21 devstack sudo[104928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:52:21 devstack sudo[104928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:21 devstack sudo[104928]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:21 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-4b62b13a-ad30-42a2-aa76-74204aaa3e44 tempest-ProjectMemberTests-700601358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.396s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:21 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-4b62b13a-ad30-42a2-aa76-74204aaa3e44 tempest-ProjectMemberTests-700601358 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:52:21 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-4b62b13a-ad30-42a2-aa76-74204aaa3e44 tempest-ProjectMemberTests-700601358 None] Deleted volume successfully. Sep 23 14:52:21 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-4b62b13a-ad30-42a2-aa76-74204aaa3e44 tempest-ProjectMemberTests-700601358 None] Lock "cinder-4e5bcebb-b83b-4207-a7ff-ccea157beee4-delete_volume" released by "delete_volume" :: held 1.841s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:52:22 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-d08828a9-f31f-43d0-b5e9-a503be127beb tempest-ProjectMemberTests-700601358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:52:22 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-d08828a9-f31f-43d0-b5e9-a503be127beb tempest-ProjectMemberTests-700601358 None] Flow 'volume_create_manager' (d3ea0ed5-0ff2-4d8c-a7eb-76aaa139cf01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:52:22 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-d08828a9-f31f-43d0-b5e9-a503be127beb tempest-ProjectMemberTests-700601358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0a91999-101e-4d5b-aaa1-d776820ecace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:52:22 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-d08828a9-f31f-43d0-b5e9-a503be127beb tempest-ProjectMemberTests-700601358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0a91999-101e-4d5b-aaa1-d776820ecace) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:52:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-427344268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8833acae-70c2-4c7c-8475-8c6a94273f73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96e82c6bd57443b895414c81e35dd400',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:52:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:52:23Z,use_quota=True,user_id='ec53ea8e97044f789c6e4da593a5da06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:52:22 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-d08828a9-f31f-43d0-b5e9-a503be127beb tempest-ProjectMemberTests-700601358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05ee0e5f-0d21-4604-81a2-25724fb947ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:52:22 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-d08828a9-f31f-43d0-b5e9-a503be127beb tempest-ProjectMemberTests-700601358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05ee0e5f-0d21-4604-81a2-25724fb947ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:52:22 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-d08828a9-f31f-43d0-b5e9-a503be127beb tempest-ProjectMemberTests-700601358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dc2c257-e194-4a5a-83cf-d825d178f6dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:52:22 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-d08828a9-f31f-43d0-b5e9-a503be127beb tempest-ProjectMemberTests-700601358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dc2c257-e194-4a5a-83cf-d825d178f6dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8833acae-70c2-4c7c-8475-8c6a94273f73', 'volume_name': 'volume-8833acae-70c2-4c7c-8475-8c6a94273f73', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:52:22 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-d08828a9-f31f-43d0-b5e9-a503be127beb tempest-ProjectMemberTests-700601358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd8bfe81-a901-460b-afda-a80af3b77c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:52:22 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-d08828a9-f31f-43d0-b5e9-a503be127beb tempest-ProjectMemberTests-700601358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd8bfe81-a901-460b-afda-a80af3b77c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:52:22 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-d08828a9-f31f-43d0-b5e9-a503be127beb tempest-ProjectMemberTests-700601358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1030974-c423-43a5-a297-f1bce5f5f398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:52:22 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-d08828a9-f31f-43d0-b5e9-a503be127beb tempest-ProjectMemberTests-700601358 None] Volume 8833acae-70c2-4c7c-8475-8c6a94273f73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8833acae-70c2-4c7c-8475-8c6a94273f73', 'volume_size': 1} Sep 23 14:52:22 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-d08828a9-f31f-43d0-b5e9-a503be127beb tempest-ProjectMemberTests-700601358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:52:24 devstack sudo[104895]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:24 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-9f181d08-3fe0-4613-b14b-95ad901d9be9 tempest-SnapshotDependencyTests-1749138146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-69b96242-74f5-4401-9ebc-09d94bfb91c6 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-64d116a9-5a4a-4a82-98a4-3aba2f683a9f" returned: 0 in 6.627s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:24 devstack cinder-volume[86310]: DEBUG cinder.image.image_utils [None req-9f181d08-3fe0-4613-b14b-95ad901d9be9 tempest-SnapshotDependencyTests-1749138146 None] Image conversion details: src /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-69b96242-74f5-4401-9ebc-09d94bfb91c6, size 1024.00 MB, duration 6.63 sec, destination /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-64d116a9-5a4a-4a82-98a4-3aba2f683a9f {{(pid=86310) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 14:52:24 devstack cinder-volume[86310]: INFO cinder.image.image_utils [None req-9f181d08-3fe0-4613-b14b-95ad901d9be9 tempest-SnapshotDependencyTests-1749138146 None] Converted 1024.00 MB image at 154.48 MB/s Sep 23 14:52:24 devstack cinder-volume[86310]: WARNING cinder.volume.drivers.remotefs [None req-9f181d08-3fe0-4613-b14b-95ad901d9be9 tempest-SnapshotDependencyTests-1749138146 None] /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-64d116a9-5a4a-4a82-98a4-3aba2f683a9f is being set with open permissions: ugo+rw Sep 23 14:52:24 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-9f181d08-3fe0-4613-b14b-95ad901d9be9 tempest-SnapshotDependencyTests-1749138146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-64d116a9-5a4a-4a82-98a4-3aba2f683a9f {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:24 devstack sudo[104932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-64d116a9-5a4a-4a82-98a4-3aba2f683a9f Sep 23 14:52:24 devstack sudo[104932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:24 devstack sudo[104932]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:24 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-9f181d08-3fe0-4613-b14b-95ad901d9be9 tempest-SnapshotDependencyTests-1749138146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-64d116a9-5a4a-4a82-98a4-3aba2f683a9f" returned: 0 in 0.244s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:24 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-9f181d08-3fe0-4613-b14b-95ad901d9be9 tempest-SnapshotDependencyTests-1749138146 None] Lock "cinder-quobyte-64d116a9-5a4a-4a82-98a4-3aba2f683a9f" released by "_copy_volume_from_snapshot" :: held 7.720s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:52:25 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-9f181d08-3fe0-4613-b14b-95ad901d9be9 tempest-SnapshotDependencyTests-1749138146 None] Lock "cinder-quobyte-f7c9e24c-71e4-4d13-989a-482ce7b20b39-64d116a9-5a4a-4a82-98a4-3aba2f683a9f" released by "_create_volume_from_snapshot" :: held 7.786s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:52:25 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-9f181d08-3fe0-4613-b14b-95ad901d9be9 tempest-SnapshotDependencyTests-1749138146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.807s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:52:25 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-d08828a9-f31f-43d0-b5e9-a503be127beb tempest-ProjectMemberTests-700601358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.262s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:52:25 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-d08828a9-f31f-43d0-b5e9-a503be127beb tempest-ProjectMemberTests-700601358 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:52:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-427344268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8833acae-70c2-4c7c-8475-8c6a94273f73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96e82c6bd57443b895414c81e35dd400',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:52:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:52:23Z,use_quota=True,user_id='ec53ea8e97044f789c6e4da593a5da06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:52:25 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-d08828a9-f31f-43d0-b5e9-a503be127beb tempest-ProjectMemberTests-700601358 None] Creating volume 8833acae-70c2-4c7c-8475-8c6a94273f73 {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:52:25 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-d08828a9-f31f-43d0-b5e9-a503be127beb tempest-ProjectMemberTests-700601358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:52:25 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-d08828a9-f31f-43d0-b5e9-a503be127beb tempest-ProjectMemberTests-700601358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:52:25 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-d08828a9-f31f-43d0-b5e9-a503be127beb tempest-ProjectMemberTests-700601358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:52:25 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-d08828a9-f31f-43d0-b5e9-a503be127beb tempest-ProjectMemberTests-700601358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:52:25 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-d08828a9-f31f-43d0-b5e9-a503be127beb tempest-ProjectMemberTests-700601358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:52:25 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-d08828a9-f31f-43d0-b5e9-a503be127beb tempest-ProjectMemberTests-700601358 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:52:25 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-d08828a9-f31f-43d0-b5e9-a503be127beb tempest-ProjectMemberTests-700601358 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:52:25 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d08828a9-f31f-43d0-b5e9-a503be127beb tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8833acae-70c2-4c7c-8475-8c6a94273f73 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:25 devstack sudo[104935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8833acae-70c2-4c7c-8475-8c6a94273f73 1073741824 Sep 23 14:52:25 devstack sudo[104935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:25 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-9f181d08-3fe0-4613-b14b-95ad901d9be9 tempest-SnapshotDependencyTests-1749138146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fede91b8-7739-4850-ad9b-9cec081a566b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64d116a9-5a4a-4a82-98a4-3aba2f683a9f', 'volume_size': 1, 'snapshot_id': 'f7c9e24c-71e4-4d13-989a-482ce7b20b39'}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:52:25 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-9f181d08-3fe0-4613-b14b-95ad901d9be9 tempest-SnapshotDependencyTests-1749138146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cf8dde1-8fca-46e8-8247-cc783d9d90ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:52:25 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-9f181d08-3fe0-4613-b14b-95ad901d9be9 tempest-SnapshotDependencyTests-1749138146 None] Volume volume-64d116a9-5a4a-4a82-98a4-3aba2f683a9f (64d116a9-5a4a-4a82-98a4-3aba2f683a9f): created successfully Sep 23 14:52:25 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-9f181d08-3fe0-4613-b14b-95ad901d9be9 tempest-SnapshotDependencyTests-1749138146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cf8dde1-8fca-46e8-8247-cc783d9d90ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:52:25 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-9f181d08-3fe0-4613-b14b-95ad901d9be9 tempest-SnapshotDependencyTests-1749138146 None] Flow 'volume_create_manager' (a4d88d45-829f-4457-9a42-8baec931ca00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:52:25 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-9f181d08-3fe0-4613-b14b-95ad901d9be9 tempest-SnapshotDependencyTests-1749138146 None] Created volume successfully. Sep 23 14:52:25 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-049b1a32-6ab2-4b60-bbc7-1d18bcc1b178 tempest-SnapshotDependencyTests-1749138146 None] Acquiring lock "cinder-f7c9e24c-71e4-4d13-989a-482ce7b20b39-delete_snapshot" by "delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:52:25 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-049b1a32-6ab2-4b60-bbc7-1d18bcc1b178 tempest-SnapshotDependencyTests-1749138146 None] Lock "cinder-f7c9e24c-71e4-4d13-989a-482ce7b20b39-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:52:25 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-049b1a32-6ab2-4b60-bbc7-1d18bcc1b178 tempest-SnapshotDependencyTests-1749138146 None] Acquiring lock "cinder-quobyte-69b96242-74f5-4401-9ebc-09d94bfb91c6" by "delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:52:25 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-049b1a32-6ab2-4b60-bbc7-1d18bcc1b178 tempest-SnapshotDependencyTests-1749138146 None] Lock "cinder-quobyte-69b96242-74f5-4401-9ebc-09d94bfb91c6" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:52:25 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-049b1a32-6ab2-4b60-bbc7-1d18bcc1b178 tempest-SnapshotDependencyTests-1749138146 None] Acquiring lock "cinder-quobyte-f7c9e24c-71e4-4d13-989a-482ce7b20b39" by "_delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:52:25 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-049b1a32-6ab2-4b60-bbc7-1d18bcc1b178 tempest-SnapshotDependencyTests-1749138146 None] Lock "cinder-quobyte-f7c9e24c-71e4-4d13-989a-482ce7b20b39" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:52:25 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-049b1a32-6ab2-4b60-bbc7-1d18bcc1b178 tempest-SnapshotDependencyTests-1749138146 None] Deleting offline snapshot f7c9e24c-71e4-4d13-989a-482ce7b20b39 of volume 69b96242-74f5-4401-9ebc-09d94bfb91c6 {{(pid=86310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 14:52:25 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-049b1a32-6ab2-4b60-bbc7-1d18bcc1b178 tempest-SnapshotDependencyTests-1749138146 None] snapshot_file for this snap is: volume-69b96242-74f5-4401-9ebc-09d94bfb91c6.f7c9e24c-71e4-4d13-989a-482ce7b20b39 {{(pid=86310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 14:52:25 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[90c4d674-7762-46d9-bbb9-028b0a542eb2]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:52:25 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-049b1a32-6ab2-4b60-bbc7-1d18bcc1b178 tempest-SnapshotDependencyTests-1749138146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-69b96242-74f5-4401-9ebc-09d94bfb91c6.f7c9e24c-71e4-4d13-989a-482ce7b20b39 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:25 devstack sudo[104940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-69b96242-74f5-4401-9ebc-09d94bfb91c6.f7c9e24c-71e4-4d13-989a-482ce7b20b39 Sep 23 14:52:25 devstack sudo[104940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:25 devstack sudo[104935]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:25 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d08828a9-f31f-43d0-b5e9-a503be127beb tempest-ProjectMemberTests-700601358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8833acae-70c2-4c7c-8475-8c6a94273f73 1073741824" returned: 0 in 0.474s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:25 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d08828a9-f31f-43d0-b5e9-a503be127beb tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8833acae-70c2-4c7c-8475-8c6a94273f73 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:25 devstack sudo[104943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8833acae-70c2-4c7c-8475-8c6a94273f73 Sep 23 14:52:25 devstack sudo[104943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:25 devstack sudo[104940]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:25 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-049b1a32-6ab2-4b60-bbc7-1d18bcc1b178 tempest-SnapshotDependencyTests-1749138146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-69b96242-74f5-4401-9ebc-09d94bfb91c6.f7c9e24c-71e4-4d13-989a-482ce7b20b39" returned: 0 in 0.399s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:25 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-049b1a32-6ab2-4b60-bbc7-1d18bcc1b178 tempest-SnapshotDependencyTests-1749138146 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69b96242-74f5-4401-9ebc-09d94bfb91c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 14:52:25 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6abb02c-bab7-40f1-96da-9b56b66717d0]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:52:25 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-049b1a32-6ab2-4b60-bbc7-1d18bcc1b178 tempest-SnapshotDependencyTests-1749138146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-69b96242-74f5-4401-9ebc-09d94bfb91c6 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:25 devstack sudo[104943]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:25 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d08828a9-f31f-43d0-b5e9-a503be127beb tempest-ProjectMemberTests-700601358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8833acae-70c2-4c7c-8475-8c6a94273f73" returned: 0 in 0.255s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:25 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-d08828a9-f31f-43d0-b5e9-a503be127beb tempest-ProjectMemberTests-700601358 None] <== create_volume: return (777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:52:25 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-d08828a9-f31f-43d0-b5e9-a503be127beb tempest-ProjectMemberTests-700601358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.781s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:52:25 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-d08828a9-f31f-43d0-b5e9-a503be127beb tempest-ProjectMemberTests-700601358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1030974-c423-43a5-a297-f1bce5f5f398) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8833acae-70c2-4c7c-8475-8c6a94273f73', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:52:25 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-d08828a9-f31f-43d0-b5e9-a503be127beb tempest-ProjectMemberTests-700601358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ed7b875-3a81-45d2-a738-4b964e87b826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:52:25 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-d08828a9-f31f-43d0-b5e9-a503be127beb tempest-ProjectMemberTests-700601358 None] Volume volume-8833acae-70c2-4c7c-8475-8c6a94273f73 (8833acae-70c2-4c7c-8475-8c6a94273f73): created successfully Sep 23 14:52:25 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-d08828a9-f31f-43d0-b5e9-a503be127beb tempest-ProjectMemberTests-700601358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ed7b875-3a81-45d2-a738-4b964e87b826) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:52:25 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-d08828a9-f31f-43d0-b5e9-a503be127beb tempest-ProjectMemberTests-700601358 None] Flow 'volume_create_manager' (d3ea0ed5-0ff2-4d8c-a7eb-76aaa139cf01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:52:25 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-d08828a9-f31f-43d0-b5e9-a503be127beb tempest-ProjectMemberTests-700601358 None] Created volume successfully. Sep 23 14:52:25 devstack sudo[104949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-69b96242-74f5-4401-9ebc-09d94bfb91c6 Sep 23 14:52:25 devstack sudo[104949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:26 devstack sudo[104949]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:26 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-049b1a32-6ab2-4b60-bbc7-1d18bcc1b178 tempest-SnapshotDependencyTests-1749138146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-69b96242-74f5-4401-9ebc-09d94bfb91c6" returned: 0 in 0.524s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:26 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-049b1a32-6ab2-4b60-bbc7-1d18bcc1b178 tempest-SnapshotDependencyTests-1749138146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-69b96242-74f5-4401-9ebc-09d94bfb91c6.f7c9e24c-71e4-4d13-989a-482ce7b20b39 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:26 devstack sudo[104954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-69b96242-74f5-4401-9ebc-09d94bfb91c6.f7c9e24c-71e4-4d13-989a-482ce7b20b39 Sep 23 14:52:26 devstack sudo[104954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:26 devstack sudo[104954]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:26 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-049b1a32-6ab2-4b60-bbc7-1d18bcc1b178 tempest-SnapshotDependencyTests-1749138146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-69b96242-74f5-4401-9ebc-09d94bfb91c6.f7c9e24c-71e4-4d13-989a-482ce7b20b39" returned: 0 in 0.321s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:26 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-049b1a32-6ab2-4b60-bbc7-1d18bcc1b178 tempest-SnapshotDependencyTests-1749138146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-69b96242-74f5-4401-9ebc-09d94bfb91c6.f7c9e24c-71e4-4d13-989a-482ce7b20b39 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:26 devstack sudo[104959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-69b96242-74f5-4401-9ebc-09d94bfb91c6.f7c9e24c-71e4-4d13-989a-482ce7b20b39 Sep 23 14:52:26 devstack sudo[104959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:26 devstack sudo[104959]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:26 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-049b1a32-6ab2-4b60-bbc7-1d18bcc1b178 tempest-SnapshotDependencyTests-1749138146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-69b96242-74f5-4401-9ebc-09d94bfb91c6.f7c9e24c-71e4-4d13-989a-482ce7b20b39" returned: 0 in 0.269s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:26 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-049b1a32-6ab2-4b60-bbc7-1d18bcc1b178 tempest-SnapshotDependencyTests-1749138146 None] Lock "cinder-quobyte-f7c9e24c-71e4-4d13-989a-482ce7b20b39" released by "_delete_snapshot" :: held 1.625s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:52:26 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-049b1a32-6ab2-4b60-bbc7-1d18bcc1b178 tempest-SnapshotDependencyTests-1749138146 None] Lock "cinder-quobyte-69b96242-74f5-4401-9ebc-09d94bfb91c6" released by "delete_snapshot" :: held 1.652s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:52:27 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-049b1a32-6ab2-4b60-bbc7-1d18bcc1b178 tempest-SnapshotDependencyTests-1749138146 None] Created reservations ['32b86285-0297-47ba-8e8c-49681ba0c447', '279d60a5-04cf-4e11-9cae-bf144881d53b', 'f560a023-2987-4669-81d8-6b287309aa7e', '54875ead-d510-4829-ab2f-a41a7c8c42a1'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:52:27 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-3ce9afc3-32bd-4fd6-9586-cadc7f4ab8d9 tempest-ProjectMemberTests-700601358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:52:27 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-3ce9afc3-32bd-4fd6-9586-cadc7f4ab8d9 tempest-ProjectMemberTests-700601358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:52:27 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-3ce9afc3-32bd-4fd6-9586-cadc7f4ab8d9 tempest-ProjectMemberTests-700601358 None] Creating offline snapshot 0bcaef3b-00fd-48d4-a12a-cee98aa0bea8 of volume 8833acae-70c2-4c7c-8475-8c6a94273f73 {{(pid=86310) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 14:52:27 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dd7a1d8-d55b-473b-9fb7-f6bf626dcd35]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:52:27 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-3ce9afc3-32bd-4fd6-9586-cadc7f4ab8d9 tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8833acae-70c2-4c7c-8475-8c6a94273f73 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:27 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-049b1a32-6ab2-4b60-bbc7-1d18bcc1b178 tempest-SnapshotDependencyTests-1749138146 None] Delete snapshot completed successfully. Sep 23 14:52:27 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-049b1a32-6ab2-4b60-bbc7-1d18bcc1b178 tempest-SnapshotDependencyTests-1749138146 None] Lock "cinder-f7c9e24c-71e4-4d13-989a-482ce7b20b39-delete_snapshot" released by "delete_snapshot" :: held 1.860s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:52:27 devstack sudo[104962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8833acae-70c2-4c7c-8475-8c6a94273f73 Sep 23 14:52:27 devstack sudo[104962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:27 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-5468556c-9fd1-49a2-9209-0fc3d47e3f38 tempest-SnapshotDependencyTests-1749138146 None] Acquiring lock "cinder-69b96242-74f5-4401-9ebc-09d94bfb91c6-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:52:27 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-5468556c-9fd1-49a2-9209-0fc3d47e3f38 tempest-SnapshotDependencyTests-1749138146 None] Lock "cinder-69b96242-74f5-4401-9ebc-09d94bfb91c6-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:52:27 devstack sudo[104962]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:27 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-5468556c-9fd1-49a2-9209-0fc3d47e3f38 tempest-SnapshotDependencyTests-1749138146 None] Acquiring lock "cinder-quobyte-69b96242-74f5-4401-9ebc-09d94bfb91c6" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:52:27 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-3ce9afc3-32bd-4fd6-9586-cadc7f4ab8d9 tempest-ProjectMemberTests-700601358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8833acae-70c2-4c7c-8475-8c6a94273f73" returned: 0 in 0.403s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:27 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-3ce9afc3-32bd-4fd6-9586-cadc7f4ab8d9 tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8833acae-70c2-4c7c-8475-8c6a94273f73,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8833acae-70c2-4c7c-8475-8c6a94273f73.0bcaef3b-00fd-48d4-a12a-cee98aa0bea8 1G {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:27 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-5468556c-9fd1-49a2-9209-0fc3d47e3f38 tempest-SnapshotDependencyTests-1749138146 None] Lock "cinder-quobyte-69b96242-74f5-4401-9ebc-09d94bfb91c6" acquired by "delete_volume" :: waited 0.026s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:52:27 devstack sudo[104967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8833acae-70c2-4c7c-8475-8c6a94273f73,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8833acae-70c2-4c7c-8475-8c6a94273f73.0bcaef3b-00fd-48d4-a12a-cee98aa0bea8 1G Sep 23 14:52:27 devstack sudo[104967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:27 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c6eac45-e150-4158-b65c-deb985c44218]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:52:27 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-5468556c-9fd1-49a2-9209-0fc3d47e3f38 tempest-SnapshotDependencyTests-1749138146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-69b96242-74f5-4401-9ebc-09d94bfb91c6 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:27 devstack sudo[104969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-69b96242-74f5-4401-9ebc-09d94bfb91c6 Sep 23 14:52:27 devstack sudo[104969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:27 devstack sudo[104967]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:27 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-3ce9afc3-32bd-4fd6-9586-cadc7f4ab8d9 tempest-ProjectMemberTests-700601358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8833acae-70c2-4c7c-8475-8c6a94273f73,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8833acae-70c2-4c7c-8475-8c6a94273f73.0bcaef3b-00fd-48d4-a12a-cee98aa0bea8 1G" returned: 0 in 0.402s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:27 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-3ce9afc3-32bd-4fd6-9586-cadc7f4ab8d9 tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8833acae-70c2-4c7c-8475-8c6a94273f73 -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8833acae-70c2-4c7c-8475-8c6a94273f73.0bcaef3b-00fd-48d4-a12a-cee98aa0bea8 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:27 devstack sudo[104978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8833acae-70c2-4c7c-8475-8c6a94273f73 -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8833acae-70c2-4c7c-8475-8c6a94273f73.0bcaef3b-00fd-48d4-a12a-cee98aa0bea8 Sep 23 14:52:27 devstack sudo[104978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:27 devstack sudo[104969]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:27 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-5468556c-9fd1-49a2-9209-0fc3d47e3f38 tempest-SnapshotDependencyTests-1749138146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-69b96242-74f5-4401-9ebc-09d94bfb91c6" returned: 0 in 0.372s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:27 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-5468556c-9fd1-49a2-9209-0fc3d47e3f38 tempest-SnapshotDependencyTests-1749138146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-69b96242-74f5-4401-9ebc-09d94bfb91c6 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:27 devstack sudo[104980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-69b96242-74f5-4401-9ebc-09d94bfb91c6 Sep 23 14:52:27 devstack sudo[104980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:28 devstack sudo[104978]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:28 devstack sudo[104980]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:28 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-3ce9afc3-32bd-4fd6-9586-cadc7f4ab8d9 tempest-ProjectMemberTests-700601358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8833acae-70c2-4c7c-8475-8c6a94273f73 -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8833acae-70c2-4c7c-8475-8c6a94273f73.0bcaef3b-00fd-48d4-a12a-cee98aa0bea8" returned: 0 in 0.304s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:28 devstack cinder-volume[86310]: WARNING cinder.volume.drivers.remotefs [None req-3ce9afc3-32bd-4fd6-9586-cadc7f4ab8d9 tempest-ProjectMemberTests-700601358 None] /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8833acae-70c2-4c7c-8475-8c6a94273f73.0bcaef3b-00fd-48d4-a12a-cee98aa0bea8 is being set with open permissions: ugo+rw Sep 23 14:52:28 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-3ce9afc3-32bd-4fd6-9586-cadc7f4ab8d9 tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8833acae-70c2-4c7c-8475-8c6a94273f73.0bcaef3b-00fd-48d4-a12a-cee98aa0bea8 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:28 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-5468556c-9fd1-49a2-9209-0fc3d47e3f38 tempest-SnapshotDependencyTests-1749138146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-69b96242-74f5-4401-9ebc-09d94bfb91c6" returned: 0 in 0.278s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:28 devstack sudo[104986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8833acae-70c2-4c7c-8475-8c6a94273f73.0bcaef3b-00fd-48d4-a12a-cee98aa0bea8 Sep 23 14:52:28 devstack sudo[104986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:28 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-5468556c-9fd1-49a2-9209-0fc3d47e3f38 tempest-SnapshotDependencyTests-1749138146 None] Lock "cinder-quobyte-69b96242-74f5-4401-9ebc-09d94bfb91c6" released by "delete_volume" :: held 0.724s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:52:28 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-5468556c-9fd1-49a2-9209-0fc3d47e3f38 tempest-SnapshotDependencyTests-1749138146 None] Created reservations ['04f73123-a4a6-4d9b-bf2a-0d0b1fc3969d', '6821a9b9-7306-46ca-bb13-86ff37edf0a2', '2a9ebada-5d1d-4577-b3b5-e6d325526209', 'c83d135f-c477-4014-ab89-f982e7b99c98'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:52:28 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-5468556c-9fd1-49a2-9209-0fc3d47e3f38 tempest-SnapshotDependencyTests-1749138146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:52:28 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-5468556c-9fd1-49a2-9209-0fc3d47e3f38 tempest-SnapshotDependencyTests-1749138146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:52:28 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-5468556c-9fd1-49a2-9209-0fc3d47e3f38 tempest-SnapshotDependencyTests-1749138146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:52:28 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-5468556c-9fd1-49a2-9209-0fc3d47e3f38 tempest-SnapshotDependencyTests-1749138146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:52:28 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-5468556c-9fd1-49a2-9209-0fc3d47e3f38 tempest-SnapshotDependencyTests-1749138146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:52:28 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-5468556c-9fd1-49a2-9209-0fc3d47e3f38 tempest-SnapshotDependencyTests-1749138146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:28 devstack sudo[104988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:52:28 devstack sudo[104988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:28 devstack sudo[104986]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:28 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-3ce9afc3-32bd-4fd6-9586-cadc7f4ab8d9 tempest-ProjectMemberTests-700601358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8833acae-70c2-4c7c-8475-8c6a94273f73.0bcaef3b-00fd-48d4-a12a-cee98aa0bea8" returned: 0 in 0.251s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:28 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-3ce9afc3-32bd-4fd6-9586-cadc7f4ab8d9 tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8833acae-70c2-4c7c-8475-8c6a94273f73.info {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:28 devstack sudo[104991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8833acae-70c2-4c7c-8475-8c6a94273f73.info Sep 23 14:52:28 devstack sudo[104991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:28 devstack sudo[104988]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:28 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-107d80d9-4fee-4ba0-8aab-a6053b6ea405 tempest-SnapshotDependencyTests-1749138146 None] Acquiring lock "cinder-64d116a9-5a4a-4a82-98a4-3aba2f683a9f-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:52:28 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-5468556c-9fd1-49a2-9209-0fc3d47e3f38 tempest-SnapshotDependencyTests-1749138146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.281s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:28 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-5468556c-9fd1-49a2-9209-0fc3d47e3f38 tempest-SnapshotDependencyTests-1749138146 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:52:28 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-107d80d9-4fee-4ba0-8aab-a6053b6ea405 tempest-SnapshotDependencyTests-1749138146 None] Lock "cinder-64d116a9-5a4a-4a82-98a4-3aba2f683a9f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:52:28 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-5468556c-9fd1-49a2-9209-0fc3d47e3f38 tempest-SnapshotDependencyTests-1749138146 None] Deleted volume successfully. Sep 23 14:52:28 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-5468556c-9fd1-49a2-9209-0fc3d47e3f38 tempest-SnapshotDependencyTests-1749138146 None] Lock "cinder-69b96242-74f5-4401-9ebc-09d94bfb91c6-delete_volume" released by "delete_volume" :: held 1.244s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:52:28 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-107d80d9-4fee-4ba0-8aab-a6053b6ea405 tempest-SnapshotDependencyTests-1749138146 None] Acquiring lock "cinder-quobyte-64d116a9-5a4a-4a82-98a4-3aba2f683a9f" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:52:28 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-107d80d9-4fee-4ba0-8aab-a6053b6ea405 tempest-SnapshotDependencyTests-1749138146 None] Lock "cinder-quobyte-64d116a9-5a4a-4a82-98a4-3aba2f683a9f" acquired by "delete_volume" :: waited 0.015s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:52:28 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[78ff07b4-28cb-4872-b06e-a539fb6344d6]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:52:28 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-107d80d9-4fee-4ba0-8aab-a6053b6ea405 tempest-SnapshotDependencyTests-1749138146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-64d116a9-5a4a-4a82-98a4-3aba2f683a9f {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:28 devstack sudo[104991]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:28 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-3ce9afc3-32bd-4fd6-9586-cadc7f4ab8d9 tempest-ProjectMemberTests-700601358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8833acae-70c2-4c7c-8475-8c6a94273f73.info" returned: 0 in 0.281s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:28 devstack cinder-volume[86310]: WARNING cinder.volume.drivers.remotefs [None req-3ce9afc3-32bd-4fd6-9586-cadc7f4ab8d9 tempest-ProjectMemberTests-700601358 None] /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8833acae-70c2-4c7c-8475-8c6a94273f73.info is being set with open permissions: ugo+rw Sep 23 14:52:28 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-3ce9afc3-32bd-4fd6-9586-cadc7f4ab8d9 tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8833acae-70c2-4c7c-8475-8c6a94273f73.info {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:28 devstack sudo[104996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8833acae-70c2-4c7c-8475-8c6a94273f73.info Sep 23 14:52:28 devstack sudo[104996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:28 devstack sudo[104995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-64d116a9-5a4a-4a82-98a4-3aba2f683a9f Sep 23 14:52:28 devstack sudo[104995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:29 devstack sudo[104996]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:29 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-3ce9afc3-32bd-4fd6-9586-cadc7f4ab8d9 tempest-ProjectMemberTests-700601358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8833acae-70c2-4c7c-8475-8c6a94273f73.info" returned: 0 in 0.269s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:29 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-3ce9afc3-32bd-4fd6-9586-cadc7f4ab8d9 tempest-ProjectMemberTests-700601358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.005s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:52:29 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-3ce9afc3-32bd-4fd6-9586-cadc7f4ab8d9 tempest-ProjectMemberTests-700601358 None] Create snapshot completed successfully Sep 23 14:52:29 devstack sudo[104995]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:29 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-107d80d9-4fee-4ba0-8aab-a6053b6ea405 tempest-SnapshotDependencyTests-1749138146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-64d116a9-5a4a-4a82-98a4-3aba2f683a9f" returned: 0 in 0.395s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:29 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-107d80d9-4fee-4ba0-8aab-a6053b6ea405 tempest-SnapshotDependencyTests-1749138146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-64d116a9-5a4a-4a82-98a4-3aba2f683a9f {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:29 devstack sudo[105037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-64d116a9-5a4a-4a82-98a4-3aba2f683a9f Sep 23 14:52:29 devstack sudo[105037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:29 devstack sudo[105037]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:29 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-107d80d9-4fee-4ba0-8aab-a6053b6ea405 tempest-SnapshotDependencyTests-1749138146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-64d116a9-5a4a-4a82-98a4-3aba2f683a9f" returned: 0 in 0.247s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:29 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-107d80d9-4fee-4ba0-8aab-a6053b6ea405 tempest-SnapshotDependencyTests-1749138146 None] Lock "cinder-quobyte-64d116a9-5a4a-4a82-98a4-3aba2f683a9f" released by "delete_volume" :: held 0.684s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:52:29 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-107d80d9-4fee-4ba0-8aab-a6053b6ea405 tempest-SnapshotDependencyTests-1749138146 None] Created reservations ['b839dd29-5ff4-4d1f-9787-602addffd860', '6f876185-9c4d-499d-b3bb-19ef7eced18d', 'ddb049a2-0537-4bb7-9434-f76748094346', '91794684-6aa2-40b7-bf15-10320a1666cb'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:52:29 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-107d80d9-4fee-4ba0-8aab-a6053b6ea405 tempest-SnapshotDependencyTests-1749138146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:52:29 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-107d80d9-4fee-4ba0-8aab-a6053b6ea405 tempest-SnapshotDependencyTests-1749138146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:52:29 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-107d80d9-4fee-4ba0-8aab-a6053b6ea405 tempest-SnapshotDependencyTests-1749138146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:52:29 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-107d80d9-4fee-4ba0-8aab-a6053b6ea405 tempest-SnapshotDependencyTests-1749138146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:52:29 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-107d80d9-4fee-4ba0-8aab-a6053b6ea405 tempest-SnapshotDependencyTests-1749138146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:52:29 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-107d80d9-4fee-4ba0-8aab-a6053b6ea405 tempest-SnapshotDependencyTests-1749138146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:29 devstack sudo[105042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:52:29 devstack sudo[105042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:29 devstack sudo[105042]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:29 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-107d80d9-4fee-4ba0-8aab-a6053b6ea405 tempest-SnapshotDependencyTests-1749138146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.246s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:29 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-107d80d9-4fee-4ba0-8aab-a6053b6ea405 tempest-SnapshotDependencyTests-1749138146 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:52:29 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-107d80d9-4fee-4ba0-8aab-a6053b6ea405 tempest-SnapshotDependencyTests-1749138146 None] Deleted volume successfully. Sep 23 14:52:29 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-107d80d9-4fee-4ba0-8aab-a6053b6ea405 tempest-SnapshotDependencyTests-1749138146 None] Lock "cinder-64d116a9-5a4a-4a82-98a4-3aba2f683a9f-delete_volume" released by "delete_volume" :: held 1.128s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:52:30 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-fc02af46-c8ba-4330-9026-c13238c8abc2 tempest-ProjectMemberTests-700601358 None] Acquiring lock "cinder-0bcaef3b-00fd-48d4-a12a-cee98aa0bea8-delete_snapshot" by "delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:52:30 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-fc02af46-c8ba-4330-9026-c13238c8abc2 tempest-ProjectMemberTests-700601358 None] Lock "cinder-0bcaef3b-00fd-48d4-a12a-cee98aa0bea8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:52:30 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-fc02af46-c8ba-4330-9026-c13238c8abc2 tempest-ProjectMemberTests-700601358 None] Acquiring lock "cinder-quobyte-8833acae-70c2-4c7c-8475-8c6a94273f73" by "delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:52:30 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-fc02af46-c8ba-4330-9026-c13238c8abc2 tempest-ProjectMemberTests-700601358 None] Lock "cinder-quobyte-8833acae-70c2-4c7c-8475-8c6a94273f73" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:52:30 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-fc02af46-c8ba-4330-9026-c13238c8abc2 tempest-ProjectMemberTests-700601358 None] Acquiring lock "cinder-quobyte-0bcaef3b-00fd-48d4-a12a-cee98aa0bea8" by "_delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:52:30 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-fc02af46-c8ba-4330-9026-c13238c8abc2 tempest-ProjectMemberTests-700601358 None] Lock "cinder-quobyte-0bcaef3b-00fd-48d4-a12a-cee98aa0bea8" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:52:30 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-fc02af46-c8ba-4330-9026-c13238c8abc2 tempest-ProjectMemberTests-700601358 None] Deleting offline snapshot 0bcaef3b-00fd-48d4-a12a-cee98aa0bea8 of volume 8833acae-70c2-4c7c-8475-8c6a94273f73 {{(pid=86310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 14:52:30 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-fc02af46-c8ba-4330-9026-c13238c8abc2 tempest-ProjectMemberTests-700601358 None] snapshot_file for this snap is: volume-8833acae-70c2-4c7c-8475-8c6a94273f73.0bcaef3b-00fd-48d4-a12a-cee98aa0bea8 {{(pid=86310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 14:52:30 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f28a566-e69e-4ecc-96d4-631719ecdf92]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:52:30 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-fc02af46-c8ba-4330-9026-c13238c8abc2 tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8833acae-70c2-4c7c-8475-8c6a94273f73.0bcaef3b-00fd-48d4-a12a-cee98aa0bea8 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:30 devstack sudo[105046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8833acae-70c2-4c7c-8475-8c6a94273f73.0bcaef3b-00fd-48d4-a12a-cee98aa0bea8 Sep 23 14:52:30 devstack sudo[105046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:30 devstack sudo[105046]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:30 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-fc02af46-c8ba-4330-9026-c13238c8abc2 tempest-ProjectMemberTests-700601358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8833acae-70c2-4c7c-8475-8c6a94273f73.0bcaef3b-00fd-48d4-a12a-cee98aa0bea8" returned: 0 in 0.412s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:30 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-fc02af46-c8ba-4330-9026-c13238c8abc2 tempest-ProjectMemberTests-700601358 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8833acae-70c2-4c7c-8475-8c6a94273f73(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 14:52:30 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9769d93-50d0-4b0a-99de-07d421ff2175]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:52:30 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-fc02af46-c8ba-4330-9026-c13238c8abc2 tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8833acae-70c2-4c7c-8475-8c6a94273f73 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:30 devstack sudo[105051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8833acae-70c2-4c7c-8475-8c6a94273f73 Sep 23 14:52:30 devstack sudo[105051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:31 devstack sudo[105051]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:31 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-fc02af46-c8ba-4330-9026-c13238c8abc2 tempest-ProjectMemberTests-700601358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8833acae-70c2-4c7c-8475-8c6a94273f73" returned: 0 in 0.373s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:31 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-fc02af46-c8ba-4330-9026-c13238c8abc2 tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8833acae-70c2-4c7c-8475-8c6a94273f73.0bcaef3b-00fd-48d4-a12a-cee98aa0bea8 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:31 devstack sudo[105057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8833acae-70c2-4c7c-8475-8c6a94273f73.0bcaef3b-00fd-48d4-a12a-cee98aa0bea8 Sep 23 14:52:31 devstack sudo[105057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:31 devstack sudo[105057]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:31 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-fc02af46-c8ba-4330-9026-c13238c8abc2 tempest-ProjectMemberTests-700601358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8833acae-70c2-4c7c-8475-8c6a94273f73.0bcaef3b-00fd-48d4-a12a-cee98aa0bea8" returned: 0 in 0.367s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:31 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-fc02af46-c8ba-4330-9026-c13238c8abc2 tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8833acae-70c2-4c7c-8475-8c6a94273f73.0bcaef3b-00fd-48d4-a12a-cee98aa0bea8 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:31 devstack sudo[105063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8833acae-70c2-4c7c-8475-8c6a94273f73.0bcaef3b-00fd-48d4-a12a-cee98aa0bea8 Sep 23 14:52:31 devstack sudo[105063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:31 devstack sudo[105063]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:31 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-fc02af46-c8ba-4330-9026-c13238c8abc2 tempest-ProjectMemberTests-700601358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8833acae-70c2-4c7c-8475-8c6a94273f73.0bcaef3b-00fd-48d4-a12a-cee98aa0bea8" returned: 0 in 0.259s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:31 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-fc02af46-c8ba-4330-9026-c13238c8abc2 tempest-ProjectMemberTests-700601358 None] Lock "cinder-quobyte-0bcaef3b-00fd-48d4-a12a-cee98aa0bea8" released by "_delete_snapshot" :: held 1.529s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:52:31 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-fc02af46-c8ba-4330-9026-c13238c8abc2 tempest-ProjectMemberTests-700601358 None] Lock "cinder-quobyte-8833acae-70c2-4c7c-8475-8c6a94273f73" released by "delete_snapshot" :: held 1.558s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:52:31 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-fc02af46-c8ba-4330-9026-c13238c8abc2 tempest-ProjectMemberTests-700601358 None] Created reservations ['07b909bb-6748-4060-9525-b2822b908a4d', '824df54c-5b3d-4a77-b35c-6e2a9263678c', 'd178301f-f88d-4d99-b116-9af58ed6486c', '6b357325-1d53-4862-89dc-f5eab9c64453'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:52:31 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-fc02af46-c8ba-4330-9026-c13238c8abc2 tempest-ProjectMemberTests-700601358 None] Delete snapshot completed successfully. Sep 23 14:52:31 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-fc02af46-c8ba-4330-9026-c13238c8abc2 tempest-ProjectMemberTests-700601358 None] Lock "cinder-0bcaef3b-00fd-48d4-a12a-cee98aa0bea8-delete_snapshot" released by "delete_snapshot" :: held 1.726s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:52:32 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-f68cfbb7-6734-4f52-bd7e-99ad307993a7 tempest-ProjectMemberTests-700601358 None] Acquiring lock "cinder-8833acae-70c2-4c7c-8475-8c6a94273f73-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:52:32 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-f68cfbb7-6734-4f52-bd7e-99ad307993a7 tempest-ProjectMemberTests-700601358 None] Lock "cinder-8833acae-70c2-4c7c-8475-8c6a94273f73-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:52:32 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-f68cfbb7-6734-4f52-bd7e-99ad307993a7 tempest-ProjectMemberTests-700601358 None] Acquiring lock "cinder-quobyte-8833acae-70c2-4c7c-8475-8c6a94273f73" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:52:32 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-f68cfbb7-6734-4f52-bd7e-99ad307993a7 tempest-ProjectMemberTests-700601358 None] Lock "cinder-quobyte-8833acae-70c2-4c7c-8475-8c6a94273f73" acquired by "delete_volume" :: waited 0.016s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:52:32 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[16e20bbc-76a3-41e2-af81-c400dc01ccbd]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:52:32 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-f68cfbb7-6734-4f52-bd7e-99ad307993a7 tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8833acae-70c2-4c7c-8475-8c6a94273f73 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:32 devstack sudo[105066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8833acae-70c2-4c7c-8475-8c6a94273f73 Sep 23 14:52:32 devstack sudo[105066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:32 devstack sudo[105066]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:32 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-f68cfbb7-6734-4f52-bd7e-99ad307993a7 tempest-ProjectMemberTests-700601358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8833acae-70c2-4c7c-8475-8c6a94273f73" returned: 0 in 0.355s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:32 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-f68cfbb7-6734-4f52-bd7e-99ad307993a7 tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8833acae-70c2-4c7c-8475-8c6a94273f73 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:32 devstack sudo[105072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8833acae-70c2-4c7c-8475-8c6a94273f73 Sep 23 14:52:32 devstack sudo[105072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:33 devstack sudo[105072]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:33 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-f68cfbb7-6734-4f52-bd7e-99ad307993a7 tempest-ProjectMemberTests-700601358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-8833acae-70c2-4c7c-8475-8c6a94273f73" returned: 0 in 0.251s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:33 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-f68cfbb7-6734-4f52-bd7e-99ad307993a7 tempest-ProjectMemberTests-700601358 None] Lock "cinder-quobyte-8833acae-70c2-4c7c-8475-8c6a94273f73" released by "delete_volume" :: held 0.668s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:52:33 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-f68cfbb7-6734-4f52-bd7e-99ad307993a7 tempest-ProjectMemberTests-700601358 None] Created reservations ['08bbaf4c-f153-4eee-8cee-794d889f13d7', '3a5b639e-4f88-4013-b99f-6affcdae05bc', '9c6bde4e-0f75-446c-a671-bd5abdfb2e11', '42fe1c1e-2c37-452c-87e5-fbe186a4f86d'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:52:33 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-f68cfbb7-6734-4f52-bd7e-99ad307993a7 tempest-ProjectMemberTests-700601358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:52:33 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-f68cfbb7-6734-4f52-bd7e-99ad307993a7 tempest-ProjectMemberTests-700601358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:52:33 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-f68cfbb7-6734-4f52-bd7e-99ad307993a7 tempest-ProjectMemberTests-700601358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:52:33 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-f68cfbb7-6734-4f52-bd7e-99ad307993a7 tempest-ProjectMemberTests-700601358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:52:33 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-f68cfbb7-6734-4f52-bd7e-99ad307993a7 tempest-ProjectMemberTests-700601358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:52:33 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-f68cfbb7-6734-4f52-bd7e-99ad307993a7 tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:33 devstack sudo[105075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:52:33 devstack sudo[105075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:33 devstack sudo[105075]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:33 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-f68cfbb7-6734-4f52-bd7e-99ad307993a7 tempest-ProjectMemberTests-700601358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.287s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:33 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-f68cfbb7-6734-4f52-bd7e-99ad307993a7 tempest-ProjectMemberTests-700601358 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:52:33 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-f68cfbb7-6734-4f52-bd7e-99ad307993a7 tempest-ProjectMemberTests-700601358 None] Deleted volume successfully. Sep 23 14:52:33 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-f68cfbb7-6734-4f52-bd7e-99ad307993a7 tempest-ProjectMemberTests-700601358 None] Lock "cinder-8833acae-70c2-4c7c-8475-8c6a94273f73-delete_volume" released by "delete_volume" :: held 1.227s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:52:34 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-550ddab7-a00d-4796-90d0-aa1466b39d69 tempest-ProjectMemberTests-700601358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:52:34 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-550ddab7-a00d-4796-90d0-aa1466b39d69 tempest-ProjectMemberTests-700601358 None] Flow 'volume_create_manager' (920a9b96-f1dd-4857-b4f0-1d61c4228317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:52:34 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-550ddab7-a00d-4796-90d0-aa1466b39d69 tempest-ProjectMemberTests-700601358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6eb9dde-c8d5-4750-8d73-1469b9df146b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:52:34 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-550ddab7-a00d-4796-90d0-aa1466b39d69 tempest-ProjectMemberTests-700601358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6eb9dde-c8d5-4750-8d73-1469b9df146b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:52:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-555340245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55930e62-07e0-4f9b-8694-ee610be42f91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96e82c6bd57443b895414c81e35dd400',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:52:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:52:34Z,use_quota=True,user_id='ec53ea8e97044f789c6e4da593a5da06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:52:34 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-550ddab7-a00d-4796-90d0-aa1466b39d69 tempest-ProjectMemberTests-700601358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3eea393-05d7-4339-841f-22a470cd3c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:52:34 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-550ddab7-a00d-4796-90d0-aa1466b39d69 tempest-ProjectMemberTests-700601358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3eea393-05d7-4339-841f-22a470cd3c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:52:34 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-550ddab7-a00d-4796-90d0-aa1466b39d69 tempest-ProjectMemberTests-700601358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4af4c404-d1db-4d68-b5a4-304d27409042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:52:34 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-550ddab7-a00d-4796-90d0-aa1466b39d69 tempest-ProjectMemberTests-700601358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4af4c404-d1db-4d68-b5a4-304d27409042) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55930e62-07e0-4f9b-8694-ee610be42f91', 'volume_name': 'volume-55930e62-07e0-4f9b-8694-ee610be42f91', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:52:34 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-550ddab7-a00d-4796-90d0-aa1466b39d69 tempest-ProjectMemberTests-700601358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22107bc7-a8e5-4e79-8c29-5825e96b5b5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:52:34 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-550ddab7-a00d-4796-90d0-aa1466b39d69 tempest-ProjectMemberTests-700601358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22107bc7-a8e5-4e79-8c29-5825e96b5b5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:52:34 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-550ddab7-a00d-4796-90d0-aa1466b39d69 tempest-ProjectMemberTests-700601358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbc58c49-81ab-431d-bc0d-120c88f09235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:52:34 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-550ddab7-a00d-4796-90d0-aa1466b39d69 tempest-ProjectMemberTests-700601358 None] Volume 55930e62-07e0-4f9b-8694-ee610be42f91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55930e62-07e0-4f9b-8694-ee610be42f91', 'volume_size': 1} Sep 23 14:52:34 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-550ddab7-a00d-4796-90d0-aa1466b39d69 tempest-ProjectMemberTests-700601358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:52:34 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-550ddab7-a00d-4796-90d0-aa1466b39d69 tempest-ProjectMemberTests-700601358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:52:34 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-550ddab7-a00d-4796-90d0-aa1466b39d69 tempest-ProjectMemberTests-700601358 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:52:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-555340245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55930e62-07e0-4f9b-8694-ee610be42f91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96e82c6bd57443b895414c81e35dd400',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:52:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:52:34Z,use_quota=True,user_id='ec53ea8e97044f789c6e4da593a5da06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:52:34 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-550ddab7-a00d-4796-90d0-aa1466b39d69 tempest-ProjectMemberTests-700601358 None] Creating volume 55930e62-07e0-4f9b-8694-ee610be42f91 {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:52:34 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-550ddab7-a00d-4796-90d0-aa1466b39d69 tempest-ProjectMemberTests-700601358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:52:34 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-550ddab7-a00d-4796-90d0-aa1466b39d69 tempest-ProjectMemberTests-700601358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:52:34 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-550ddab7-a00d-4796-90d0-aa1466b39d69 tempest-ProjectMemberTests-700601358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:52:34 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-550ddab7-a00d-4796-90d0-aa1466b39d69 tempest-ProjectMemberTests-700601358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:52:34 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-550ddab7-a00d-4796-90d0-aa1466b39d69 tempest-ProjectMemberTests-700601358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:52:34 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-550ddab7-a00d-4796-90d0-aa1466b39d69 tempest-ProjectMemberTests-700601358 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:52:34 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-550ddab7-a00d-4796-90d0-aa1466b39d69 tempest-ProjectMemberTests-700601358 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:52:34 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-550ddab7-a00d-4796-90d0-aa1466b39d69 tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-55930e62-07e0-4f9b-8694-ee610be42f91 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:34 devstack sudo[105079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-55930e62-07e0-4f9b-8694-ee610be42f91 1073741824 Sep 23 14:52:34 devstack sudo[105079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:34 devstack sudo[105079]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:34 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-550ddab7-a00d-4796-90d0-aa1466b39d69 tempest-ProjectMemberTests-700601358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-55930e62-07e0-4f9b-8694-ee610be42f91 1073741824" returned: 0 in 0.507s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:34 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-550ddab7-a00d-4796-90d0-aa1466b39d69 tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-55930e62-07e0-4f9b-8694-ee610be42f91 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:34 devstack sudo[105091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-55930e62-07e0-4f9b-8694-ee610be42f91 Sep 23 14:52:34 devstack sudo[105091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:35 devstack sudo[105091]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:35 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-550ddab7-a00d-4796-90d0-aa1466b39d69 tempest-ProjectMemberTests-700601358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-55930e62-07e0-4f9b-8694-ee610be42f91" returned: 0 in 0.259s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:35 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-550ddab7-a00d-4796-90d0-aa1466b39d69 tempest-ProjectMemberTests-700601358 None] <== create_volume: return (812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:52:35 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-550ddab7-a00d-4796-90d0-aa1466b39d69 tempest-ProjectMemberTests-700601358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.815s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:52:35 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-550ddab7-a00d-4796-90d0-aa1466b39d69 tempest-ProjectMemberTests-700601358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbc58c49-81ab-431d-bc0d-120c88f09235) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55930e62-07e0-4f9b-8694-ee610be42f91', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:52:35 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-550ddab7-a00d-4796-90d0-aa1466b39d69 tempest-ProjectMemberTests-700601358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0308bcf-b900-44d7-92fb-96ecf4f4825b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:52:35 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-550ddab7-a00d-4796-90d0-aa1466b39d69 tempest-ProjectMemberTests-700601358 None] Volume volume-55930e62-07e0-4f9b-8694-ee610be42f91 (55930e62-07e0-4f9b-8694-ee610be42f91): created successfully Sep 23 14:52:35 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-550ddab7-a00d-4796-90d0-aa1466b39d69 tempest-ProjectMemberTests-700601358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0308bcf-b900-44d7-92fb-96ecf4f4825b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:52:35 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-550ddab7-a00d-4796-90d0-aa1466b39d69 tempest-ProjectMemberTests-700601358 None] Flow 'volume_create_manager' (920a9b96-f1dd-4857-b4f0-1d61c4228317) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:52:35 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-550ddab7-a00d-4796-90d0-aa1466b39d69 tempest-ProjectMemberTests-700601358 None] Created volume successfully. Sep 23 14:52:36 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-02de3cb2-e73d-43c4-bc2f-f8721ad5889c tempest-ProjectMemberTests-700601358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:52:36 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-02de3cb2-e73d-43c4-bc2f-f8721ad5889c tempest-ProjectMemberTests-700601358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:52:36 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-02de3cb2-e73d-43c4-bc2f-f8721ad5889c tempest-ProjectMemberTests-700601358 None] Creating offline snapshot 9b3eaea1-0c90-4750-b2d3-cc92fb4735ab of volume 55930e62-07e0-4f9b-8694-ee610be42f91 {{(pid=86310) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 14:52:36 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[f062dd76-b7d6-47f4-956b-3f31507db2c0]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:52:36 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-02de3cb2-e73d-43c4-bc2f-f8721ad5889c tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-55930e62-07e0-4f9b-8694-ee610be42f91 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:36 devstack sudo[105095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-55930e62-07e0-4f9b-8694-ee610be42f91 Sep 23 14:52:36 devstack sudo[105095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:36 devstack sudo[105095]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:36 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-02de3cb2-e73d-43c4-bc2f-f8721ad5889c tempest-ProjectMemberTests-700601358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-55930e62-07e0-4f9b-8694-ee610be42f91" returned: 0 in 0.382s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:36 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-02de3cb2-e73d-43c4-bc2f-f8721ad5889c tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-55930e62-07e0-4f9b-8694-ee610be42f91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-55930e62-07e0-4f9b-8694-ee610be42f91.9b3eaea1-0c90-4750-b2d3-cc92fb4735ab 1G {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:36 devstack sudo[105100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-55930e62-07e0-4f9b-8694-ee610be42f91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-55930e62-07e0-4f9b-8694-ee610be42f91.9b3eaea1-0c90-4750-b2d3-cc92fb4735ab 1G Sep 23 14:52:36 devstack sudo[105100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:37 devstack sudo[105100]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:37 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-02de3cb2-e73d-43c4-bc2f-f8721ad5889c tempest-ProjectMemberTests-700601358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-55930e62-07e0-4f9b-8694-ee610be42f91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-55930e62-07e0-4f9b-8694-ee610be42f91.9b3eaea1-0c90-4750-b2d3-cc92fb4735ab 1G" returned: 0 in 0.427s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:37 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-02de3cb2-e73d-43c4-bc2f-f8721ad5889c tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55930e62-07e0-4f9b-8694-ee610be42f91 -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-55930e62-07e0-4f9b-8694-ee610be42f91.9b3eaea1-0c90-4750-b2d3-cc92fb4735ab {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:37 devstack sudo[105106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55930e62-07e0-4f9b-8694-ee610be42f91 -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-55930e62-07e0-4f9b-8694-ee610be42f91.9b3eaea1-0c90-4750-b2d3-cc92fb4735ab Sep 23 14:52:37 devstack sudo[105106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:37 devstack sudo[105106]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:37 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-02de3cb2-e73d-43c4-bc2f-f8721ad5889c tempest-ProjectMemberTests-700601358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55930e62-07e0-4f9b-8694-ee610be42f91 -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-55930e62-07e0-4f9b-8694-ee610be42f91.9b3eaea1-0c90-4750-b2d3-cc92fb4735ab" returned: 0 in 0.314s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:37 devstack cinder-volume[86310]: WARNING cinder.volume.drivers.remotefs [None req-02de3cb2-e73d-43c4-bc2f-f8721ad5889c tempest-ProjectMemberTests-700601358 None] /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-55930e62-07e0-4f9b-8694-ee610be42f91.9b3eaea1-0c90-4750-b2d3-cc92fb4735ab is being set with open permissions: ugo+rw Sep 23 14:52:37 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-02de3cb2-e73d-43c4-bc2f-f8721ad5889c tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-55930e62-07e0-4f9b-8694-ee610be42f91.9b3eaea1-0c90-4750-b2d3-cc92fb4735ab {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:37 devstack sudo[105111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-55930e62-07e0-4f9b-8694-ee610be42f91.9b3eaea1-0c90-4750-b2d3-cc92fb4735ab Sep 23 14:52:37 devstack sudo[105111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:37 devstack sudo[105111]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:37 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-02de3cb2-e73d-43c4-bc2f-f8721ad5889c tempest-ProjectMemberTests-700601358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-55930e62-07e0-4f9b-8694-ee610be42f91.9b3eaea1-0c90-4750-b2d3-cc92fb4735ab" returned: 0 in 0.287s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:37 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-02de3cb2-e73d-43c4-bc2f-f8721ad5889c tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-55930e62-07e0-4f9b-8694-ee610be42f91.info {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:37 devstack sudo[105114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-55930e62-07e0-4f9b-8694-ee610be42f91.info Sep 23 14:52:37 devstack sudo[105114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:38 devstack sudo[105114]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:38 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-02de3cb2-e73d-43c4-bc2f-f8721ad5889c tempest-ProjectMemberTests-700601358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-55930e62-07e0-4f9b-8694-ee610be42f91.info" returned: 0 in 0.263s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:38 devstack cinder-volume[86310]: WARNING cinder.volume.drivers.remotefs [None req-02de3cb2-e73d-43c4-bc2f-f8721ad5889c tempest-ProjectMemberTests-700601358 None] /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-55930e62-07e0-4f9b-8694-ee610be42f91.info is being set with open permissions: ugo+rw Sep 23 14:52:38 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-02de3cb2-e73d-43c4-bc2f-f8721ad5889c tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-55930e62-07e0-4f9b-8694-ee610be42f91.info {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:38 devstack sudo[105117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-55930e62-07e0-4f9b-8694-ee610be42f91.info Sep 23 14:52:38 devstack sudo[105117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:38 devstack sudo[105117]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:38 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-02de3cb2-e73d-43c4-bc2f-f8721ad5889c tempest-ProjectMemberTests-700601358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-55930e62-07e0-4f9b-8694-ee610be42f91.info" returned: 0 in 0.284s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:38 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-02de3cb2-e73d-43c4-bc2f-f8721ad5889c tempest-ProjectMemberTests-700601358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.088s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:52:38 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-02de3cb2-e73d-43c4-bc2f-f8721ad5889c tempest-ProjectMemberTests-700601358 None] Create snapshot completed successfully Sep 23 14:52:39 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-8fbef9f9-7389-4544-8014-176cc88ef4d1 tempest-ProjectMemberTests-700601358 None] Acquiring lock "cinder-9b3eaea1-0c90-4750-b2d3-cc92fb4735ab-delete_snapshot" by "delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:52:39 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-8fbef9f9-7389-4544-8014-176cc88ef4d1 tempest-ProjectMemberTests-700601358 None] Lock "cinder-9b3eaea1-0c90-4750-b2d3-cc92fb4735ab-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:52:39 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-8fbef9f9-7389-4544-8014-176cc88ef4d1 tempest-ProjectMemberTests-700601358 None] Acquiring lock "cinder-quobyte-55930e62-07e0-4f9b-8694-ee610be42f91" by "delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:52:39 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-8fbef9f9-7389-4544-8014-176cc88ef4d1 tempest-ProjectMemberTests-700601358 None] Lock "cinder-quobyte-55930e62-07e0-4f9b-8694-ee610be42f91" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:52:39 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-8fbef9f9-7389-4544-8014-176cc88ef4d1 tempest-ProjectMemberTests-700601358 None] Acquiring lock "cinder-quobyte-9b3eaea1-0c90-4750-b2d3-cc92fb4735ab" by "_delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:52:39 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-8fbef9f9-7389-4544-8014-176cc88ef4d1 tempest-ProjectMemberTests-700601358 None] Lock "cinder-quobyte-9b3eaea1-0c90-4750-b2d3-cc92fb4735ab" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:52:39 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-8fbef9f9-7389-4544-8014-176cc88ef4d1 tempest-ProjectMemberTests-700601358 None] Deleting offline snapshot 9b3eaea1-0c90-4750-b2d3-cc92fb4735ab of volume 55930e62-07e0-4f9b-8694-ee610be42f91 {{(pid=86310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 14:52:39 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-8fbef9f9-7389-4544-8014-176cc88ef4d1 tempest-ProjectMemberTests-700601358 None] snapshot_file for this snap is: volume-55930e62-07e0-4f9b-8694-ee610be42f91.9b3eaea1-0c90-4750-b2d3-cc92fb4735ab {{(pid=86310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 14:52:39 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[89f4b932-8055-4fad-83d0-ad093fb0bb88]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:52:39 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8fbef9f9-7389-4544-8014-176cc88ef4d1 tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-55930e62-07e0-4f9b-8694-ee610be42f91.9b3eaea1-0c90-4750-b2d3-cc92fb4735ab {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:39 devstack sudo[105121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-55930e62-07e0-4f9b-8694-ee610be42f91.9b3eaea1-0c90-4750-b2d3-cc92fb4735ab Sep 23 14:52:39 devstack sudo[105121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:40 devstack sudo[105121]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:40 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8fbef9f9-7389-4544-8014-176cc88ef4d1 tempest-ProjectMemberTests-700601358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-55930e62-07e0-4f9b-8694-ee610be42f91.9b3eaea1-0c90-4750-b2d3-cc92fb4735ab" returned: 0 in 0.394s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:40 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-8fbef9f9-7389-4544-8014-176cc88ef4d1 tempest-ProjectMemberTests-700601358 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-55930e62-07e0-4f9b-8694-ee610be42f91(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 14:52:40 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[362f9394-d3ce-4415-b9b5-1a934a490864]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:52:40 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8fbef9f9-7389-4544-8014-176cc88ef4d1 tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-55930e62-07e0-4f9b-8694-ee610be42f91 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:40 devstack sudo[105126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-55930e62-07e0-4f9b-8694-ee610be42f91 Sep 23 14:52:40 devstack sudo[105126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:40 devstack sudo[105126]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:40 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8fbef9f9-7389-4544-8014-176cc88ef4d1 tempest-ProjectMemberTests-700601358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-55930e62-07e0-4f9b-8694-ee610be42f91" returned: 0 in 0.421s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:40 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8fbef9f9-7389-4544-8014-176cc88ef4d1 tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-55930e62-07e0-4f9b-8694-ee610be42f91.9b3eaea1-0c90-4750-b2d3-cc92fb4735ab {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:40 devstack sudo[105131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-55930e62-07e0-4f9b-8694-ee610be42f91.9b3eaea1-0c90-4750-b2d3-cc92fb4735ab Sep 23 14:52:40 devstack sudo[105131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:40 devstack sudo[105131]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:40 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8fbef9f9-7389-4544-8014-176cc88ef4d1 tempest-ProjectMemberTests-700601358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-55930e62-07e0-4f9b-8694-ee610be42f91.9b3eaea1-0c90-4750-b2d3-cc92fb4735ab" returned: 0 in 0.380s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:40 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8fbef9f9-7389-4544-8014-176cc88ef4d1 tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-55930e62-07e0-4f9b-8694-ee610be42f91.9b3eaea1-0c90-4750-b2d3-cc92fb4735ab {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:40 devstack sudo[105136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-55930e62-07e0-4f9b-8694-ee610be42f91.9b3eaea1-0c90-4750-b2d3-cc92fb4735ab Sep 23 14:52:40 devstack sudo[105136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:41 devstack sudo[105136]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:41 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8fbef9f9-7389-4544-8014-176cc88ef4d1 tempest-ProjectMemberTests-700601358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-55930e62-07e0-4f9b-8694-ee610be42f91.9b3eaea1-0c90-4750-b2d3-cc92fb4735ab" returned: 0 in 0.278s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:41 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-8fbef9f9-7389-4544-8014-176cc88ef4d1 tempest-ProjectMemberTests-700601358 None] Lock "cinder-quobyte-9b3eaea1-0c90-4750-b2d3-cc92fb4735ab" released by "_delete_snapshot" :: held 1.596s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:52:41 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-8fbef9f9-7389-4544-8014-176cc88ef4d1 tempest-ProjectMemberTests-700601358 None] Lock "cinder-quobyte-55930e62-07e0-4f9b-8694-ee610be42f91" released by "delete_snapshot" :: held 1.628s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:52:41 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-8fbef9f9-7389-4544-8014-176cc88ef4d1 tempest-ProjectMemberTests-700601358 None] Created reservations ['c79c8a26-5bc9-4648-9117-5592153edf1f', 'd4701859-d93a-4f61-9e1c-347d696698d6', '9b35bf2e-95a0-4d5d-adf7-d682fbe7c126', 'e7764fc3-482d-4da2-8922-b271030f1120'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:52:41 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-8fbef9f9-7389-4544-8014-176cc88ef4d1 tempest-ProjectMemberTests-700601358 None] Delete snapshot completed successfully. Sep 23 14:52:41 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-8fbef9f9-7389-4544-8014-176cc88ef4d1 tempest-ProjectMemberTests-700601358 None] Lock "cinder-9b3eaea1-0c90-4750-b2d3-cc92fb4735ab-delete_snapshot" released by "delete_snapshot" :: held 1.787s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:52:41 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-ae693a03-8a35-4e76-a899-abf0ddb6608c tempest-ProjectMemberTests-700601358 None] Acquiring lock "cinder-55930e62-07e0-4f9b-8694-ee610be42f91-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:52:41 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-ae693a03-8a35-4e76-a899-abf0ddb6608c tempest-ProjectMemberTests-700601358 None] Lock "cinder-55930e62-07e0-4f9b-8694-ee610be42f91-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:52:41 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-ae693a03-8a35-4e76-a899-abf0ddb6608c tempest-ProjectMemberTests-700601358 None] Acquiring lock "cinder-quobyte-55930e62-07e0-4f9b-8694-ee610be42f91" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:52:41 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-ae693a03-8a35-4e76-a899-abf0ddb6608c tempest-ProjectMemberTests-700601358 None] Lock "cinder-quobyte-55930e62-07e0-4f9b-8694-ee610be42f91" acquired by "delete_volume" :: waited 0.016s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:52:41 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee4735f5-c0b3-429f-aa49-6d52f5e6d80b]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:52:41 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ae693a03-8a35-4e76-a899-abf0ddb6608c tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-55930e62-07e0-4f9b-8694-ee610be42f91 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:41 devstack sudo[105140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-55930e62-07e0-4f9b-8694-ee610be42f91 Sep 23 14:52:41 devstack sudo[105140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:42 devstack sudo[105140]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:42 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ae693a03-8a35-4e76-a899-abf0ddb6608c tempest-ProjectMemberTests-700601358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-55930e62-07e0-4f9b-8694-ee610be42f91" returned: 0 in 0.374s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:42 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ae693a03-8a35-4e76-a899-abf0ddb6608c tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-55930e62-07e0-4f9b-8694-ee610be42f91 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:42 devstack sudo[105145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-55930e62-07e0-4f9b-8694-ee610be42f91 Sep 23 14:52:42 devstack sudo[105145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:42 devstack sudo[105145]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:42 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ae693a03-8a35-4e76-a899-abf0ddb6608c tempest-ProjectMemberTests-700601358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-55930e62-07e0-4f9b-8694-ee610be42f91" returned: 0 in 0.238s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:42 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-ae693a03-8a35-4e76-a899-abf0ddb6608c tempest-ProjectMemberTests-700601358 None] Lock "cinder-quobyte-55930e62-07e0-4f9b-8694-ee610be42f91" released by "delete_volume" :: held 0.685s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:52:42 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-ae693a03-8a35-4e76-a899-abf0ddb6608c tempest-ProjectMemberTests-700601358 None] Created reservations ['77c8b7b0-8af9-4f92-8b97-31491a352dd4', '3cd3763b-36f4-4e82-b4ae-2dafba12eb09', '0a6fd19e-7894-4368-8d67-f2f3e7a3f1d4', '6387bd93-ace0-4063-b0fb-2990b49d8795'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:52:42 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-ae693a03-8a35-4e76-a899-abf0ddb6608c tempest-ProjectMemberTests-700601358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:52:42 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-ae693a03-8a35-4e76-a899-abf0ddb6608c tempest-ProjectMemberTests-700601358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:52:42 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-ae693a03-8a35-4e76-a899-abf0ddb6608c tempest-ProjectMemberTests-700601358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:52:42 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-ae693a03-8a35-4e76-a899-abf0ddb6608c tempest-ProjectMemberTests-700601358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:52:42 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-ae693a03-8a35-4e76-a899-abf0ddb6608c tempest-ProjectMemberTests-700601358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:52:42 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ae693a03-8a35-4e76-a899-abf0ddb6608c tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:42 devstack sudo[105148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:52:42 devstack sudo[105148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:42 devstack sudo[105148]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:42 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ae693a03-8a35-4e76-a899-abf0ddb6608c tempest-ProjectMemberTests-700601358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.241s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:42 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-ae693a03-8a35-4e76-a899-abf0ddb6608c tempest-ProjectMemberTests-700601358 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:52:42 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-ae693a03-8a35-4e76-a899-abf0ddb6608c tempest-ProjectMemberTests-700601358 None] Deleted volume successfully. Sep 23 14:52:42 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-ae693a03-8a35-4e76-a899-abf0ddb6608c tempest-ProjectMemberTests-700601358 None] Lock "cinder-55930e62-07e0-4f9b-8694-ee610be42f91-delete_volume" released by "delete_volume" :: held 1.133s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:52:43 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ff6b781-e36b-4575-b7ef-1d186a8163fe tempest-ProjectMemberTests-700601358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:52:43 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-9ff6b781-e36b-4575-b7ef-1d186a8163fe tempest-ProjectMemberTests-700601358 None] Flow 'volume_create_manager' (3375e420-c2ac-4d70-b6ce-4ff0522fb68b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:52:43 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-9ff6b781-e36b-4575-b7ef-1d186a8163fe tempest-ProjectMemberTests-700601358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f4d4b2b-3ed5-49cc-847b-9b054411382b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:52:43 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-9ff6b781-e36b-4575-b7ef-1d186a8163fe tempest-ProjectMemberTests-700601358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f4d4b2b-3ed5-49cc-847b-9b054411382b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:52:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1547700323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b692b50a-21d5-4f16-a24a-b7777ab1fa4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96e82c6bd57443b895414c81e35dd400',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:52:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:52:43Z,use_quota=True,user_id='ec53ea8e97044f789c6e4da593a5da06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:52:43 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-9ff6b781-e36b-4575-b7ef-1d186a8163fe tempest-ProjectMemberTests-700601358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7926d1de-70e4-4d90-8c21-a7e039cca523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:52:43 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-9ff6b781-e36b-4575-b7ef-1d186a8163fe tempest-ProjectMemberTests-700601358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7926d1de-70e4-4d90-8c21-a7e039cca523) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:52:43 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-9ff6b781-e36b-4575-b7ef-1d186a8163fe tempest-ProjectMemberTests-700601358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c314a952-ea2f-401f-b416-7309fdaf62d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:52:43 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-9ff6b781-e36b-4575-b7ef-1d186a8163fe tempest-ProjectMemberTests-700601358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c314a952-ea2f-401f-b416-7309fdaf62d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b692b50a-21d5-4f16-a24a-b7777ab1fa4a', 'volume_name': 'volume-b692b50a-21d5-4f16-a24a-b7777ab1fa4a', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:52:43 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-9ff6b781-e36b-4575-b7ef-1d186a8163fe tempest-ProjectMemberTests-700601358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48a123e8-2005-4eb6-9f11-fcab0f6ff909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:52:43 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-9ff6b781-e36b-4575-b7ef-1d186a8163fe tempest-ProjectMemberTests-700601358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48a123e8-2005-4eb6-9f11-fcab0f6ff909) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:52:43 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-9ff6b781-e36b-4575-b7ef-1d186a8163fe tempest-ProjectMemberTests-700601358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b3e097c-3873-4f0e-bda6-c27c229e8f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:52:43 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-9ff6b781-e36b-4575-b7ef-1d186a8163fe tempest-ProjectMemberTests-700601358 None] Volume b692b50a-21d5-4f16-a24a-b7777ab1fa4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b692b50a-21d5-4f16-a24a-b7777ab1fa4a', 'volume_size': 1} Sep 23 14:52:43 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-9ff6b781-e36b-4575-b7ef-1d186a8163fe tempest-ProjectMemberTests-700601358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:52:43 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-9ff6b781-e36b-4575-b7ef-1d186a8163fe tempest-ProjectMemberTests-700601358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:52:43 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-9ff6b781-e36b-4575-b7ef-1d186a8163fe tempest-ProjectMemberTests-700601358 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:52:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1547700323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b692b50a-21d5-4f16-a24a-b7777ab1fa4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96e82c6bd57443b895414c81e35dd400',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:52:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:52:43Z,use_quota=True,user_id='ec53ea8e97044f789c6e4da593a5da06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:52:43 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-9ff6b781-e36b-4575-b7ef-1d186a8163fe tempest-ProjectMemberTests-700601358 None] Creating volume b692b50a-21d5-4f16-a24a-b7777ab1fa4a {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:52:43 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-9ff6b781-e36b-4575-b7ef-1d186a8163fe tempest-ProjectMemberTests-700601358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:52:43 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-9ff6b781-e36b-4575-b7ef-1d186a8163fe tempest-ProjectMemberTests-700601358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:52:43 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-9ff6b781-e36b-4575-b7ef-1d186a8163fe tempest-ProjectMemberTests-700601358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:52:43 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-9ff6b781-e36b-4575-b7ef-1d186a8163fe tempest-ProjectMemberTests-700601358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:52:43 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-9ff6b781-e36b-4575-b7ef-1d186a8163fe tempest-ProjectMemberTests-700601358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:52:43 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-9ff6b781-e36b-4575-b7ef-1d186a8163fe tempest-ProjectMemberTests-700601358 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:52:43 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-9ff6b781-e36b-4575-b7ef-1d186a8163fe tempest-ProjectMemberTests-700601358 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:52:43 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-9ff6b781-e36b-4575-b7ef-1d186a8163fe tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b692b50a-21d5-4f16-a24a-b7777ab1fa4a 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:43 devstack sudo[105152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b692b50a-21d5-4f16-a24a-b7777ab1fa4a 1073741824 Sep 23 14:52:43 devstack sudo[105152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:43 devstack sudo[105152]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:43 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-9ff6b781-e36b-4575-b7ef-1d186a8163fe tempest-ProjectMemberTests-700601358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b692b50a-21d5-4f16-a24a-b7777ab1fa4a 1073741824" returned: 0 in 0.434s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:43 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-9ff6b781-e36b-4575-b7ef-1d186a8163fe tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b692b50a-21d5-4f16-a24a-b7777ab1fa4a {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:43 devstack sudo[105157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b692b50a-21d5-4f16-a24a-b7777ab1fa4a Sep 23 14:52:43 devstack sudo[105157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:44 devstack sudo[105157]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:44 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-9ff6b781-e36b-4575-b7ef-1d186a8163fe tempest-ProjectMemberTests-700601358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b692b50a-21d5-4f16-a24a-b7777ab1fa4a" returned: 0 in 0.253s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:44 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-9ff6b781-e36b-4575-b7ef-1d186a8163fe tempest-ProjectMemberTests-700601358 None] <== create_volume: return (730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:52:44 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-9ff6b781-e36b-4575-b7ef-1d186a8163fe tempest-ProjectMemberTests-700601358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.733s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:52:44 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-9ff6b781-e36b-4575-b7ef-1d186a8163fe tempest-ProjectMemberTests-700601358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b3e097c-3873-4f0e-bda6-c27c229e8f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b692b50a-21d5-4f16-a24a-b7777ab1fa4a', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:52:44 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-9ff6b781-e36b-4575-b7ef-1d186a8163fe tempest-ProjectMemberTests-700601358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (862828f6-b101-49fa-b928-819a4f431372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:52:44 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-9ff6b781-e36b-4575-b7ef-1d186a8163fe tempest-ProjectMemberTests-700601358 None] Volume volume-b692b50a-21d5-4f16-a24a-b7777ab1fa4a (b692b50a-21d5-4f16-a24a-b7777ab1fa4a): created successfully Sep 23 14:52:44 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-9ff6b781-e36b-4575-b7ef-1d186a8163fe tempest-ProjectMemberTests-700601358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (862828f6-b101-49fa-b928-819a4f431372) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:52:44 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-9ff6b781-e36b-4575-b7ef-1d186a8163fe tempest-ProjectMemberTests-700601358 None] Flow 'volume_create_manager' (3375e420-c2ac-4d70-b6ce-4ff0522fb68b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:52:44 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-9ff6b781-e36b-4575-b7ef-1d186a8163fe tempest-ProjectMemberTests-700601358 None] Created volume successfully. Sep 23 14:52:44 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-9c16af9d-6a4e-4c68-9aa6-2fd4ba3e32fc tempest-ProjectMemberTests-700601358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:52:44 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-9c16af9d-6a4e-4c68-9aa6-2fd4ba3e32fc tempest-ProjectMemberTests-700601358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:52:44 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-9c16af9d-6a4e-4c68-9aa6-2fd4ba3e32fc tempest-ProjectMemberTests-700601358 None] Creating offline snapshot 5946ea7c-3e14-4351-94f2-1baeafd49aaa of volume b692b50a-21d5-4f16-a24a-b7777ab1fa4a {{(pid=86310) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 14:52:44 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[d86edfef-ad1e-4051-9399-b5ada73a9a3c]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:52:44 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-9c16af9d-6a4e-4c68-9aa6-2fd4ba3e32fc tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b692b50a-21d5-4f16-a24a-b7777ab1fa4a {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:44 devstack sudo[105160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b692b50a-21d5-4f16-a24a-b7777ab1fa4a Sep 23 14:52:44 devstack sudo[105160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:44 devstack sudo[105160]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:44 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-9c16af9d-6a4e-4c68-9aa6-2fd4ba3e32fc tempest-ProjectMemberTests-700601358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b692b50a-21d5-4f16-a24a-b7777ab1fa4a" returned: 0 in 0.352s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:44 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-9c16af9d-6a4e-4c68-9aa6-2fd4ba3e32fc tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b692b50a-21d5-4f16-a24a-b7777ab1fa4a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b692b50a-21d5-4f16-a24a-b7777ab1fa4a.5946ea7c-3e14-4351-94f2-1baeafd49aaa 1G {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:44 devstack sudo[105165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b692b50a-21d5-4f16-a24a-b7777ab1fa4a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b692b50a-21d5-4f16-a24a-b7777ab1fa4a.5946ea7c-3e14-4351-94f2-1baeafd49aaa 1G Sep 23 14:52:44 devstack sudo[105165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:45 devstack sudo[105165]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:45 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-9c16af9d-6a4e-4c68-9aa6-2fd4ba3e32fc tempest-ProjectMemberTests-700601358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b692b50a-21d5-4f16-a24a-b7777ab1fa4a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b692b50a-21d5-4f16-a24a-b7777ab1fa4a.5946ea7c-3e14-4351-94f2-1baeafd49aaa 1G" returned: 0 in 0.407s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:45 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-9c16af9d-6a4e-4c68-9aa6-2fd4ba3e32fc tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b692b50a-21d5-4f16-a24a-b7777ab1fa4a -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b692b50a-21d5-4f16-a24a-b7777ab1fa4a.5946ea7c-3e14-4351-94f2-1baeafd49aaa {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:45 devstack sudo[105171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b692b50a-21d5-4f16-a24a-b7777ab1fa4a -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b692b50a-21d5-4f16-a24a-b7777ab1fa4a.5946ea7c-3e14-4351-94f2-1baeafd49aaa Sep 23 14:52:45 devstack sudo[105171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:45 devstack sudo[105171]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:45 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-9c16af9d-6a4e-4c68-9aa6-2fd4ba3e32fc tempest-ProjectMemberTests-700601358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b692b50a-21d5-4f16-a24a-b7777ab1fa4a -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b692b50a-21d5-4f16-a24a-b7777ab1fa4a.5946ea7c-3e14-4351-94f2-1baeafd49aaa" returned: 0 in 0.312s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:45 devstack cinder-volume[86310]: WARNING cinder.volume.drivers.remotefs [None req-9c16af9d-6a4e-4c68-9aa6-2fd4ba3e32fc tempest-ProjectMemberTests-700601358 None] /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b692b50a-21d5-4f16-a24a-b7777ab1fa4a.5946ea7c-3e14-4351-94f2-1baeafd49aaa is being set with open permissions: ugo+rw Sep 23 14:52:45 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-9c16af9d-6a4e-4c68-9aa6-2fd4ba3e32fc tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b692b50a-21d5-4f16-a24a-b7777ab1fa4a.5946ea7c-3e14-4351-94f2-1baeafd49aaa {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:45 devstack sudo[105176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b692b50a-21d5-4f16-a24a-b7777ab1fa4a.5946ea7c-3e14-4351-94f2-1baeafd49aaa Sep 23 14:52:45 devstack sudo[105176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:45 devstack sudo[105176]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:45 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-9c16af9d-6a4e-4c68-9aa6-2fd4ba3e32fc tempest-ProjectMemberTests-700601358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b692b50a-21d5-4f16-a24a-b7777ab1fa4a.5946ea7c-3e14-4351-94f2-1baeafd49aaa" returned: 0 in 0.235s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:45 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-9c16af9d-6a4e-4c68-9aa6-2fd4ba3e32fc tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b692b50a-21d5-4f16-a24a-b7777ab1fa4a.info {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:45 devstack sudo[105179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b692b50a-21d5-4f16-a24a-b7777ab1fa4a.info Sep 23 14:52:45 devstack sudo[105179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:46 devstack sudo[105179]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:46 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-9c16af9d-6a4e-4c68-9aa6-2fd4ba3e32fc tempest-ProjectMemberTests-700601358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b692b50a-21d5-4f16-a24a-b7777ab1fa4a.info" returned: 0 in 0.256s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:46 devstack cinder-volume[86310]: WARNING cinder.volume.drivers.remotefs [None req-9c16af9d-6a4e-4c68-9aa6-2fd4ba3e32fc tempest-ProjectMemberTests-700601358 None] /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b692b50a-21d5-4f16-a24a-b7777ab1fa4a.info is being set with open permissions: ugo+rw Sep 23 14:52:46 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-9c16af9d-6a4e-4c68-9aa6-2fd4ba3e32fc tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b692b50a-21d5-4f16-a24a-b7777ab1fa4a.info {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:46 devstack sudo[105182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b692b50a-21d5-4f16-a24a-b7777ab1fa4a.info Sep 23 14:52:46 devstack sudo[105182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:46 devstack sudo[105182]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:46 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-9c16af9d-6a4e-4c68-9aa6-2fd4ba3e32fc tempest-ProjectMemberTests-700601358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b692b50a-21d5-4f16-a24a-b7777ab1fa4a.info" returned: 0 in 0.237s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:46 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-9c16af9d-6a4e-4c68-9aa6-2fd4ba3e32fc tempest-ProjectMemberTests-700601358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.882s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:52:46 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-9c16af9d-6a4e-4c68-9aa6-2fd4ba3e32fc tempest-ProjectMemberTests-700601358 None] Create snapshot completed successfully Sep 23 14:52:46 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-4b12d85d-0b6f-48dc-bbd9-2d8f8ed1cbb0 tempest-ProjectMemberTests-700601358 None] Acquiring lock "cinder-5946ea7c-3e14-4351-94f2-1baeafd49aaa-delete_snapshot" by "delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:52:46 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-4b12d85d-0b6f-48dc-bbd9-2d8f8ed1cbb0 tempest-ProjectMemberTests-700601358 None] Lock "cinder-5946ea7c-3e14-4351-94f2-1baeafd49aaa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:52:46 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-4b12d85d-0b6f-48dc-bbd9-2d8f8ed1cbb0 tempest-ProjectMemberTests-700601358 None] Acquiring lock "cinder-quobyte-b692b50a-21d5-4f16-a24a-b7777ab1fa4a" by "delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:52:46 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-4b12d85d-0b6f-48dc-bbd9-2d8f8ed1cbb0 tempest-ProjectMemberTests-700601358 None] Lock "cinder-quobyte-b692b50a-21d5-4f16-a24a-b7777ab1fa4a" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:52:46 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-4b12d85d-0b6f-48dc-bbd9-2d8f8ed1cbb0 tempest-ProjectMemberTests-700601358 None] Acquiring lock "cinder-quobyte-5946ea7c-3e14-4351-94f2-1baeafd49aaa" by "_delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:52:46 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-4b12d85d-0b6f-48dc-bbd9-2d8f8ed1cbb0 tempest-ProjectMemberTests-700601358 None] Lock "cinder-quobyte-5946ea7c-3e14-4351-94f2-1baeafd49aaa" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:52:46 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-4b12d85d-0b6f-48dc-bbd9-2d8f8ed1cbb0 tempest-ProjectMemberTests-700601358 None] Deleting offline snapshot 5946ea7c-3e14-4351-94f2-1baeafd49aaa of volume b692b50a-21d5-4f16-a24a-b7777ab1fa4a {{(pid=86310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 14:52:46 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-4b12d85d-0b6f-48dc-bbd9-2d8f8ed1cbb0 tempest-ProjectMemberTests-700601358 None] snapshot_file for this snap is: volume-b692b50a-21d5-4f16-a24a-b7777ab1fa4a.5946ea7c-3e14-4351-94f2-1baeafd49aaa {{(pid=86310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 14:52:46 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[376cb2e0-b6a6-43dc-8d2c-cba1a036ed5d]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:52:46 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-4b12d85d-0b6f-48dc-bbd9-2d8f8ed1cbb0 tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b692b50a-21d5-4f16-a24a-b7777ab1fa4a.5946ea7c-3e14-4351-94f2-1baeafd49aaa {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:46 devstack sudo[105185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b692b50a-21d5-4f16-a24a-b7777ab1fa4a.5946ea7c-3e14-4351-94f2-1baeafd49aaa Sep 23 14:52:46 devstack sudo[105185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:47 devstack sudo[105185]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:47 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-4b12d85d-0b6f-48dc-bbd9-2d8f8ed1cbb0 tempest-ProjectMemberTests-700601358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b692b50a-21d5-4f16-a24a-b7777ab1fa4a.5946ea7c-3e14-4351-94f2-1baeafd49aaa" returned: 0 in 0.345s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:47 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-4b12d85d-0b6f-48dc-bbd9-2d8f8ed1cbb0 tempest-ProjectMemberTests-700601358 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b692b50a-21d5-4f16-a24a-b7777ab1fa4a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 14:52:47 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[821d3116-1a5a-4d98-9345-0f8f774e5e8d]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:52:47 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-4b12d85d-0b6f-48dc-bbd9-2d8f8ed1cbb0 tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b692b50a-21d5-4f16-a24a-b7777ab1fa4a {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:47 devstack sudo[105191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b692b50a-21d5-4f16-a24a-b7777ab1fa4a Sep 23 14:52:47 devstack sudo[105191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:47 devstack sudo[105191]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:47 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-4b12d85d-0b6f-48dc-bbd9-2d8f8ed1cbb0 tempest-ProjectMemberTests-700601358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b692b50a-21d5-4f16-a24a-b7777ab1fa4a" returned: 0 in 0.369s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:47 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-4b12d85d-0b6f-48dc-bbd9-2d8f8ed1cbb0 tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b692b50a-21d5-4f16-a24a-b7777ab1fa4a.5946ea7c-3e14-4351-94f2-1baeafd49aaa {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:47 devstack sudo[105196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b692b50a-21d5-4f16-a24a-b7777ab1fa4a.5946ea7c-3e14-4351-94f2-1baeafd49aaa Sep 23 14:52:47 devstack sudo[105196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:47 devstack sudo[105196]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:47 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-4b12d85d-0b6f-48dc-bbd9-2d8f8ed1cbb0 tempest-ProjectMemberTests-700601358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b692b50a-21d5-4f16-a24a-b7777ab1fa4a.5946ea7c-3e14-4351-94f2-1baeafd49aaa" returned: 0 in 0.320s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:47 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-4b12d85d-0b6f-48dc-bbd9-2d8f8ed1cbb0 tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b692b50a-21d5-4f16-a24a-b7777ab1fa4a.5946ea7c-3e14-4351-94f2-1baeafd49aaa {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:47 devstack sudo[105201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b692b50a-21d5-4f16-a24a-b7777ab1fa4a.5946ea7c-3e14-4351-94f2-1baeafd49aaa Sep 23 14:52:47 devstack sudo[105201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:48 devstack sudo[105201]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:48 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-4b12d85d-0b6f-48dc-bbd9-2d8f8ed1cbb0 tempest-ProjectMemberTests-700601358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b692b50a-21d5-4f16-a24a-b7777ab1fa4a.5946ea7c-3e14-4351-94f2-1baeafd49aaa" returned: 0 in 0.253s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:48 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-4b12d85d-0b6f-48dc-bbd9-2d8f8ed1cbb0 tempest-ProjectMemberTests-700601358 None] Lock "cinder-quobyte-5946ea7c-3e14-4351-94f2-1baeafd49aaa" released by "_delete_snapshot" :: held 1.381s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:52:48 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-4b12d85d-0b6f-48dc-bbd9-2d8f8ed1cbb0 tempest-ProjectMemberTests-700601358 None] Lock "cinder-quobyte-b692b50a-21d5-4f16-a24a-b7777ab1fa4a" released by "delete_snapshot" :: held 1.404s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:52:48 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-4b12d85d-0b6f-48dc-bbd9-2d8f8ed1cbb0 tempest-ProjectMemberTests-700601358 None] Created reservations ['3d0fe611-b113-446d-b119-984bc59d14b5', 'ab0bdff8-7c14-496b-ab97-da4399703634', '48a4ca03-5c62-4840-978a-3aea6f009edd', '8061125a-db51-45ca-9678-ad2041956143'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:52:48 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-4b12d85d-0b6f-48dc-bbd9-2d8f8ed1cbb0 tempest-ProjectMemberTests-700601358 None] Delete snapshot completed successfully. Sep 23 14:52:48 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-4b12d85d-0b6f-48dc-bbd9-2d8f8ed1cbb0 tempest-ProjectMemberTests-700601358 None] Lock "cinder-5946ea7c-3e14-4351-94f2-1baeafd49aaa-delete_snapshot" released by "delete_snapshot" :: held 1.546s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:52:48 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-7dfc0c10-080a-4860-9f7b-e620d0b70bde tempest-ProjectMemberTests-700601358 None] Acquiring lock "cinder-b692b50a-21d5-4f16-a24a-b7777ab1fa4a-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:52:48 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-7dfc0c10-080a-4860-9f7b-e620d0b70bde tempest-ProjectMemberTests-700601358 None] Lock "cinder-b692b50a-21d5-4f16-a24a-b7777ab1fa4a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:52:48 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-7dfc0c10-080a-4860-9f7b-e620d0b70bde tempest-ProjectMemberTests-700601358 None] Acquiring lock "cinder-quobyte-b692b50a-21d5-4f16-a24a-b7777ab1fa4a" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:52:48 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-7dfc0c10-080a-4860-9f7b-e620d0b70bde tempest-ProjectMemberTests-700601358 None] Lock "cinder-quobyte-b692b50a-21d5-4f16-a24a-b7777ab1fa4a" acquired by "delete_volume" :: waited 0.017s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:52:48 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f9dd4c4-f069-42c8-b49c-bed5a46a0b7c]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:52:48 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-7dfc0c10-080a-4860-9f7b-e620d0b70bde tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b692b50a-21d5-4f16-a24a-b7777ab1fa4a {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:48 devstack sudo[105204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b692b50a-21d5-4f16-a24a-b7777ab1fa4a Sep 23 14:52:48 devstack sudo[105204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:49 devstack sudo[105204]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:49 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-7dfc0c10-080a-4860-9f7b-e620d0b70bde tempest-ProjectMemberTests-700601358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b692b50a-21d5-4f16-a24a-b7777ab1fa4a" returned: 0 in 0.354s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:49 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-7dfc0c10-080a-4860-9f7b-e620d0b70bde tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b692b50a-21d5-4f16-a24a-b7777ab1fa4a {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:49 devstack sudo[105209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b692b50a-21d5-4f16-a24a-b7777ab1fa4a Sep 23 14:52:49 devstack sudo[105209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:49 devstack sudo[105209]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:49 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-7dfc0c10-080a-4860-9f7b-e620d0b70bde tempest-ProjectMemberTests-700601358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-b692b50a-21d5-4f16-a24a-b7777ab1fa4a" returned: 0 in 0.247s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:49 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-7dfc0c10-080a-4860-9f7b-e620d0b70bde tempest-ProjectMemberTests-700601358 None] Lock "cinder-quobyte-b692b50a-21d5-4f16-a24a-b7777ab1fa4a" released by "delete_volume" :: held 0.660s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:52:49 devstack cinder-volume[86310]: DEBUG dbcounter [-] [86310] Writing DB stats cinder:SELECT=122,cinder:INSERT=36,cinder:UPDATE=148,cinder:DELETE=11 {{(pid=86310) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 14:52:49 devstack cinder-volume[86310]: DEBUG dbcounter [-] [86310] Writing DB stats cinder:DELETE=13,cinder:SELECT=113,cinder:INSERT=43,cinder:UPDATE=139 {{(pid=86310) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 14:52:49 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-7dfc0c10-080a-4860-9f7b-e620d0b70bde tempest-ProjectMemberTests-700601358 None] Created reservations ['6a3a539d-0043-4515-a9ef-a2e0257f0172', 'eb0e3aae-7fd2-40c5-9429-d23df63efbc9', '0ff3f9bf-3861-44da-b5db-896b5922be96', 'f70d889e-ef9d-4c7b-8ca2-85e8c105150c'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:52:49 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-7dfc0c10-080a-4860-9f7b-e620d0b70bde tempest-ProjectMemberTests-700601358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:52:49 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-7dfc0c10-080a-4860-9f7b-e620d0b70bde tempest-ProjectMemberTests-700601358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:52:49 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-7dfc0c10-080a-4860-9f7b-e620d0b70bde tempest-ProjectMemberTests-700601358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:52:49 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-7dfc0c10-080a-4860-9f7b-e620d0b70bde tempest-ProjectMemberTests-700601358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:52:49 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-7dfc0c10-080a-4860-9f7b-e620d0b70bde tempest-ProjectMemberTests-700601358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:52:49 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-7dfc0c10-080a-4860-9f7b-e620d0b70bde tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:49 devstack sudo[105212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:52:49 devstack sudo[105212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:49 devstack sudo[105212]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:49 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-7dfc0c10-080a-4860-9f7b-e620d0b70bde tempest-ProjectMemberTests-700601358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.239s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:49 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-7dfc0c10-080a-4860-9f7b-e620d0b70bde tempest-ProjectMemberTests-700601358 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:52:49 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-7dfc0c10-080a-4860-9f7b-e620d0b70bde tempest-ProjectMemberTests-700601358 None] Deleted volume successfully. Sep 23 14:52:49 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-7dfc0c10-080a-4860-9f7b-e620d0b70bde tempest-ProjectMemberTests-700601358 None] Lock "cinder-b692b50a-21d5-4f16-a24a-b7777ab1fa4a-delete_volume" released by "delete_volume" :: held 1.103s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:52:50 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-5acfa3d1-551c-4139-be20-2144b219841c tempest-ProjectMemberTests-700601358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:52:50 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-5acfa3d1-551c-4139-be20-2144b219841c tempest-ProjectMemberTests-700601358 None] Flow 'volume_create_manager' (3da271f2-87ed-4c56-8de3-d865c08e6626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:52:50 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-5acfa3d1-551c-4139-be20-2144b219841c tempest-ProjectMemberTests-700601358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccbe7328-7ce8-4720-a67d-3e07621b656a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:52:50 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-5acfa3d1-551c-4139-be20-2144b219841c tempest-ProjectMemberTests-700601358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccbe7328-7ce8-4720-a67d-3e07621b656a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:52:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-324823933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e128749-971a-4629-8362-ba1e154f9646,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96e82c6bd57443b895414c81e35dd400',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:52:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:52:50Z,use_quota=True,user_id='ec53ea8e97044f789c6e4da593a5da06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:52:50 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-5acfa3d1-551c-4139-be20-2144b219841c tempest-ProjectMemberTests-700601358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbacf04d-d0fc-4e69-bbfa-c0c1df2295e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:52:50 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-5acfa3d1-551c-4139-be20-2144b219841c tempest-ProjectMemberTests-700601358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbacf04d-d0fc-4e69-bbfa-c0c1df2295e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:52:50 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-5acfa3d1-551c-4139-be20-2144b219841c tempest-ProjectMemberTests-700601358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d173a324-c5c8-40b7-8d5d-96baa8398ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:52:50 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-5acfa3d1-551c-4139-be20-2144b219841c tempest-ProjectMemberTests-700601358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d173a324-c5c8-40b7-8d5d-96baa8398ce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e128749-971a-4629-8362-ba1e154f9646', 'volume_name': 'volume-7e128749-971a-4629-8362-ba1e154f9646', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:52:50 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-5acfa3d1-551c-4139-be20-2144b219841c tempest-ProjectMemberTests-700601358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88ade944-5701-4f91-9ecb-c82e25785868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:52:50 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-5acfa3d1-551c-4139-be20-2144b219841c tempest-ProjectMemberTests-700601358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88ade944-5701-4f91-9ecb-c82e25785868) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:52:50 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-5acfa3d1-551c-4139-be20-2144b219841c tempest-ProjectMemberTests-700601358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9e6504c-8dc4-4cba-9ead-e14c49889f32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:52:50 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-5acfa3d1-551c-4139-be20-2144b219841c tempest-ProjectMemberTests-700601358 None] Volume 7e128749-971a-4629-8362-ba1e154f9646: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e128749-971a-4629-8362-ba1e154f9646', 'volume_size': 1} Sep 23 14:52:50 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-5acfa3d1-551c-4139-be20-2144b219841c tempest-ProjectMemberTests-700601358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:52:50 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-5acfa3d1-551c-4139-be20-2144b219841c tempest-ProjectMemberTests-700601358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:52:50 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-5acfa3d1-551c-4139-be20-2144b219841c tempest-ProjectMemberTests-700601358 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:52:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-324823933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e128749-971a-4629-8362-ba1e154f9646,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96e82c6bd57443b895414c81e35dd400',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:52:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:52:50Z,use_quota=True,user_id='ec53ea8e97044f789c6e4da593a5da06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:52:50 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-5acfa3d1-551c-4139-be20-2144b219841c tempest-ProjectMemberTests-700601358 None] Creating volume 7e128749-971a-4629-8362-ba1e154f9646 {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:52:50 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-5acfa3d1-551c-4139-be20-2144b219841c tempest-ProjectMemberTests-700601358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:52:50 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-5acfa3d1-551c-4139-be20-2144b219841c tempest-ProjectMemberTests-700601358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:52:50 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-5acfa3d1-551c-4139-be20-2144b219841c tempest-ProjectMemberTests-700601358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:52:50 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-5acfa3d1-551c-4139-be20-2144b219841c tempest-ProjectMemberTests-700601358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:52:50 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-5acfa3d1-551c-4139-be20-2144b219841c tempest-ProjectMemberTests-700601358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:52:50 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-5acfa3d1-551c-4139-be20-2144b219841c tempest-ProjectMemberTests-700601358 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:52:50 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-5acfa3d1-551c-4139-be20-2144b219841c tempest-ProjectMemberTests-700601358 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:52:50 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-5acfa3d1-551c-4139-be20-2144b219841c tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7e128749-971a-4629-8362-ba1e154f9646 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:50 devstack sudo[105215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7e128749-971a-4629-8362-ba1e154f9646 1073741824 Sep 23 14:52:50 devstack sudo[105215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:50 devstack sudo[105215]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:50 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-5acfa3d1-551c-4139-be20-2144b219841c tempest-ProjectMemberTests-700601358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7e128749-971a-4629-8362-ba1e154f9646 1073741824" returned: 0 in 0.411s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:50 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-5acfa3d1-551c-4139-be20-2144b219841c tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7e128749-971a-4629-8362-ba1e154f9646 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:50 devstack sudo[105221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7e128749-971a-4629-8362-ba1e154f9646 Sep 23 14:52:50 devstack sudo[105221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:51 devstack sudo[105221]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-5acfa3d1-551c-4139-be20-2144b219841c tempest-ProjectMemberTests-700601358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7e128749-971a-4629-8362-ba1e154f9646" returned: 0 in 0.237s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:51 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-5acfa3d1-551c-4139-be20-2144b219841c tempest-ProjectMemberTests-700601358 None] <== create_volume: return (690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:52:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-5acfa3d1-551c-4139-be20-2144b219841c tempest-ProjectMemberTests-700601358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.692s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:52:51 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-5acfa3d1-551c-4139-be20-2144b219841c tempest-ProjectMemberTests-700601358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9e6504c-8dc4-4cba-9ead-e14c49889f32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e128749-971a-4629-8362-ba1e154f9646', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:52:51 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-5acfa3d1-551c-4139-be20-2144b219841c tempest-ProjectMemberTests-700601358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53b25cb1-9898-42e9-953f-8a4a0046c9cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:52:51 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-5acfa3d1-551c-4139-be20-2144b219841c tempest-ProjectMemberTests-700601358 None] Volume volume-7e128749-971a-4629-8362-ba1e154f9646 (7e128749-971a-4629-8362-ba1e154f9646): created successfully Sep 23 14:52:51 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-5acfa3d1-551c-4139-be20-2144b219841c tempest-ProjectMemberTests-700601358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53b25cb1-9898-42e9-953f-8a4a0046c9cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:52:51 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-5acfa3d1-551c-4139-be20-2144b219841c tempest-ProjectMemberTests-700601358 None] Flow 'volume_create_manager' (3da271f2-87ed-4c56-8de3-d865c08e6626) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:52:51 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-5acfa3d1-551c-4139-be20-2144b219841c tempest-ProjectMemberTests-700601358 None] Created volume successfully. Sep 23 14:52:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-f765fa12-d6a7-4d61-b6ad-1f1d786ccaeb tempest-ProjectMemberTests-700601358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:52:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-f765fa12-d6a7-4d61-b6ad-1f1d786ccaeb tempest-ProjectMemberTests-700601358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:52:51 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-f765fa12-d6a7-4d61-b6ad-1f1d786ccaeb tempest-ProjectMemberTests-700601358 None] Creating offline snapshot 4df6e925-fef0-4e24-a343-6c1accd8447f of volume 7e128749-971a-4629-8362-ba1e154f9646 {{(pid=86310) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 14:52:51 devstack cinder-volume[86310]: DEBUG oslo_service.periodic_task [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86310) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 14:52:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:52:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:52:51 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:52:51 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:52:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:52:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:51 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[50f827f9-fcae-4a75-ad33-092005a5c85f]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:52:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-f765fa12-d6a7-4d61-b6ad-1f1d786ccaeb tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7e128749-971a-4629-8362-ba1e154f9646 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:51 devstack sudo[105224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:52:51 devstack sudo[105224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:51 devstack sudo[105225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7e128749-971a-4629-8362-ba1e154f9646 Sep 23 14:52:51 devstack sudo[105225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:51 devstack sudo[105224]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.244s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:51 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:52:51 devstack cinder-volume[86310]: DEBUG oslo_service.periodic_task [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Running periodic task VolumeManager._thread_info {{(pid=86310) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 14:52:51 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] thread count: 28 {{(pid=86310) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 14:52:51 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] thread info: [<_MainThread(MainThread, started 128854208852096)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86310) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 14:52:51 devstack sudo[105225]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-f765fa12-d6a7-4d61-b6ad-1f1d786ccaeb tempest-ProjectMemberTests-700601358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7e128749-971a-4629-8362-ba1e154f9646" returned: 0 in 0.355s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-f765fa12-d6a7-4d61-b6ad-1f1d786ccaeb tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7e128749-971a-4629-8362-ba1e154f9646,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7e128749-971a-4629-8362-ba1e154f9646.4df6e925-fef0-4e24-a343-6c1accd8447f 1G {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:51 devstack sudo[105232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7e128749-971a-4629-8362-ba1e154f9646,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7e128749-971a-4629-8362-ba1e154f9646.4df6e925-fef0-4e24-a343-6c1accd8447f 1G Sep 23 14:52:51 devstack sudo[105232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:52 devstack sudo[105232]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:52 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-f765fa12-d6a7-4d61-b6ad-1f1d786ccaeb tempest-ProjectMemberTests-700601358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7e128749-971a-4629-8362-ba1e154f9646,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7e128749-971a-4629-8362-ba1e154f9646.4df6e925-fef0-4e24-a343-6c1accd8447f 1G" returned: 0 in 0.385s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:52 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-f765fa12-d6a7-4d61-b6ad-1f1d786ccaeb tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e128749-971a-4629-8362-ba1e154f9646 -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7e128749-971a-4629-8362-ba1e154f9646.4df6e925-fef0-4e24-a343-6c1accd8447f {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:52 devstack sudo[105238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e128749-971a-4629-8362-ba1e154f9646 -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7e128749-971a-4629-8362-ba1e154f9646.4df6e925-fef0-4e24-a343-6c1accd8447f Sep 23 14:52:52 devstack sudo[105238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:52 devstack sudo[105238]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:52 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-f765fa12-d6a7-4d61-b6ad-1f1d786ccaeb tempest-ProjectMemberTests-700601358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e128749-971a-4629-8362-ba1e154f9646 -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7e128749-971a-4629-8362-ba1e154f9646.4df6e925-fef0-4e24-a343-6c1accd8447f" returned: 0 in 0.283s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:52 devstack cinder-volume[86310]: WARNING cinder.volume.drivers.remotefs [None req-f765fa12-d6a7-4d61-b6ad-1f1d786ccaeb tempest-ProjectMemberTests-700601358 None] /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7e128749-971a-4629-8362-ba1e154f9646.4df6e925-fef0-4e24-a343-6c1accd8447f is being set with open permissions: ugo+rw Sep 23 14:52:52 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-f765fa12-d6a7-4d61-b6ad-1f1d786ccaeb tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7e128749-971a-4629-8362-ba1e154f9646.4df6e925-fef0-4e24-a343-6c1accd8447f {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:52 devstack sudo[105243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7e128749-971a-4629-8362-ba1e154f9646.4df6e925-fef0-4e24-a343-6c1accd8447f Sep 23 14:52:52 devstack sudo[105243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:52 devstack sudo[105243]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:52 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-f765fa12-d6a7-4d61-b6ad-1f1d786ccaeb tempest-ProjectMemberTests-700601358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7e128749-971a-4629-8362-ba1e154f9646.4df6e925-fef0-4e24-a343-6c1accd8447f" returned: 0 in 0.235s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:52 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-f765fa12-d6a7-4d61-b6ad-1f1d786ccaeb tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7e128749-971a-4629-8362-ba1e154f9646.info {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:52 devstack sudo[105246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7e128749-971a-4629-8362-ba1e154f9646.info Sep 23 14:52:52 devstack sudo[105246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:53 devstack sudo[105246]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:53 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-f765fa12-d6a7-4d61-b6ad-1f1d786ccaeb tempest-ProjectMemberTests-700601358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7e128749-971a-4629-8362-ba1e154f9646.info" returned: 0 in 0.241s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:53 devstack cinder-volume[86310]: WARNING cinder.volume.drivers.remotefs [None req-f765fa12-d6a7-4d61-b6ad-1f1d786ccaeb tempest-ProjectMemberTests-700601358 None] /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7e128749-971a-4629-8362-ba1e154f9646.info is being set with open permissions: ugo+rw Sep 23 14:52:53 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-f765fa12-d6a7-4d61-b6ad-1f1d786ccaeb tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7e128749-971a-4629-8362-ba1e154f9646.info {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:53 devstack sudo[105250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7e128749-971a-4629-8362-ba1e154f9646.info Sep 23 14:52:53 devstack sudo[105250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:53 devstack sudo[105250]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:53 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-f765fa12-d6a7-4d61-b6ad-1f1d786ccaeb tempest-ProjectMemberTests-700601358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7e128749-971a-4629-8362-ba1e154f9646.info" returned: 0 in 0.252s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:53 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-f765fa12-d6a7-4d61-b6ad-1f1d786ccaeb tempest-ProjectMemberTests-700601358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.841s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:52:53 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-f765fa12-d6a7-4d61-b6ad-1f1d786ccaeb tempest-ProjectMemberTests-700601358 None] Create snapshot completed successfully Sep 23 14:52:53 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-da2add4f-6536-4ab1-b9ca-f1494e612b93 tempest-ProjectMemberTests-700601358 None] Acquiring lock "cinder-4df6e925-fef0-4e24-a343-6c1accd8447f-delete_snapshot" by "delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:52:53 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-da2add4f-6536-4ab1-b9ca-f1494e612b93 tempest-ProjectMemberTests-700601358 None] Lock "cinder-4df6e925-fef0-4e24-a343-6c1accd8447f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:52:53 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-da2add4f-6536-4ab1-b9ca-f1494e612b93 tempest-ProjectMemberTests-700601358 None] Acquiring lock "cinder-quobyte-7e128749-971a-4629-8362-ba1e154f9646" by "delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:52:53 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-da2add4f-6536-4ab1-b9ca-f1494e612b93 tempest-ProjectMemberTests-700601358 None] Lock "cinder-quobyte-7e128749-971a-4629-8362-ba1e154f9646" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:52:53 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-da2add4f-6536-4ab1-b9ca-f1494e612b93 tempest-ProjectMemberTests-700601358 None] Acquiring lock "cinder-quobyte-4df6e925-fef0-4e24-a343-6c1accd8447f" by "_delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:52:53 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-da2add4f-6536-4ab1-b9ca-f1494e612b93 tempest-ProjectMemberTests-700601358 None] Lock "cinder-quobyte-4df6e925-fef0-4e24-a343-6c1accd8447f" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:52:53 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-da2add4f-6536-4ab1-b9ca-f1494e612b93 tempest-ProjectMemberTests-700601358 None] Deleting offline snapshot 4df6e925-fef0-4e24-a343-6c1accd8447f of volume 7e128749-971a-4629-8362-ba1e154f9646 {{(pid=86310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 14:52:53 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-da2add4f-6536-4ab1-b9ca-f1494e612b93 tempest-ProjectMemberTests-700601358 None] snapshot_file for this snap is: volume-7e128749-971a-4629-8362-ba1e154f9646.4df6e925-fef0-4e24-a343-6c1accd8447f {{(pid=86310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 14:52:53 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[30c48086-3034-44cf-b7f6-a6056f0d181b]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:52:53 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-da2add4f-6536-4ab1-b9ca-f1494e612b93 tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7e128749-971a-4629-8362-ba1e154f9646.4df6e925-fef0-4e24-a343-6c1accd8447f {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:53 devstack sudo[105253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7e128749-971a-4629-8362-ba1e154f9646.4df6e925-fef0-4e24-a343-6c1accd8447f Sep 23 14:52:53 devstack sudo[105253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:54 devstack sudo[105253]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:54 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-da2add4f-6536-4ab1-b9ca-f1494e612b93 tempest-ProjectMemberTests-700601358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7e128749-971a-4629-8362-ba1e154f9646.4df6e925-fef0-4e24-a343-6c1accd8447f" returned: 0 in 0.353s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:54 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-da2add4f-6536-4ab1-b9ca-f1494e612b93 tempest-ProjectMemberTests-700601358 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e128749-971a-4629-8362-ba1e154f9646(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 14:52:54 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[52bad2a3-ab77-45b8-8755-03b657585c22]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:52:54 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-da2add4f-6536-4ab1-b9ca-f1494e612b93 tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7e128749-971a-4629-8362-ba1e154f9646 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:54 devstack sudo[105258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7e128749-971a-4629-8362-ba1e154f9646 Sep 23 14:52:54 devstack sudo[105258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:54 devstack sudo[105258]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:54 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-da2add4f-6536-4ab1-b9ca-f1494e612b93 tempest-ProjectMemberTests-700601358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7e128749-971a-4629-8362-ba1e154f9646" returned: 0 in 0.347s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:54 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-da2add4f-6536-4ab1-b9ca-f1494e612b93 tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7e128749-971a-4629-8362-ba1e154f9646.4df6e925-fef0-4e24-a343-6c1accd8447f {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:54 devstack sudo[105263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7e128749-971a-4629-8362-ba1e154f9646.4df6e925-fef0-4e24-a343-6c1accd8447f Sep 23 14:52:54 devstack sudo[105263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:54 devstack sudo[105263]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:54 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-da2add4f-6536-4ab1-b9ca-f1494e612b93 tempest-ProjectMemberTests-700601358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7e128749-971a-4629-8362-ba1e154f9646.4df6e925-fef0-4e24-a343-6c1accd8447f" returned: 0 in 0.323s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:54 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-da2add4f-6536-4ab1-b9ca-f1494e612b93 tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7e128749-971a-4629-8362-ba1e154f9646.4df6e925-fef0-4e24-a343-6c1accd8447f {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:54 devstack sudo[105268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7e128749-971a-4629-8362-ba1e154f9646.4df6e925-fef0-4e24-a343-6c1accd8447f Sep 23 14:52:54 devstack sudo[105268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:54 devstack sudo[105268]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:54 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-da2add4f-6536-4ab1-b9ca-f1494e612b93 tempest-ProjectMemberTests-700601358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7e128749-971a-4629-8362-ba1e154f9646.4df6e925-fef0-4e24-a343-6c1accd8447f" returned: 0 in 0.235s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:55 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-da2add4f-6536-4ab1-b9ca-f1494e612b93 tempest-ProjectMemberTests-700601358 None] Lock "cinder-quobyte-4df6e925-fef0-4e24-a343-6c1accd8447f" released by "_delete_snapshot" :: held 1.349s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:52:55 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-da2add4f-6536-4ab1-b9ca-f1494e612b93 tempest-ProjectMemberTests-700601358 None] Lock "cinder-quobyte-7e128749-971a-4629-8362-ba1e154f9646" released by "delete_snapshot" :: held 1.372s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:52:55 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-da2add4f-6536-4ab1-b9ca-f1494e612b93 tempest-ProjectMemberTests-700601358 None] Created reservations ['7f5e9938-e110-433c-811d-7a537ffbc183', 'ca698b18-b5be-4a6a-a5e7-8e2a6c0b353f', '97a9ad65-32bd-48f4-96eb-7d4b3194370f', '21dbad13-3450-4b73-89a8-caf314269fb1'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:52:55 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-da2add4f-6536-4ab1-b9ca-f1494e612b93 tempest-ProjectMemberTests-700601358 None] Delete snapshot completed successfully. Sep 23 14:52:55 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-da2add4f-6536-4ab1-b9ca-f1494e612b93 tempest-ProjectMemberTests-700601358 None] Lock "cinder-4df6e925-fef0-4e24-a343-6c1accd8447f-delete_snapshot" released by "delete_snapshot" :: held 1.493s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:52:55 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-e6f415b2-d087-4e59-a70f-6c1f8144fa42 tempest-ProjectMemberTests-700601358 None] Acquiring lock "cinder-7e128749-971a-4629-8362-ba1e154f9646-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:52:55 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-e6f415b2-d087-4e59-a70f-6c1f8144fa42 tempest-ProjectMemberTests-700601358 None] Lock "cinder-7e128749-971a-4629-8362-ba1e154f9646-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:52:55 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-e6f415b2-d087-4e59-a70f-6c1f8144fa42 tempest-ProjectMemberTests-700601358 None] Acquiring lock "cinder-quobyte-7e128749-971a-4629-8362-ba1e154f9646" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:52:55 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-e6f415b2-d087-4e59-a70f-6c1f8144fa42 tempest-ProjectMemberTests-700601358 None] Lock "cinder-quobyte-7e128749-971a-4629-8362-ba1e154f9646" acquired by "delete_volume" :: waited 0.018s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:52:55 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[16a60c3a-7e13-45a7-971d-ab63accb9881]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:52:55 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-e6f415b2-d087-4e59-a70f-6c1f8144fa42 tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7e128749-971a-4629-8362-ba1e154f9646 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:55 devstack sudo[105271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7e128749-971a-4629-8362-ba1e154f9646 Sep 23 14:52:55 devstack sudo[105271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:56 devstack sudo[105271]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:56 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-e6f415b2-d087-4e59-a70f-6c1f8144fa42 tempest-ProjectMemberTests-700601358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7e128749-971a-4629-8362-ba1e154f9646" returned: 0 in 0.354s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:56 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-e6f415b2-d087-4e59-a70f-6c1f8144fa42 tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7e128749-971a-4629-8362-ba1e154f9646 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:56 devstack sudo[105276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7e128749-971a-4629-8362-ba1e154f9646 Sep 23 14:52:56 devstack sudo[105276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:56 devstack sudo[105276]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:56 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-e6f415b2-d087-4e59-a70f-6c1f8144fa42 tempest-ProjectMemberTests-700601358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-7e128749-971a-4629-8362-ba1e154f9646" returned: 0 in 0.248s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:56 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-e6f415b2-d087-4e59-a70f-6c1f8144fa42 tempest-ProjectMemberTests-700601358 None] Lock "cinder-quobyte-7e128749-971a-4629-8362-ba1e154f9646" released by "delete_volume" :: held 0.665s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:52:56 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-e6f415b2-d087-4e59-a70f-6c1f8144fa42 tempest-ProjectMemberTests-700601358 None] Created reservations ['5ce216c8-ba56-47b3-bf0c-4ece53e55fd5', '55c8c0b0-b11a-4476-b048-0f870dc6f4f8', '03d9b22b-872b-4e35-ab3c-9274f48bffa8', 'e3dcf2db-4f7d-4911-84e2-6ebbd8a62c5f'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:52:56 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-e6f415b2-d087-4e59-a70f-6c1f8144fa42 tempest-ProjectMemberTests-700601358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:52:56 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-e6f415b2-d087-4e59-a70f-6c1f8144fa42 tempest-ProjectMemberTests-700601358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:52:56 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-e6f415b2-d087-4e59-a70f-6c1f8144fa42 tempest-ProjectMemberTests-700601358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:52:56 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-e6f415b2-d087-4e59-a70f-6c1f8144fa42 tempest-ProjectMemberTests-700601358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:52:56 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-e6f415b2-d087-4e59-a70f-6c1f8144fa42 tempest-ProjectMemberTests-700601358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:52:56 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-e6f415b2-d087-4e59-a70f-6c1f8144fa42 tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:56 devstack sudo[105279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:52:56 devstack sudo[105279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:56 devstack sudo[105279]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:56 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-e6f415b2-d087-4e59-a70f-6c1f8144fa42 tempest-ProjectMemberTests-700601358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.254s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:56 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-e6f415b2-d087-4e59-a70f-6c1f8144fa42 tempest-ProjectMemberTests-700601358 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:52:56 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-e6f415b2-d087-4e59-a70f-6c1f8144fa42 tempest-ProjectMemberTests-700601358 None] Deleted volume successfully. Sep 23 14:52:56 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-e6f415b2-d087-4e59-a70f-6c1f8144fa42 tempest-ProjectMemberTests-700601358 None] Lock "cinder-7e128749-971a-4629-8362-ba1e154f9646-delete_volume" released by "delete_volume" :: held 1.117s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:52:57 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-409f9407-5fa5-40ac-a329-53669dc882aa tempest-ProjectMemberTests-700601358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:52:57 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-409f9407-5fa5-40ac-a329-53669dc882aa tempest-ProjectMemberTests-700601358 None] Flow 'volume_create_manager' (d8fdd0b4-c558-43bc-abc0-af434b0b7bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:52:57 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-409f9407-5fa5-40ac-a329-53669dc882aa tempest-ProjectMemberTests-700601358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80960903-e65c-4615-a1e9-4d40244703b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:52:57 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-409f9407-5fa5-40ac-a329-53669dc882aa tempest-ProjectMemberTests-700601358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80960903-e65c-4615-a1e9-4d40244703b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:52:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1610888838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb851dec-910e-48fb-b93d-39e5a61db311,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96e82c6bd57443b895414c81e35dd400',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:52:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:52:57Z,use_quota=True,user_id='ec53ea8e97044f789c6e4da593a5da06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:52:57 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-409f9407-5fa5-40ac-a329-53669dc882aa tempest-ProjectMemberTests-700601358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c5885e8-4c36-4112-b1e8-b1d270438156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:52:57 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-409f9407-5fa5-40ac-a329-53669dc882aa tempest-ProjectMemberTests-700601358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c5885e8-4c36-4112-b1e8-b1d270438156) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:52:57 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-409f9407-5fa5-40ac-a329-53669dc882aa tempest-ProjectMemberTests-700601358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (953eaae0-f104-4e4c-9f3a-a01dc30adf81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:52:57 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-409f9407-5fa5-40ac-a329-53669dc882aa tempest-ProjectMemberTests-700601358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (953eaae0-f104-4e4c-9f3a-a01dc30adf81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb851dec-910e-48fb-b93d-39e5a61db311', 'volume_name': 'volume-eb851dec-910e-48fb-b93d-39e5a61db311', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:52:57 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-409f9407-5fa5-40ac-a329-53669dc882aa tempest-ProjectMemberTests-700601358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d598a198-4f07-4069-80fb-3b9227457584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:52:57 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-409f9407-5fa5-40ac-a329-53669dc882aa tempest-ProjectMemberTests-700601358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d598a198-4f07-4069-80fb-3b9227457584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:52:57 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-409f9407-5fa5-40ac-a329-53669dc882aa tempest-ProjectMemberTests-700601358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9132c002-d171-45a0-b5aa-5d8033cb05a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:52:57 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-409f9407-5fa5-40ac-a329-53669dc882aa tempest-ProjectMemberTests-700601358 None] Volume eb851dec-910e-48fb-b93d-39e5a61db311: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb851dec-910e-48fb-b93d-39e5a61db311', 'volume_size': 1} Sep 23 14:52:57 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-409f9407-5fa5-40ac-a329-53669dc882aa tempest-ProjectMemberTests-700601358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:52:57 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-409f9407-5fa5-40ac-a329-53669dc882aa tempest-ProjectMemberTests-700601358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:52:57 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-409f9407-5fa5-40ac-a329-53669dc882aa tempest-ProjectMemberTests-700601358 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:52:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1610888838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb851dec-910e-48fb-b93d-39e5a61db311,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96e82c6bd57443b895414c81e35dd400',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:52:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:52:57Z,use_quota=True,user_id='ec53ea8e97044f789c6e4da593a5da06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:52:57 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-409f9407-5fa5-40ac-a329-53669dc882aa tempest-ProjectMemberTests-700601358 None] Creating volume eb851dec-910e-48fb-b93d-39e5a61db311 {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:52:57 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-409f9407-5fa5-40ac-a329-53669dc882aa tempest-ProjectMemberTests-700601358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:52:57 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-409f9407-5fa5-40ac-a329-53669dc882aa tempest-ProjectMemberTests-700601358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:52:57 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-409f9407-5fa5-40ac-a329-53669dc882aa tempest-ProjectMemberTests-700601358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:52:57 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-409f9407-5fa5-40ac-a329-53669dc882aa tempest-ProjectMemberTests-700601358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:52:57 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-409f9407-5fa5-40ac-a329-53669dc882aa tempest-ProjectMemberTests-700601358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:52:57 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-409f9407-5fa5-40ac-a329-53669dc882aa tempest-ProjectMemberTests-700601358 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:52:57 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-409f9407-5fa5-40ac-a329-53669dc882aa tempest-ProjectMemberTests-700601358 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:52:57 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-409f9407-5fa5-40ac-a329-53669dc882aa tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-eb851dec-910e-48fb-b93d-39e5a61db311 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:57 devstack sudo[105282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-eb851dec-910e-48fb-b93d-39e5a61db311 1073741824 Sep 23 14:52:57 devstack sudo[105282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:57 devstack sudo[105282]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:57 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-409f9407-5fa5-40ac-a329-53669dc882aa tempest-ProjectMemberTests-700601358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-eb851dec-910e-48fb-b93d-39e5a61db311 1073741824" returned: 0 in 0.426s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:57 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-409f9407-5fa5-40ac-a329-53669dc882aa tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-eb851dec-910e-48fb-b93d-39e5a61db311 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:57 devstack sudo[105288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-eb851dec-910e-48fb-b93d-39e5a61db311 Sep 23 14:52:57 devstack sudo[105288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:58 devstack sudo[105288]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:58 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-409f9407-5fa5-40ac-a329-53669dc882aa tempest-ProjectMemberTests-700601358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-eb851dec-910e-48fb-b93d-39e5a61db311" returned: 0 in 0.242s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:58 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-409f9407-5fa5-40ac-a329-53669dc882aa tempest-ProjectMemberTests-700601358 None] <== create_volume: return (709ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:52:58 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-409f9407-5fa5-40ac-a329-53669dc882aa tempest-ProjectMemberTests-700601358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.712s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:52:58 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-409f9407-5fa5-40ac-a329-53669dc882aa tempest-ProjectMemberTests-700601358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9132c002-d171-45a0-b5aa-5d8033cb05a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb851dec-910e-48fb-b93d-39e5a61db311', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:52:58 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-409f9407-5fa5-40ac-a329-53669dc882aa tempest-ProjectMemberTests-700601358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04984e6c-dd19-4f7c-bad7-bb915cb11e28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:52:58 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-409f9407-5fa5-40ac-a329-53669dc882aa tempest-ProjectMemberTests-700601358 None] Volume volume-eb851dec-910e-48fb-b93d-39e5a61db311 (eb851dec-910e-48fb-b93d-39e5a61db311): created successfully Sep 23 14:52:58 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-409f9407-5fa5-40ac-a329-53669dc882aa tempest-ProjectMemberTests-700601358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04984e6c-dd19-4f7c-bad7-bb915cb11e28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:52:58 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-409f9407-5fa5-40ac-a329-53669dc882aa tempest-ProjectMemberTests-700601358 None] Flow 'volume_create_manager' (d8fdd0b4-c558-43bc-abc0-af434b0b7bb8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:52:58 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-409f9407-5fa5-40ac-a329-53669dc882aa tempest-ProjectMemberTests-700601358 None] Created volume successfully. Sep 23 14:52:58 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-838fc592-476c-4a1f-abb5-d6e7b1c798f4 tempest-ProjectMemberTests-700601358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:52:58 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-838fc592-476c-4a1f-abb5-d6e7b1c798f4 tempest-ProjectMemberTests-700601358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:52:58 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-838fc592-476c-4a1f-abb5-d6e7b1c798f4 tempest-ProjectMemberTests-700601358 None] Creating offline snapshot c48abb66-ea15-4a1d-a473-3242feb8a427 of volume eb851dec-910e-48fb-b93d-39e5a61db311 {{(pid=86310) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 14:52:58 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[0de04cc8-a341-4ffc-b88f-bdee4d0f76f5]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:52:58 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-838fc592-476c-4a1f-abb5-d6e7b1c798f4 tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-eb851dec-910e-48fb-b93d-39e5a61db311 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:58 devstack sudo[105291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-eb851dec-910e-48fb-b93d-39e5a61db311 Sep 23 14:52:58 devstack sudo[105291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:58 devstack sudo[105291]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:58 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-838fc592-476c-4a1f-abb5-d6e7b1c798f4 tempest-ProjectMemberTests-700601358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-eb851dec-910e-48fb-b93d-39e5a61db311" returned: 0 in 0.348s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:58 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-838fc592-476c-4a1f-abb5-d6e7b1c798f4 tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-eb851dec-910e-48fb-b93d-39e5a61db311,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-eb851dec-910e-48fb-b93d-39e5a61db311.c48abb66-ea15-4a1d-a473-3242feb8a427 1G {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:58 devstack sudo[105297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-eb851dec-910e-48fb-b93d-39e5a61db311,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-eb851dec-910e-48fb-b93d-39e5a61db311.c48abb66-ea15-4a1d-a473-3242feb8a427 1G Sep 23 14:52:58 devstack sudo[105297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:59 devstack sudo[105297]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:59 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-838fc592-476c-4a1f-abb5-d6e7b1c798f4 tempest-ProjectMemberTests-700601358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-eb851dec-910e-48fb-b93d-39e5a61db311,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-eb851dec-910e-48fb-b93d-39e5a61db311.c48abb66-ea15-4a1d-a473-3242feb8a427 1G" returned: 0 in 0.397s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:59 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-838fc592-476c-4a1f-abb5-d6e7b1c798f4 tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb851dec-910e-48fb-b93d-39e5a61db311 -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-eb851dec-910e-48fb-b93d-39e5a61db311.c48abb66-ea15-4a1d-a473-3242feb8a427 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:59 devstack sudo[105303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb851dec-910e-48fb-b93d-39e5a61db311 -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-eb851dec-910e-48fb-b93d-39e5a61db311.c48abb66-ea15-4a1d-a473-3242feb8a427 Sep 23 14:52:59 devstack sudo[105303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:59 devstack sudo[105303]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:59 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-838fc592-476c-4a1f-abb5-d6e7b1c798f4 tempest-ProjectMemberTests-700601358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb851dec-910e-48fb-b93d-39e5a61db311 -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-eb851dec-910e-48fb-b93d-39e5a61db311.c48abb66-ea15-4a1d-a473-3242feb8a427" returned: 0 in 0.295s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:59 devstack cinder-volume[86310]: WARNING cinder.volume.drivers.remotefs [None req-838fc592-476c-4a1f-abb5-d6e7b1c798f4 tempest-ProjectMemberTests-700601358 None] /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-eb851dec-910e-48fb-b93d-39e5a61db311.c48abb66-ea15-4a1d-a473-3242feb8a427 is being set with open permissions: ugo+rw Sep 23 14:52:59 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-838fc592-476c-4a1f-abb5-d6e7b1c798f4 tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-eb851dec-910e-48fb-b93d-39e5a61db311.c48abb66-ea15-4a1d-a473-3242feb8a427 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:59 devstack sudo[105308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-eb851dec-910e-48fb-b93d-39e5a61db311.c48abb66-ea15-4a1d-a473-3242feb8a427 Sep 23 14:52:59 devstack sudo[105308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:52:59 devstack sudo[105308]: pam_unix(sudo:session): session closed for user root Sep 23 14:52:59 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-838fc592-476c-4a1f-abb5-d6e7b1c798f4 tempest-ProjectMemberTests-700601358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-eb851dec-910e-48fb-b93d-39e5a61db311.c48abb66-ea15-4a1d-a473-3242feb8a427" returned: 0 in 0.254s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:52:59 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-838fc592-476c-4a1f-abb5-d6e7b1c798f4 tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-eb851dec-910e-48fb-b93d-39e5a61db311.info {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:52:59 devstack sudo[105311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-eb851dec-910e-48fb-b93d-39e5a61db311.info Sep 23 14:52:59 devstack sudo[105311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:53:00 devstack sudo[105311]: pam_unix(sudo:session): session closed for user root Sep 23 14:53:00 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-838fc592-476c-4a1f-abb5-d6e7b1c798f4 tempest-ProjectMemberTests-700601358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-eb851dec-910e-48fb-b93d-39e5a61db311.info" returned: 0 in 0.241s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:53:00 devstack cinder-volume[86310]: WARNING cinder.volume.drivers.remotefs [None req-838fc592-476c-4a1f-abb5-d6e7b1c798f4 tempest-ProjectMemberTests-700601358 None] /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-eb851dec-910e-48fb-b93d-39e5a61db311.info is being set with open permissions: ugo+rw Sep 23 14:53:00 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-838fc592-476c-4a1f-abb5-d6e7b1c798f4 tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-eb851dec-910e-48fb-b93d-39e5a61db311.info {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:53:00 devstack sudo[105314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-eb851dec-910e-48fb-b93d-39e5a61db311.info Sep 23 14:53:00 devstack sudo[105314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:53:00 devstack sudo[105314]: pam_unix(sudo:session): session closed for user root Sep 23 14:53:00 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-838fc592-476c-4a1f-abb5-d6e7b1c798f4 tempest-ProjectMemberTests-700601358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-eb851dec-910e-48fb-b93d-39e5a61db311.info" returned: 0 in 0.243s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:53:00 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-838fc592-476c-4a1f-abb5-d6e7b1c798f4 tempest-ProjectMemberTests-700601358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.859s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:53:00 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-838fc592-476c-4a1f-abb5-d6e7b1c798f4 tempest-ProjectMemberTests-700601358 None] Create snapshot completed successfully Sep 23 14:53:00 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-34daf498-73b9-418c-a36f-10c90c36d085 tempest-ProjectMemberTests-700601358 None] Acquiring lock "cinder-c48abb66-ea15-4a1d-a473-3242feb8a427-delete_snapshot" by "delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:53:00 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-34daf498-73b9-418c-a36f-10c90c36d085 tempest-ProjectMemberTests-700601358 None] Lock "cinder-c48abb66-ea15-4a1d-a473-3242feb8a427-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:53:00 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-34daf498-73b9-418c-a36f-10c90c36d085 tempest-ProjectMemberTests-700601358 None] Acquiring lock "cinder-quobyte-eb851dec-910e-48fb-b93d-39e5a61db311" by "delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:53:00 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-34daf498-73b9-418c-a36f-10c90c36d085 tempest-ProjectMemberTests-700601358 None] Lock "cinder-quobyte-eb851dec-910e-48fb-b93d-39e5a61db311" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:53:00 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-34daf498-73b9-418c-a36f-10c90c36d085 tempest-ProjectMemberTests-700601358 None] Acquiring lock "cinder-quobyte-c48abb66-ea15-4a1d-a473-3242feb8a427" by "_delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:53:00 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-34daf498-73b9-418c-a36f-10c90c36d085 tempest-ProjectMemberTests-700601358 None] Lock "cinder-quobyte-c48abb66-ea15-4a1d-a473-3242feb8a427" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:53:00 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-34daf498-73b9-418c-a36f-10c90c36d085 tempest-ProjectMemberTests-700601358 None] Deleting offline snapshot c48abb66-ea15-4a1d-a473-3242feb8a427 of volume eb851dec-910e-48fb-b93d-39e5a61db311 {{(pid=86310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 14:53:00 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-34daf498-73b9-418c-a36f-10c90c36d085 tempest-ProjectMemberTests-700601358 None] snapshot_file for this snap is: volume-eb851dec-910e-48fb-b93d-39e5a61db311.c48abb66-ea15-4a1d-a473-3242feb8a427 {{(pid=86310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 14:53:00 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff819b7d-bc8b-4c28-8caa-c020cab22fe5]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:53:00 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-34daf498-73b9-418c-a36f-10c90c36d085 tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-eb851dec-910e-48fb-b93d-39e5a61db311.c48abb66-ea15-4a1d-a473-3242feb8a427 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:53:00 devstack sudo[105317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-eb851dec-910e-48fb-b93d-39e5a61db311.c48abb66-ea15-4a1d-a473-3242feb8a427 Sep 23 14:53:00 devstack sudo[105317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:53:01 devstack sudo[105317]: pam_unix(sudo:session): session closed for user root Sep 23 14:53:01 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-34daf498-73b9-418c-a36f-10c90c36d085 tempest-ProjectMemberTests-700601358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-eb851dec-910e-48fb-b93d-39e5a61db311.c48abb66-ea15-4a1d-a473-3242feb8a427" returned: 0 in 0.365s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:53:01 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-34daf498-73b9-418c-a36f-10c90c36d085 tempest-ProjectMemberTests-700601358 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eb851dec-910e-48fb-b93d-39e5a61db311(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 14:53:01 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[c630583d-2e39-43c0-811e-22906c95e012]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:53:01 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-34daf498-73b9-418c-a36f-10c90c36d085 tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-eb851dec-910e-48fb-b93d-39e5a61db311 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:53:01 devstack sudo[105322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-eb851dec-910e-48fb-b93d-39e5a61db311 Sep 23 14:53:01 devstack sudo[105322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:53:01 devstack sudo[105322]: pam_unix(sudo:session): session closed for user root Sep 23 14:53:01 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-34daf498-73b9-418c-a36f-10c90c36d085 tempest-ProjectMemberTests-700601358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-eb851dec-910e-48fb-b93d-39e5a61db311" returned: 0 in 0.349s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:53:01 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-34daf498-73b9-418c-a36f-10c90c36d085 tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-eb851dec-910e-48fb-b93d-39e5a61db311.c48abb66-ea15-4a1d-a473-3242feb8a427 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:53:01 devstack sudo[105327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-eb851dec-910e-48fb-b93d-39e5a61db311.c48abb66-ea15-4a1d-a473-3242feb8a427 Sep 23 14:53:01 devstack sudo[105327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:53:01 devstack sudo[105327]: pam_unix(sudo:session): session closed for user root Sep 23 14:53:01 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-34daf498-73b9-418c-a36f-10c90c36d085 tempest-ProjectMemberTests-700601358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-eb851dec-910e-48fb-b93d-39e5a61db311.c48abb66-ea15-4a1d-a473-3242feb8a427" returned: 0 in 0.328s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:53:01 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-34daf498-73b9-418c-a36f-10c90c36d085 tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-eb851dec-910e-48fb-b93d-39e5a61db311.c48abb66-ea15-4a1d-a473-3242feb8a427 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:53:01 devstack sudo[105333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-eb851dec-910e-48fb-b93d-39e5a61db311.c48abb66-ea15-4a1d-a473-3242feb8a427 Sep 23 14:53:01 devstack sudo[105333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:53:02 devstack sudo[105333]: pam_unix(sudo:session): session closed for user root Sep 23 14:53:02 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-34daf498-73b9-418c-a36f-10c90c36d085 tempest-ProjectMemberTests-700601358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-eb851dec-910e-48fb-b93d-39e5a61db311.c48abb66-ea15-4a1d-a473-3242feb8a427" returned: 0 in 0.244s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:53:02 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-34daf498-73b9-418c-a36f-10c90c36d085 tempest-ProjectMemberTests-700601358 None] Lock "cinder-quobyte-c48abb66-ea15-4a1d-a473-3242feb8a427" released by "_delete_snapshot" :: held 1.378s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:53:02 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-34daf498-73b9-418c-a36f-10c90c36d085 tempest-ProjectMemberTests-700601358 None] Lock "cinder-quobyte-eb851dec-910e-48fb-b93d-39e5a61db311" released by "delete_snapshot" :: held 1.397s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:53:02 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-34daf498-73b9-418c-a36f-10c90c36d085 tempest-ProjectMemberTests-700601358 None] Created reservations ['8d1c7170-3c37-4f55-a084-eb0aea54a56a', 'e788b24f-84ad-4f0d-b1f7-31d8f6d8fa8b', 'b40b8233-585c-4a21-a64c-48e6118e1c44', 'b0646117-28a0-4497-be24-5d80c4245e05'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:53:02 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-34daf498-73b9-418c-a36f-10c90c36d085 tempest-ProjectMemberTests-700601358 None] Delete snapshot completed successfully. Sep 23 14:53:02 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-34daf498-73b9-418c-a36f-10c90c36d085 tempest-ProjectMemberTests-700601358 None] Lock "cinder-c48abb66-ea15-4a1d-a473-3242feb8a427-delete_snapshot" released by "delete_snapshot" :: held 1.525s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:53:02 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-c5910f6c-f2ee-41bc-9922-3af47d7960c2 tempest-ProjectMemberTests-700601358 None] Acquiring lock "cinder-eb851dec-910e-48fb-b93d-39e5a61db311-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:53:02 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-c5910f6c-f2ee-41bc-9922-3af47d7960c2 tempest-ProjectMemberTests-700601358 None] Lock "cinder-eb851dec-910e-48fb-b93d-39e5a61db311-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:53:02 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-c5910f6c-f2ee-41bc-9922-3af47d7960c2 tempest-ProjectMemberTests-700601358 None] Acquiring lock "cinder-quobyte-eb851dec-910e-48fb-b93d-39e5a61db311" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:53:03 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-c5910f6c-f2ee-41bc-9922-3af47d7960c2 tempest-ProjectMemberTests-700601358 None] Lock "cinder-quobyte-eb851dec-910e-48fb-b93d-39e5a61db311" acquired by "delete_volume" :: waited 0.013s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:53:03 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[a54ac155-bbd2-47f1-a385-f4d07f292b5d]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:53:03 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-c5910f6c-f2ee-41bc-9922-3af47d7960c2 tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-eb851dec-910e-48fb-b93d-39e5a61db311 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:53:03 devstack sudo[105337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-eb851dec-910e-48fb-b93d-39e5a61db311 Sep 23 14:53:03 devstack sudo[105337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:53:03 devstack sudo[105337]: pam_unix(sudo:session): session closed for user root Sep 23 14:53:03 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-c5910f6c-f2ee-41bc-9922-3af47d7960c2 tempest-ProjectMemberTests-700601358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-eb851dec-910e-48fb-b93d-39e5a61db311" returned: 0 in 0.350s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:53:03 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-c5910f6c-f2ee-41bc-9922-3af47d7960c2 tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-eb851dec-910e-48fb-b93d-39e5a61db311 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:53:03 devstack sudo[105342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-eb851dec-910e-48fb-b93d-39e5a61db311 Sep 23 14:53:03 devstack sudo[105342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:53:03 devstack sudo[105342]: pam_unix(sudo:session): session closed for user root Sep 23 14:53:03 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-c5910f6c-f2ee-41bc-9922-3af47d7960c2 tempest-ProjectMemberTests-700601358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-eb851dec-910e-48fb-b93d-39e5a61db311" returned: 0 in 0.247s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:53:03 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-c5910f6c-f2ee-41bc-9922-3af47d7960c2 tempest-ProjectMemberTests-700601358 None] Lock "cinder-quobyte-eb851dec-910e-48fb-b93d-39e5a61db311" released by "delete_volume" :: held 0.655s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:53:03 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-c5910f6c-f2ee-41bc-9922-3af47d7960c2 tempest-ProjectMemberTests-700601358 None] Created reservations ['1d049e51-dcde-499f-b589-9673b4072e1f', 'b60d91bc-97ef-4552-857c-9117e8a11a17', '54c3c740-1a2b-4428-852a-2992bf414f3d', '03747625-82a7-4fb5-a718-b84baa351cfe'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:53:03 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-c5910f6c-f2ee-41bc-9922-3af47d7960c2 tempest-ProjectMemberTests-700601358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:53:03 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-c5910f6c-f2ee-41bc-9922-3af47d7960c2 tempest-ProjectMemberTests-700601358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:53:03 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-c5910f6c-f2ee-41bc-9922-3af47d7960c2 tempest-ProjectMemberTests-700601358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:53:03 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-c5910f6c-f2ee-41bc-9922-3af47d7960c2 tempest-ProjectMemberTests-700601358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:53:03 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-c5910f6c-f2ee-41bc-9922-3af47d7960c2 tempest-ProjectMemberTests-700601358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:53:03 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-c5910f6c-f2ee-41bc-9922-3af47d7960c2 tempest-ProjectMemberTests-700601358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:53:03 devstack sudo[105345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:53:03 devstack sudo[105345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:53:04 devstack sudo[105345]: pam_unix(sudo:session): session closed for user root Sep 23 14:53:04 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-c5910f6c-f2ee-41bc-9922-3af47d7960c2 tempest-ProjectMemberTests-700601358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.251s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:53:04 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-c5910f6c-f2ee-41bc-9922-3af47d7960c2 tempest-ProjectMemberTests-700601358 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:53:04 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-c5910f6c-f2ee-41bc-9922-3af47d7960c2 tempest-ProjectMemberTests-700601358 None] Deleted volume successfully. Sep 23 14:53:04 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-c5910f6c-f2ee-41bc-9922-3af47d7960c2 tempest-ProjectMemberTests-700601358 None] Lock "cinder-eb851dec-910e-48fb-b93d-39e5a61db311-delete_volume" released by "delete_volume" :: held 1.132s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:53:07 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d3f76d6-976d-47ca-bd00-5140eaab8be5 tempest-ProjectReaderTests-573888410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:53:07 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-4d3f76d6-976d-47ca-bd00-5140eaab8be5 tempest-ProjectReaderTests-573888410 None] Flow 'volume_create_manager' (ebd07ee7-0bb1-4f6b-9688-2a6a8db9b4fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:53:07 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-4d3f76d6-976d-47ca-bd00-5140eaab8be5 tempest-ProjectReaderTests-573888410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e63139f-f270-4c22-bbee-7505c49fa8c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:53:07 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-4d3f76d6-976d-47ca-bd00-5140eaab8be5 tempest-ProjectReaderTests-573888410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e63139f-f270-4c22-bbee-7505c49fa8c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:53:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-596904973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21ceaddc-c2dc-4505-aa2d-39e608b78bd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a021bd4772d4768b94a259c5b6a1bef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:53:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:53:07Z,use_quota=True,user_id='dbbd83cbf1e54fefb96f3d25fb8036e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:53:07 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-4d3f76d6-976d-47ca-bd00-5140eaab8be5 tempest-ProjectReaderTests-573888410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bd6519a-f8f7-4f1a-aa19-c4cc48083110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:53:07 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-4d3f76d6-976d-47ca-bd00-5140eaab8be5 tempest-ProjectReaderTests-573888410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bd6519a-f8f7-4f1a-aa19-c4cc48083110) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:53:07 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-4d3f76d6-976d-47ca-bd00-5140eaab8be5 tempest-ProjectReaderTests-573888410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31679a75-a99b-4a52-b4dc-e7632766bce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:53:07 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-4d3f76d6-976d-47ca-bd00-5140eaab8be5 tempest-ProjectReaderTests-573888410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31679a75-a99b-4a52-b4dc-e7632766bce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21ceaddc-c2dc-4505-aa2d-39e608b78bd3', 'volume_name': 'volume-21ceaddc-c2dc-4505-aa2d-39e608b78bd3', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:53:07 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-4d3f76d6-976d-47ca-bd00-5140eaab8be5 tempest-ProjectReaderTests-573888410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34883f52-38c4-4c68-8d3b-9ef064295401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:53:07 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-4d3f76d6-976d-47ca-bd00-5140eaab8be5 tempest-ProjectReaderTests-573888410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34883f52-38c4-4c68-8d3b-9ef064295401) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:53:07 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-4d3f76d6-976d-47ca-bd00-5140eaab8be5 tempest-ProjectReaderTests-573888410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e011980c-0cee-43b1-a416-75733f1a7f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:53:07 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-4d3f76d6-976d-47ca-bd00-5140eaab8be5 tempest-ProjectReaderTests-573888410 None] Volume 21ceaddc-c2dc-4505-aa2d-39e608b78bd3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21ceaddc-c2dc-4505-aa2d-39e608b78bd3', 'volume_size': 1} Sep 23 14:53:07 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-4d3f76d6-976d-47ca-bd00-5140eaab8be5 tempest-ProjectReaderTests-573888410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:53:07 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-4d3f76d6-976d-47ca-bd00-5140eaab8be5 tempest-ProjectReaderTests-573888410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:53:07 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-4d3f76d6-976d-47ca-bd00-5140eaab8be5 tempest-ProjectReaderTests-573888410 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:53:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-596904973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21ceaddc-c2dc-4505-aa2d-39e608b78bd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a021bd4772d4768b94a259c5b6a1bef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:53:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:53:07Z,use_quota=True,user_id='dbbd83cbf1e54fefb96f3d25fb8036e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:53:07 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-4d3f76d6-976d-47ca-bd00-5140eaab8be5 tempest-ProjectReaderTests-573888410 None] Creating volume 21ceaddc-c2dc-4505-aa2d-39e608b78bd3 {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:53:07 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-4d3f76d6-976d-47ca-bd00-5140eaab8be5 tempest-ProjectReaderTests-573888410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:53:07 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-4d3f76d6-976d-47ca-bd00-5140eaab8be5 tempest-ProjectReaderTests-573888410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:53:07 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-4d3f76d6-976d-47ca-bd00-5140eaab8be5 tempest-ProjectReaderTests-573888410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:53:07 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-4d3f76d6-976d-47ca-bd00-5140eaab8be5 tempest-ProjectReaderTests-573888410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:53:07 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-4d3f76d6-976d-47ca-bd00-5140eaab8be5 tempest-ProjectReaderTests-573888410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:53:07 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-4d3f76d6-976d-47ca-bd00-5140eaab8be5 tempest-ProjectReaderTests-573888410 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:53:07 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-4d3f76d6-976d-47ca-bd00-5140eaab8be5 tempest-ProjectReaderTests-573888410 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:53:07 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-4d3f76d6-976d-47ca-bd00-5140eaab8be5 tempest-ProjectReaderTests-573888410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-21ceaddc-c2dc-4505-aa2d-39e608b78bd3 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:53:07 devstack sudo[105348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-21ceaddc-c2dc-4505-aa2d-39e608b78bd3 1073741824 Sep 23 14:53:07 devstack sudo[105348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:53:07 devstack sudo[105348]: pam_unix(sudo:session): session closed for user root Sep 23 14:53:07 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-4d3f76d6-976d-47ca-bd00-5140eaab8be5 tempest-ProjectReaderTests-573888410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-21ceaddc-c2dc-4505-aa2d-39e608b78bd3 1073741824" returned: 0 in 0.403s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:53:07 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-4d3f76d6-976d-47ca-bd00-5140eaab8be5 tempest-ProjectReaderTests-573888410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-21ceaddc-c2dc-4505-aa2d-39e608b78bd3 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:53:08 devstack sudo[105353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-21ceaddc-c2dc-4505-aa2d-39e608b78bd3 Sep 23 14:53:08 devstack sudo[105353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:53:08 devstack sudo[105353]: pam_unix(sudo:session): session closed for user root Sep 23 14:53:08 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-4d3f76d6-976d-47ca-bd00-5140eaab8be5 tempest-ProjectReaderTests-573888410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-21ceaddc-c2dc-4505-aa2d-39e608b78bd3" returned: 0 in 0.240s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:53:08 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-4d3f76d6-976d-47ca-bd00-5140eaab8be5 tempest-ProjectReaderTests-573888410 None] <== create_volume: return (680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:53:08 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-4d3f76d6-976d-47ca-bd00-5140eaab8be5 tempest-ProjectReaderTests-573888410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.683s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:53:08 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-4d3f76d6-976d-47ca-bd00-5140eaab8be5 tempest-ProjectReaderTests-573888410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e011980c-0cee-43b1-a416-75733f1a7f5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21ceaddc-c2dc-4505-aa2d-39e608b78bd3', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:53:08 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-4d3f76d6-976d-47ca-bd00-5140eaab8be5 tempest-ProjectReaderTests-573888410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e5598c4-7217-492d-a549-44eae5e27d17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:53:08 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-4d3f76d6-976d-47ca-bd00-5140eaab8be5 tempest-ProjectReaderTests-573888410 None] Volume volume-21ceaddc-c2dc-4505-aa2d-39e608b78bd3 (21ceaddc-c2dc-4505-aa2d-39e608b78bd3): created successfully Sep 23 14:53:08 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-4d3f76d6-976d-47ca-bd00-5140eaab8be5 tempest-ProjectReaderTests-573888410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e5598c4-7217-492d-a549-44eae5e27d17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:53:08 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-4d3f76d6-976d-47ca-bd00-5140eaab8be5 tempest-ProjectReaderTests-573888410 None] Flow 'volume_create_manager' (ebd07ee7-0bb1-4f6b-9688-2a6a8db9b4fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:53:08 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-4d3f76d6-976d-47ca-bd00-5140eaab8be5 tempest-ProjectReaderTests-573888410 None] Created volume successfully. Sep 23 14:53:08 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-d7329d1d-c37e-4574-8eda-c603ba4bcc4b tempest-ProjectReaderTests-573888410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:53:08 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-d7329d1d-c37e-4574-8eda-c603ba4bcc4b tempest-ProjectReaderTests-573888410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:53:08 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-d7329d1d-c37e-4574-8eda-c603ba4bcc4b tempest-ProjectReaderTests-573888410 None] Creating offline snapshot 56c2ad0f-2912-44f7-a05c-ee2b75628fc9 of volume 21ceaddc-c2dc-4505-aa2d-39e608b78bd3 {{(pid=86310) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 14:53:08 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[468a51d1-4c9b-4773-8fd3-c7a8e8c3edb1]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:53:08 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d7329d1d-c37e-4574-8eda-c603ba4bcc4b tempest-ProjectReaderTests-573888410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-21ceaddc-c2dc-4505-aa2d-39e608b78bd3 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:53:08 devstack sudo[105357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-21ceaddc-c2dc-4505-aa2d-39e608b78bd3 Sep 23 14:53:08 devstack sudo[105357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:53:09 devstack sudo[105357]: pam_unix(sudo:session): session closed for user root Sep 23 14:53:09 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d7329d1d-c37e-4574-8eda-c603ba4bcc4b tempest-ProjectReaderTests-573888410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-21ceaddc-c2dc-4505-aa2d-39e608b78bd3" returned: 0 in 0.362s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:53:09 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d7329d1d-c37e-4574-8eda-c603ba4bcc4b tempest-ProjectReaderTests-573888410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-21ceaddc-c2dc-4505-aa2d-39e608b78bd3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-21ceaddc-c2dc-4505-aa2d-39e608b78bd3.56c2ad0f-2912-44f7-a05c-ee2b75628fc9 1G {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:53:09 devstack sudo[105362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-21ceaddc-c2dc-4505-aa2d-39e608b78bd3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-21ceaddc-c2dc-4505-aa2d-39e608b78bd3.56c2ad0f-2912-44f7-a05c-ee2b75628fc9 1G Sep 23 14:53:09 devstack sudo[105362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:53:09 devstack sudo[105362]: pam_unix(sudo:session): session closed for user root Sep 23 14:53:09 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d7329d1d-c37e-4574-8eda-c603ba4bcc4b tempest-ProjectReaderTests-573888410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-21ceaddc-c2dc-4505-aa2d-39e608b78bd3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-21ceaddc-c2dc-4505-aa2d-39e608b78bd3.56c2ad0f-2912-44f7-a05c-ee2b75628fc9 1G" returned: 0 in 0.402s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:53:09 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d7329d1d-c37e-4574-8eda-c603ba4bcc4b tempest-ProjectReaderTests-573888410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21ceaddc-c2dc-4505-aa2d-39e608b78bd3 -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-21ceaddc-c2dc-4505-aa2d-39e608b78bd3.56c2ad0f-2912-44f7-a05c-ee2b75628fc9 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:53:09 devstack sudo[105367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21ceaddc-c2dc-4505-aa2d-39e608b78bd3 -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-21ceaddc-c2dc-4505-aa2d-39e608b78bd3.56c2ad0f-2912-44f7-a05c-ee2b75628fc9 Sep 23 14:53:09 devstack sudo[105367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:53:09 devstack sudo[105367]: pam_unix(sudo:session): session closed for user root Sep 23 14:53:09 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d7329d1d-c37e-4574-8eda-c603ba4bcc4b tempest-ProjectReaderTests-573888410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21ceaddc-c2dc-4505-aa2d-39e608b78bd3 -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-21ceaddc-c2dc-4505-aa2d-39e608b78bd3.56c2ad0f-2912-44f7-a05c-ee2b75628fc9" returned: 0 in 0.298s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:53:09 devstack cinder-volume[86310]: WARNING cinder.volume.drivers.remotefs [None req-d7329d1d-c37e-4574-8eda-c603ba4bcc4b tempest-ProjectReaderTests-573888410 None] /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-21ceaddc-c2dc-4505-aa2d-39e608b78bd3.56c2ad0f-2912-44f7-a05c-ee2b75628fc9 is being set with open permissions: ugo+rw Sep 23 14:53:09 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d7329d1d-c37e-4574-8eda-c603ba4bcc4b tempest-ProjectReaderTests-573888410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-21ceaddc-c2dc-4505-aa2d-39e608b78bd3.56c2ad0f-2912-44f7-a05c-ee2b75628fc9 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:53:09 devstack sudo[105372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-21ceaddc-c2dc-4505-aa2d-39e608b78bd3.56c2ad0f-2912-44f7-a05c-ee2b75628fc9 Sep 23 14:53:09 devstack sudo[105372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:53:10 devstack sudo[105372]: pam_unix(sudo:session): session closed for user root Sep 23 14:53:10 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d7329d1d-c37e-4574-8eda-c603ba4bcc4b tempest-ProjectReaderTests-573888410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-21ceaddc-c2dc-4505-aa2d-39e608b78bd3.56c2ad0f-2912-44f7-a05c-ee2b75628fc9" returned: 0 in 0.245s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:53:10 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d7329d1d-c37e-4574-8eda-c603ba4bcc4b tempest-ProjectReaderTests-573888410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-21ceaddc-c2dc-4505-aa2d-39e608b78bd3.info {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:53:10 devstack sudo[105375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-21ceaddc-c2dc-4505-aa2d-39e608b78bd3.info Sep 23 14:53:10 devstack sudo[105375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:53:10 devstack sudo[105375]: pam_unix(sudo:session): session closed for user root Sep 23 14:53:10 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d7329d1d-c37e-4574-8eda-c603ba4bcc4b tempest-ProjectReaderTests-573888410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-21ceaddc-c2dc-4505-aa2d-39e608b78bd3.info" returned: 0 in 0.260s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:53:10 devstack cinder-volume[86310]: WARNING cinder.volume.drivers.remotefs [None req-d7329d1d-c37e-4574-8eda-c603ba4bcc4b tempest-ProjectReaderTests-573888410 None] /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-21ceaddc-c2dc-4505-aa2d-39e608b78bd3.info is being set with open permissions: ugo+rw Sep 23 14:53:10 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d7329d1d-c37e-4574-8eda-c603ba4bcc4b tempest-ProjectReaderTests-573888410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-21ceaddc-c2dc-4505-aa2d-39e608b78bd3.info {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:53:10 devstack sudo[105378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-21ceaddc-c2dc-4505-aa2d-39e608b78bd3.info Sep 23 14:53:10 devstack sudo[105378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:53:10 devstack sudo[105378]: pam_unix(sudo:session): session closed for user root Sep 23 14:53:10 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d7329d1d-c37e-4574-8eda-c603ba4bcc4b tempest-ProjectReaderTests-573888410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-21ceaddc-c2dc-4505-aa2d-39e608b78bd3.info" returned: 0 in 0.250s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:53:10 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-d7329d1d-c37e-4574-8eda-c603ba4bcc4b tempest-ProjectReaderTests-573888410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.899s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:53:10 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-d7329d1d-c37e-4574-8eda-c603ba4bcc4b tempest-ProjectReaderTests-573888410 None] Create snapshot completed successfully Sep 23 14:53:10 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-4577f662-73d1-415b-817e-6dd13f810c31 tempest-ProjectReaderTests-573888410 None] Acquiring lock "cinder-56c2ad0f-2912-44f7-a05c-ee2b75628fc9-delete_snapshot" by "delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:53:10 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-4577f662-73d1-415b-817e-6dd13f810c31 tempest-ProjectReaderTests-573888410 None] Lock "cinder-56c2ad0f-2912-44f7-a05c-ee2b75628fc9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:53:10 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-4577f662-73d1-415b-817e-6dd13f810c31 tempest-ProjectReaderTests-573888410 None] Acquiring lock "cinder-quobyte-21ceaddc-c2dc-4505-aa2d-39e608b78bd3" by "delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:53:10 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-4577f662-73d1-415b-817e-6dd13f810c31 tempest-ProjectReaderTests-573888410 None] Lock "cinder-quobyte-21ceaddc-c2dc-4505-aa2d-39e608b78bd3" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:53:10 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-4577f662-73d1-415b-817e-6dd13f810c31 tempest-ProjectReaderTests-573888410 None] Acquiring lock "cinder-quobyte-56c2ad0f-2912-44f7-a05c-ee2b75628fc9" by "_delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:53:10 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-4577f662-73d1-415b-817e-6dd13f810c31 tempest-ProjectReaderTests-573888410 None] Lock "cinder-quobyte-56c2ad0f-2912-44f7-a05c-ee2b75628fc9" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:53:10 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-4577f662-73d1-415b-817e-6dd13f810c31 tempest-ProjectReaderTests-573888410 None] Deleting offline snapshot 56c2ad0f-2912-44f7-a05c-ee2b75628fc9 of volume 21ceaddc-c2dc-4505-aa2d-39e608b78bd3 {{(pid=86310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 14:53:10 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-4577f662-73d1-415b-817e-6dd13f810c31 tempest-ProjectReaderTests-573888410 None] snapshot_file for this snap is: volume-21ceaddc-c2dc-4505-aa2d-39e608b78bd3.56c2ad0f-2912-44f7-a05c-ee2b75628fc9 {{(pid=86310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 14:53:11 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8228b9c-327c-4a7e-bf84-1d2ca90161e4]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:53:11 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-4577f662-73d1-415b-817e-6dd13f810c31 tempest-ProjectReaderTests-573888410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-21ceaddc-c2dc-4505-aa2d-39e608b78bd3.56c2ad0f-2912-44f7-a05c-ee2b75628fc9 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:53:11 devstack sudo[105383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-21ceaddc-c2dc-4505-aa2d-39e608b78bd3.56c2ad0f-2912-44f7-a05c-ee2b75628fc9 Sep 23 14:53:11 devstack sudo[105383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:53:11 devstack sudo[105383]: pam_unix(sudo:session): session closed for user root Sep 23 14:53:11 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-4577f662-73d1-415b-817e-6dd13f810c31 tempest-ProjectReaderTests-573888410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-21ceaddc-c2dc-4505-aa2d-39e608b78bd3.56c2ad0f-2912-44f7-a05c-ee2b75628fc9" returned: 0 in 0.354s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:53:11 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-4577f662-73d1-415b-817e-6dd13f810c31 tempest-ProjectReaderTests-573888410 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-21ceaddc-c2dc-4505-aa2d-39e608b78bd3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 14:53:11 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[8025af6b-fe35-4661-89e7-2b0d953d28d5]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:53:11 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-4577f662-73d1-415b-817e-6dd13f810c31 tempest-ProjectReaderTests-573888410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-21ceaddc-c2dc-4505-aa2d-39e608b78bd3 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:53:11 devstack sudo[105388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-21ceaddc-c2dc-4505-aa2d-39e608b78bd3 Sep 23 14:53:11 devstack sudo[105388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:53:11 devstack sudo[105388]: pam_unix(sudo:session): session closed for user root Sep 23 14:53:11 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-4577f662-73d1-415b-817e-6dd13f810c31 tempest-ProjectReaderTests-573888410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-21ceaddc-c2dc-4505-aa2d-39e608b78bd3" returned: 0 in 0.361s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:53:11 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-4577f662-73d1-415b-817e-6dd13f810c31 tempest-ProjectReaderTests-573888410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-21ceaddc-c2dc-4505-aa2d-39e608b78bd3.56c2ad0f-2912-44f7-a05c-ee2b75628fc9 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:53:11 devstack sudo[105393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-21ceaddc-c2dc-4505-aa2d-39e608b78bd3.56c2ad0f-2912-44f7-a05c-ee2b75628fc9 Sep 23 14:53:11 devstack sudo[105393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:53:12 devstack sudo[105393]: pam_unix(sudo:session): session closed for user root Sep 23 14:53:12 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-4577f662-73d1-415b-817e-6dd13f810c31 tempest-ProjectReaderTests-573888410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-21ceaddc-c2dc-4505-aa2d-39e608b78bd3.56c2ad0f-2912-44f7-a05c-ee2b75628fc9" returned: 0 in 0.328s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:53:12 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-4577f662-73d1-415b-817e-6dd13f810c31 tempest-ProjectReaderTests-573888410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-21ceaddc-c2dc-4505-aa2d-39e608b78bd3.56c2ad0f-2912-44f7-a05c-ee2b75628fc9 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:53:12 devstack sudo[105399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-21ceaddc-c2dc-4505-aa2d-39e608b78bd3.56c2ad0f-2912-44f7-a05c-ee2b75628fc9 Sep 23 14:53:12 devstack sudo[105399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:53:12 devstack sudo[105399]: pam_unix(sudo:session): session closed for user root Sep 23 14:53:12 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-4577f662-73d1-415b-817e-6dd13f810c31 tempest-ProjectReaderTests-573888410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-21ceaddc-c2dc-4505-aa2d-39e608b78bd3.56c2ad0f-2912-44f7-a05c-ee2b75628fc9" returned: 0 in 0.239s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:53:12 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-4577f662-73d1-415b-817e-6dd13f810c31 tempest-ProjectReaderTests-573888410 None] Lock "cinder-quobyte-56c2ad0f-2912-44f7-a05c-ee2b75628fc9" released by "_delete_snapshot" :: held 1.381s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:53:12 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-4577f662-73d1-415b-817e-6dd13f810c31 tempest-ProjectReaderTests-573888410 None] Lock "cinder-quobyte-21ceaddc-c2dc-4505-aa2d-39e608b78bd3" released by "delete_snapshot" :: held 1.404s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:53:12 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-4577f662-73d1-415b-817e-6dd13f810c31 tempest-ProjectReaderTests-573888410 None] Created reservations ['849bb3e8-a18a-49fb-a533-27bef5cfc30a', '3d847c2d-40b8-4cc6-b019-5197e8d071f0', '3f1c68b6-2b1a-41da-a076-35bdc042af93', '802bab88-d95f-47ba-bcbe-3b42277b99d2'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:53:12 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-4577f662-73d1-415b-817e-6dd13f810c31 tempest-ProjectReaderTests-573888410 None] Delete snapshot completed successfully. Sep 23 14:53:12 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-4577f662-73d1-415b-817e-6dd13f810c31 tempest-ProjectReaderTests-573888410 None] Lock "cinder-56c2ad0f-2912-44f7-a05c-ee2b75628fc9-delete_snapshot" released by "delete_snapshot" :: held 1.537s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:53:13 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-a9b29f1b-390f-4bff-9275-834c5b3706f3 tempest-ProjectReaderTests-573888410 None] Acquiring lock "cinder-21ceaddc-c2dc-4505-aa2d-39e608b78bd3-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:53:13 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-a9b29f1b-390f-4bff-9275-834c5b3706f3 tempest-ProjectReaderTests-573888410 None] Lock "cinder-21ceaddc-c2dc-4505-aa2d-39e608b78bd3-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:53:13 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-a9b29f1b-390f-4bff-9275-834c5b3706f3 tempest-ProjectReaderTests-573888410 None] Acquiring lock "cinder-quobyte-21ceaddc-c2dc-4505-aa2d-39e608b78bd3" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:53:13 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-a9b29f1b-390f-4bff-9275-834c5b3706f3 tempest-ProjectReaderTests-573888410 None] Lock "cinder-quobyte-21ceaddc-c2dc-4505-aa2d-39e608b78bd3" acquired by "delete_volume" :: waited 0.018s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:53:13 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea61a58b-e205-4487-ad1d-8689b2672930]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:53:13 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a9b29f1b-390f-4bff-9275-834c5b3706f3 tempest-ProjectReaderTests-573888410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-21ceaddc-c2dc-4505-aa2d-39e608b78bd3 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:53:13 devstack sudo[105403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-21ceaddc-c2dc-4505-aa2d-39e608b78bd3 Sep 23 14:53:13 devstack sudo[105403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:53:13 devstack sudo[105403]: pam_unix(sudo:session): session closed for user root Sep 23 14:53:13 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a9b29f1b-390f-4bff-9275-834c5b3706f3 tempest-ProjectReaderTests-573888410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-21ceaddc-c2dc-4505-aa2d-39e608b78bd3" returned: 0 in 0.356s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:53:13 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a9b29f1b-390f-4bff-9275-834c5b3706f3 tempest-ProjectReaderTests-573888410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-21ceaddc-c2dc-4505-aa2d-39e608b78bd3 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:53:13 devstack sudo[105408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-21ceaddc-c2dc-4505-aa2d-39e608b78bd3 Sep 23 14:53:13 devstack sudo[105408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:53:13 devstack sudo[105408]: pam_unix(sudo:session): session closed for user root Sep 23 14:53:13 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a9b29f1b-390f-4bff-9275-834c5b3706f3 tempest-ProjectReaderTests-573888410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-21ceaddc-c2dc-4505-aa2d-39e608b78bd3" returned: 0 in 0.239s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:53:13 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-a9b29f1b-390f-4bff-9275-834c5b3706f3 tempest-ProjectReaderTests-573888410 None] Lock "cinder-quobyte-21ceaddc-c2dc-4505-aa2d-39e608b78bd3" released by "delete_volume" :: held 0.654s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:53:13 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-a9b29f1b-390f-4bff-9275-834c5b3706f3 tempest-ProjectReaderTests-573888410 None] Created reservations ['ebf664e1-50d4-4328-bb2f-312b7b9f922e', 'ed01e2a9-c544-40f6-9937-5f2f469a5f4c', 'd14336de-3135-45ef-8417-f46c972b5b47', 'aee65845-b0ad-4678-9ece-a783ae76a825'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:53:13 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-a9b29f1b-390f-4bff-9275-834c5b3706f3 tempest-ProjectReaderTests-573888410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:53:13 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-a9b29f1b-390f-4bff-9275-834c5b3706f3 tempest-ProjectReaderTests-573888410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:53:13 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-a9b29f1b-390f-4bff-9275-834c5b3706f3 tempest-ProjectReaderTests-573888410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:53:13 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-a9b29f1b-390f-4bff-9275-834c5b3706f3 tempest-ProjectReaderTests-573888410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:53:13 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-a9b29f1b-390f-4bff-9275-834c5b3706f3 tempest-ProjectReaderTests-573888410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:53:13 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a9b29f1b-390f-4bff-9275-834c5b3706f3 tempest-ProjectReaderTests-573888410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:53:13 devstack sudo[105411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:53:13 devstack sudo[105411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:53:14 devstack sudo[105411]: pam_unix(sudo:session): session closed for user root Sep 23 14:53:14 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a9b29f1b-390f-4bff-9275-834c5b3706f3 tempest-ProjectReaderTests-573888410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.236s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:53:14 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-a9b29f1b-390f-4bff-9275-834c5b3706f3 tempest-ProjectReaderTests-573888410 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:53:14 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-a9b29f1b-390f-4bff-9275-834c5b3706f3 tempest-ProjectReaderTests-573888410 None] Deleted volume successfully. Sep 23 14:53:14 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-a9b29f1b-390f-4bff-9275-834c5b3706f3 tempest-ProjectReaderTests-573888410 None] Lock "cinder-21ceaddc-c2dc-4505-aa2d-39e608b78bd3-delete_volume" released by "delete_volume" :: held 1.091s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:53:14 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-4182691e-60fd-4f12-ab41-a88ea67f7228 tempest-ProjectReaderTests-573888410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:53:14 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-4182691e-60fd-4f12-ab41-a88ea67f7228 tempest-ProjectReaderTests-573888410 None] Flow 'volume_create_manager' (2d531ea0-96db-4f19-897e-9c4daeba28a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:53:14 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-4182691e-60fd-4f12-ab41-a88ea67f7228 tempest-ProjectReaderTests-573888410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34d1d3e6-8572-4739-bde2-4a60f0729501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:53:14 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-4182691e-60fd-4f12-ab41-a88ea67f7228 tempest-ProjectReaderTests-573888410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34d1d3e6-8572-4739-bde2-4a60f0729501) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:53:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-644325848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f691ca9-5308-4fbf-bf23-a98284447bae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a021bd4772d4768b94a259c5b6a1bef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:53:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:53:15Z,use_quota=True,user_id='dbbd83cbf1e54fefb96f3d25fb8036e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:53:14 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-4182691e-60fd-4f12-ab41-a88ea67f7228 tempest-ProjectReaderTests-573888410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (399b1e9d-b1ee-4343-8c0b-bb28a2777c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:53:14 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-4182691e-60fd-4f12-ab41-a88ea67f7228 tempest-ProjectReaderTests-573888410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (399b1e9d-b1ee-4343-8c0b-bb28a2777c23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:53:14 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-4182691e-60fd-4f12-ab41-a88ea67f7228 tempest-ProjectReaderTests-573888410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e236df9-3474-4881-83cc-6419f0462c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:53:14 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-4182691e-60fd-4f12-ab41-a88ea67f7228 tempest-ProjectReaderTests-573888410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e236df9-3474-4881-83cc-6419f0462c35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f691ca9-5308-4fbf-bf23-a98284447bae', 'volume_name': 'volume-4f691ca9-5308-4fbf-bf23-a98284447bae', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:53:14 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-4182691e-60fd-4f12-ab41-a88ea67f7228 tempest-ProjectReaderTests-573888410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (964affcd-57ac-4766-8020-afa1be7b538c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:53:14 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-4182691e-60fd-4f12-ab41-a88ea67f7228 tempest-ProjectReaderTests-573888410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (964affcd-57ac-4766-8020-afa1be7b538c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:53:14 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-4182691e-60fd-4f12-ab41-a88ea67f7228 tempest-ProjectReaderTests-573888410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae725f5c-fb3b-4eb6-b54f-11528b1c4c7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:53:14 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-4182691e-60fd-4f12-ab41-a88ea67f7228 tempest-ProjectReaderTests-573888410 None] Volume 4f691ca9-5308-4fbf-bf23-a98284447bae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f691ca9-5308-4fbf-bf23-a98284447bae', 'volume_size': 1} Sep 23 14:53:14 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-4182691e-60fd-4f12-ab41-a88ea67f7228 tempest-ProjectReaderTests-573888410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:53:14 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-4182691e-60fd-4f12-ab41-a88ea67f7228 tempest-ProjectReaderTests-573888410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:53:14 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-4182691e-60fd-4f12-ab41-a88ea67f7228 tempest-ProjectReaderTests-573888410 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:53:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-644325848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f691ca9-5308-4fbf-bf23-a98284447bae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a021bd4772d4768b94a259c5b6a1bef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:53:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:53:15Z,use_quota=True,user_id='dbbd83cbf1e54fefb96f3d25fb8036e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:53:14 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-4182691e-60fd-4f12-ab41-a88ea67f7228 tempest-ProjectReaderTests-573888410 None] Creating volume 4f691ca9-5308-4fbf-bf23-a98284447bae {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:53:14 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-4182691e-60fd-4f12-ab41-a88ea67f7228 tempest-ProjectReaderTests-573888410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:53:14 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-4182691e-60fd-4f12-ab41-a88ea67f7228 tempest-ProjectReaderTests-573888410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:53:14 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-4182691e-60fd-4f12-ab41-a88ea67f7228 tempest-ProjectReaderTests-573888410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:53:14 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-4182691e-60fd-4f12-ab41-a88ea67f7228 tempest-ProjectReaderTests-573888410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:53:14 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-4182691e-60fd-4f12-ab41-a88ea67f7228 tempest-ProjectReaderTests-573888410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:53:14 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-4182691e-60fd-4f12-ab41-a88ea67f7228 tempest-ProjectReaderTests-573888410 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:53:14 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-4182691e-60fd-4f12-ab41-a88ea67f7228 tempest-ProjectReaderTests-573888410 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:53:14 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-4182691e-60fd-4f12-ab41-a88ea67f7228 tempest-ProjectReaderTests-573888410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4f691ca9-5308-4fbf-bf23-a98284447bae 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:53:14 devstack sudo[105414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4f691ca9-5308-4fbf-bf23-a98284447bae 1073741824 Sep 23 14:53:14 devstack sudo[105414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:53:15 devstack sudo[105414]: pam_unix(sudo:session): session closed for user root Sep 23 14:53:15 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-4182691e-60fd-4f12-ab41-a88ea67f7228 tempest-ProjectReaderTests-573888410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4f691ca9-5308-4fbf-bf23-a98284447bae 1073741824" returned: 0 in 0.393s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:53:15 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-4182691e-60fd-4f12-ab41-a88ea67f7228 tempest-ProjectReaderTests-573888410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4f691ca9-5308-4fbf-bf23-a98284447bae {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:53:15 devstack sudo[105419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4f691ca9-5308-4fbf-bf23-a98284447bae Sep 23 14:53:15 devstack sudo[105419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:53:15 devstack sudo[105419]: pam_unix(sudo:session): session closed for user root Sep 23 14:53:15 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-4182691e-60fd-4f12-ab41-a88ea67f7228 tempest-ProjectReaderTests-573888410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4f691ca9-5308-4fbf-bf23-a98284447bae" returned: 0 in 0.234s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:53:15 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-4182691e-60fd-4f12-ab41-a88ea67f7228 tempest-ProjectReaderTests-573888410 None] <== create_volume: return (666ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:53:15 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-4182691e-60fd-4f12-ab41-a88ea67f7228 tempest-ProjectReaderTests-573888410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.669s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:53:15 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-4182691e-60fd-4f12-ab41-a88ea67f7228 tempest-ProjectReaderTests-573888410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae725f5c-fb3b-4eb6-b54f-11528b1c4c7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f691ca9-5308-4fbf-bf23-a98284447bae', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:53:15 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-4182691e-60fd-4f12-ab41-a88ea67f7228 tempest-ProjectReaderTests-573888410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c3e57fe-6081-4d58-b31c-8c15b38ad7d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:53:15 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-4182691e-60fd-4f12-ab41-a88ea67f7228 tempest-ProjectReaderTests-573888410 None] Volume volume-4f691ca9-5308-4fbf-bf23-a98284447bae (4f691ca9-5308-4fbf-bf23-a98284447bae): created successfully Sep 23 14:53:15 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-4182691e-60fd-4f12-ab41-a88ea67f7228 tempest-ProjectReaderTests-573888410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c3e57fe-6081-4d58-b31c-8c15b38ad7d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:53:15 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-4182691e-60fd-4f12-ab41-a88ea67f7228 tempest-ProjectReaderTests-573888410 None] Flow 'volume_create_manager' (2d531ea0-96db-4f19-897e-9c4daeba28a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:53:15 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-4182691e-60fd-4f12-ab41-a88ea67f7228 tempest-ProjectReaderTests-573888410 None] Created volume successfully. Sep 23 14:53:15 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-ebb6c6db-61c4-47b8-82c2-6fc7d2d682c4 tempest-ProjectReaderTests-573888410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:53:15 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-ebb6c6db-61c4-47b8-82c2-6fc7d2d682c4 tempest-ProjectReaderTests-573888410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:53:15 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-ebb6c6db-61c4-47b8-82c2-6fc7d2d682c4 tempest-ProjectReaderTests-573888410 None] Creating offline snapshot 635ed493-e475-4ad1-830c-0bdea1b614a1 of volume 4f691ca9-5308-4fbf-bf23-a98284447bae {{(pid=86310) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 14:53:15 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee489bb-11d4-4376-a420-d61890ab7a2d]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:53:15 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ebb6c6db-61c4-47b8-82c2-6fc7d2d682c4 tempest-ProjectReaderTests-573888410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4f691ca9-5308-4fbf-bf23-a98284447bae {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:53:15 devstack sudo[105422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4f691ca9-5308-4fbf-bf23-a98284447bae Sep 23 14:53:15 devstack sudo[105422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:53:16 devstack sudo[105422]: pam_unix(sudo:session): session closed for user root Sep 23 14:53:16 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ebb6c6db-61c4-47b8-82c2-6fc7d2d682c4 tempest-ProjectReaderTests-573888410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4f691ca9-5308-4fbf-bf23-a98284447bae" returned: 0 in 0.342s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:53:16 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ebb6c6db-61c4-47b8-82c2-6fc7d2d682c4 tempest-ProjectReaderTests-573888410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4f691ca9-5308-4fbf-bf23-a98284447bae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4f691ca9-5308-4fbf-bf23-a98284447bae.635ed493-e475-4ad1-830c-0bdea1b614a1 1G {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:53:16 devstack sudo[105427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4f691ca9-5308-4fbf-bf23-a98284447bae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4f691ca9-5308-4fbf-bf23-a98284447bae.635ed493-e475-4ad1-830c-0bdea1b614a1 1G Sep 23 14:53:16 devstack sudo[105427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:53:16 devstack sudo[105427]: pam_unix(sudo:session): session closed for user root Sep 23 14:53:16 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ebb6c6db-61c4-47b8-82c2-6fc7d2d682c4 tempest-ProjectReaderTests-573888410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4f691ca9-5308-4fbf-bf23-a98284447bae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4f691ca9-5308-4fbf-bf23-a98284447bae.635ed493-e475-4ad1-830c-0bdea1b614a1 1G" returned: 0 in 0.368s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:53:16 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ebb6c6db-61c4-47b8-82c2-6fc7d2d682c4 tempest-ProjectReaderTests-573888410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f691ca9-5308-4fbf-bf23-a98284447bae -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4f691ca9-5308-4fbf-bf23-a98284447bae.635ed493-e475-4ad1-830c-0bdea1b614a1 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:53:16 devstack sudo[105433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f691ca9-5308-4fbf-bf23-a98284447bae -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4f691ca9-5308-4fbf-bf23-a98284447bae.635ed493-e475-4ad1-830c-0bdea1b614a1 Sep 23 14:53:16 devstack sudo[105433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:53:16 devstack sudo[105433]: pam_unix(sudo:session): session closed for user root Sep 23 14:53:16 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ebb6c6db-61c4-47b8-82c2-6fc7d2d682c4 tempest-ProjectReaderTests-573888410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f691ca9-5308-4fbf-bf23-a98284447bae -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4f691ca9-5308-4fbf-bf23-a98284447bae.635ed493-e475-4ad1-830c-0bdea1b614a1" returned: 0 in 0.279s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:53:16 devstack cinder-volume[86310]: WARNING cinder.volume.drivers.remotefs [None req-ebb6c6db-61c4-47b8-82c2-6fc7d2d682c4 tempest-ProjectReaderTests-573888410 None] /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4f691ca9-5308-4fbf-bf23-a98284447bae.635ed493-e475-4ad1-830c-0bdea1b614a1 is being set with open permissions: ugo+rw Sep 23 14:53:16 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ebb6c6db-61c4-47b8-82c2-6fc7d2d682c4 tempest-ProjectReaderTests-573888410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4f691ca9-5308-4fbf-bf23-a98284447bae.635ed493-e475-4ad1-830c-0bdea1b614a1 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:53:16 devstack sudo[105438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4f691ca9-5308-4fbf-bf23-a98284447bae.635ed493-e475-4ad1-830c-0bdea1b614a1 Sep 23 14:53:16 devstack sudo[105438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:53:17 devstack sudo[105438]: pam_unix(sudo:session): session closed for user root Sep 23 14:53:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ebb6c6db-61c4-47b8-82c2-6fc7d2d682c4 tempest-ProjectReaderTests-573888410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4f691ca9-5308-4fbf-bf23-a98284447bae.635ed493-e475-4ad1-830c-0bdea1b614a1" returned: 0 in 0.237s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:53:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ebb6c6db-61c4-47b8-82c2-6fc7d2d682c4 tempest-ProjectReaderTests-573888410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4f691ca9-5308-4fbf-bf23-a98284447bae.info {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:53:17 devstack sudo[105441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4f691ca9-5308-4fbf-bf23-a98284447bae.info Sep 23 14:53:17 devstack sudo[105441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:53:17 devstack sudo[105441]: pam_unix(sudo:session): session closed for user root Sep 23 14:53:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ebb6c6db-61c4-47b8-82c2-6fc7d2d682c4 tempest-ProjectReaderTests-573888410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4f691ca9-5308-4fbf-bf23-a98284447bae.info" returned: 0 in 0.242s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:53:17 devstack cinder-volume[86310]: WARNING cinder.volume.drivers.remotefs [None req-ebb6c6db-61c4-47b8-82c2-6fc7d2d682c4 tempest-ProjectReaderTests-573888410 None] /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4f691ca9-5308-4fbf-bf23-a98284447bae.info is being set with open permissions: ugo+rw Sep 23 14:53:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ebb6c6db-61c4-47b8-82c2-6fc7d2d682c4 tempest-ProjectReaderTests-573888410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4f691ca9-5308-4fbf-bf23-a98284447bae.info {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:53:17 devstack sudo[105444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4f691ca9-5308-4fbf-bf23-a98284447bae.info Sep 23 14:53:17 devstack sudo[105444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:53:17 devstack sudo[105444]: pam_unix(sudo:session): session closed for user root Sep 23 14:53:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-ebb6c6db-61c4-47b8-82c2-6fc7d2d682c4 tempest-ProjectReaderTests-573888410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4f691ca9-5308-4fbf-bf23-a98284447bae.info" returned: 0 in 0.240s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:53:17 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-ebb6c6db-61c4-47b8-82c2-6fc7d2d682c4 tempest-ProjectReaderTests-573888410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.791s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:53:17 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-ebb6c6db-61c4-47b8-82c2-6fc7d2d682c4 tempest-ProjectReaderTests-573888410 None] Create snapshot completed successfully Sep 23 14:53:17 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-9d89f5c7-ded7-4458-94bd-44b3a15c4acc tempest-ProjectReaderTests-573888410 None] Acquiring lock "cinder-635ed493-e475-4ad1-830c-0bdea1b614a1-delete_snapshot" by "delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:53:17 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-9d89f5c7-ded7-4458-94bd-44b3a15c4acc tempest-ProjectReaderTests-573888410 None] Lock "cinder-635ed493-e475-4ad1-830c-0bdea1b614a1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:53:17 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-9d89f5c7-ded7-4458-94bd-44b3a15c4acc tempest-ProjectReaderTests-573888410 None] Acquiring lock "cinder-quobyte-4f691ca9-5308-4fbf-bf23-a98284447bae" by "delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:53:17 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-9d89f5c7-ded7-4458-94bd-44b3a15c4acc tempest-ProjectReaderTests-573888410 None] Lock "cinder-quobyte-4f691ca9-5308-4fbf-bf23-a98284447bae" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:53:17 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-9d89f5c7-ded7-4458-94bd-44b3a15c4acc tempest-ProjectReaderTests-573888410 None] Acquiring lock "cinder-quobyte-635ed493-e475-4ad1-830c-0bdea1b614a1" by "_delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:53:17 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-9d89f5c7-ded7-4458-94bd-44b3a15c4acc tempest-ProjectReaderTests-573888410 None] Lock "cinder-quobyte-635ed493-e475-4ad1-830c-0bdea1b614a1" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:53:17 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-9d89f5c7-ded7-4458-94bd-44b3a15c4acc tempest-ProjectReaderTests-573888410 None] Deleting offline snapshot 635ed493-e475-4ad1-830c-0bdea1b614a1 of volume 4f691ca9-5308-4fbf-bf23-a98284447bae {{(pid=86310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 14:53:17 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-9d89f5c7-ded7-4458-94bd-44b3a15c4acc tempest-ProjectReaderTests-573888410 None] snapshot_file for this snap is: volume-4f691ca9-5308-4fbf-bf23-a98284447bae.635ed493-e475-4ad1-830c-0bdea1b614a1 {{(pid=86310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 14:53:18 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d241b4d-24de-42cd-884e-6bde3d65ea1d]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:53:18 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-9d89f5c7-ded7-4458-94bd-44b3a15c4acc tempest-ProjectReaderTests-573888410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4f691ca9-5308-4fbf-bf23-a98284447bae.635ed493-e475-4ad1-830c-0bdea1b614a1 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:53:18 devstack sudo[105447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4f691ca9-5308-4fbf-bf23-a98284447bae.635ed493-e475-4ad1-830c-0bdea1b614a1 Sep 23 14:53:18 devstack sudo[105447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:53:18 devstack sudo[105447]: pam_unix(sudo:session): session closed for user root Sep 23 14:53:18 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-9d89f5c7-ded7-4458-94bd-44b3a15c4acc tempest-ProjectReaderTests-573888410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4f691ca9-5308-4fbf-bf23-a98284447bae.635ed493-e475-4ad1-830c-0bdea1b614a1" returned: 0 in 0.347s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:53:18 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-9d89f5c7-ded7-4458-94bd-44b3a15c4acc tempest-ProjectReaderTests-573888410 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4f691ca9-5308-4fbf-bf23-a98284447bae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 14:53:18 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[da19db13-a933-463b-b43d-1a19e41344c5]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:53:18 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-9d89f5c7-ded7-4458-94bd-44b3a15c4acc tempest-ProjectReaderTests-573888410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4f691ca9-5308-4fbf-bf23-a98284447bae {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:53:18 devstack sudo[105452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4f691ca9-5308-4fbf-bf23-a98284447bae Sep 23 14:53:18 devstack sudo[105452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:53:18 devstack sudo[105452]: pam_unix(sudo:session): session closed for user root Sep 23 14:53:18 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-9d89f5c7-ded7-4458-94bd-44b3a15c4acc tempest-ProjectReaderTests-573888410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4f691ca9-5308-4fbf-bf23-a98284447bae" returned: 0 in 0.344s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:53:18 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-9d89f5c7-ded7-4458-94bd-44b3a15c4acc tempest-ProjectReaderTests-573888410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4f691ca9-5308-4fbf-bf23-a98284447bae.635ed493-e475-4ad1-830c-0bdea1b614a1 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:53:18 devstack sudo[105457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4f691ca9-5308-4fbf-bf23-a98284447bae.635ed493-e475-4ad1-830c-0bdea1b614a1 Sep 23 14:53:18 devstack sudo[105457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:53:19 devstack sudo[105457]: pam_unix(sudo:session): session closed for user root Sep 23 14:53:19 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-9d89f5c7-ded7-4458-94bd-44b3a15c4acc tempest-ProjectReaderTests-573888410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4f691ca9-5308-4fbf-bf23-a98284447bae.635ed493-e475-4ad1-830c-0bdea1b614a1" returned: 0 in 0.335s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:53:19 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-9d89f5c7-ded7-4458-94bd-44b3a15c4acc tempest-ProjectReaderTests-573888410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4f691ca9-5308-4fbf-bf23-a98284447bae.635ed493-e475-4ad1-830c-0bdea1b614a1 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:53:19 devstack sudo[105462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4f691ca9-5308-4fbf-bf23-a98284447bae.635ed493-e475-4ad1-830c-0bdea1b614a1 Sep 23 14:53:19 devstack sudo[105462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:53:19 devstack sudo[105462]: pam_unix(sudo:session): session closed for user root Sep 23 14:53:19 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-9d89f5c7-ded7-4458-94bd-44b3a15c4acc tempest-ProjectReaderTests-573888410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4f691ca9-5308-4fbf-bf23-a98284447bae.635ed493-e475-4ad1-830c-0bdea1b614a1" returned: 0 in 0.235s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:53:19 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-9d89f5c7-ded7-4458-94bd-44b3a15c4acc tempest-ProjectReaderTests-573888410 None] Lock "cinder-quobyte-635ed493-e475-4ad1-830c-0bdea1b614a1" released by "_delete_snapshot" :: held 1.354s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:53:19 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-9d89f5c7-ded7-4458-94bd-44b3a15c4acc tempest-ProjectReaderTests-573888410 None] Lock "cinder-quobyte-4f691ca9-5308-4fbf-bf23-a98284447bae" released by "delete_snapshot" :: held 1.375s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:53:19 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-9d89f5c7-ded7-4458-94bd-44b3a15c4acc tempest-ProjectReaderTests-573888410 None] Created reservations ['8e841951-a3b1-467d-ab85-4136cb65d180', 'ff6b3581-5d9a-45c4-bd9a-7a55c8038e3e', 'b0a3f32f-3201-4f8c-b38c-86c8c4eeaf22', '677424da-8b42-4975-bfac-018159fac8fd'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:53:19 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-9d89f5c7-ded7-4458-94bd-44b3a15c4acc tempest-ProjectReaderTests-573888410 None] Delete snapshot completed successfully. Sep 23 14:53:19 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-9d89f5c7-ded7-4458-94bd-44b3a15c4acc tempest-ProjectReaderTests-573888410 None] Lock "cinder-635ed493-e475-4ad1-830c-0bdea1b614a1-delete_snapshot" released by "delete_snapshot" :: held 1.496s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:53:20 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-9f7a9380-276f-456a-bcd8-6d86390c806f tempest-ProjectReaderTests-573888410 None] Acquiring lock "cinder-4f691ca9-5308-4fbf-bf23-a98284447bae-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:53:20 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-9f7a9380-276f-456a-bcd8-6d86390c806f tempest-ProjectReaderTests-573888410 None] Lock "cinder-4f691ca9-5308-4fbf-bf23-a98284447bae-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:53:20 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-9f7a9380-276f-456a-bcd8-6d86390c806f tempest-ProjectReaderTests-573888410 None] Acquiring lock "cinder-quobyte-4f691ca9-5308-4fbf-bf23-a98284447bae" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:53:20 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-9f7a9380-276f-456a-bcd8-6d86390c806f tempest-ProjectReaderTests-573888410 None] Lock "cinder-quobyte-4f691ca9-5308-4fbf-bf23-a98284447bae" acquired by "delete_volume" :: waited 0.015s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:53:20 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[46b87dbc-739d-4997-bd30-e0b9251982f7]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:53:20 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-9f7a9380-276f-456a-bcd8-6d86390c806f tempest-ProjectReaderTests-573888410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4f691ca9-5308-4fbf-bf23-a98284447bae {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:53:20 devstack sudo[105465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4f691ca9-5308-4fbf-bf23-a98284447bae Sep 23 14:53:20 devstack sudo[105465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:53:20 devstack sudo[105465]: pam_unix(sudo:session): session closed for user root Sep 23 14:53:20 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-9f7a9380-276f-456a-bcd8-6d86390c806f tempest-ProjectReaderTests-573888410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4f691ca9-5308-4fbf-bf23-a98284447bae" returned: 0 in 0.352s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:53:20 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-9f7a9380-276f-456a-bcd8-6d86390c806f tempest-ProjectReaderTests-573888410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4f691ca9-5308-4fbf-bf23-a98284447bae {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:53:20 devstack sudo[105470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4f691ca9-5308-4fbf-bf23-a98284447bae Sep 23 14:53:20 devstack sudo[105470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:53:20 devstack sudo[105470]: pam_unix(sudo:session): session closed for user root Sep 23 14:53:20 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-9f7a9380-276f-456a-bcd8-6d86390c806f tempest-ProjectReaderTests-573888410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-4f691ca9-5308-4fbf-bf23-a98284447bae" returned: 0 in 0.251s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:53:20 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-9f7a9380-276f-456a-bcd8-6d86390c806f tempest-ProjectReaderTests-573888410 None] Lock "cinder-quobyte-4f691ca9-5308-4fbf-bf23-a98284447bae" released by "delete_volume" :: held 0.662s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:53:20 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-9f7a9380-276f-456a-bcd8-6d86390c806f tempest-ProjectReaderTests-573888410 None] Created reservations ['9e15c6af-54e5-463b-97f5-dec6a655054a', '3ccbb297-ca62-4dc3-a823-60db1f2d60d7', '1b7b9dac-d487-426f-a449-b70641988c88', '231a5daf-5bfe-4caa-a1fc-7ecb1eb19520'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:53:20 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-9f7a9380-276f-456a-bcd8-6d86390c806f tempest-ProjectReaderTests-573888410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:53:20 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-9f7a9380-276f-456a-bcd8-6d86390c806f tempest-ProjectReaderTests-573888410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:53:20 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-9f7a9380-276f-456a-bcd8-6d86390c806f tempest-ProjectReaderTests-573888410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:53:20 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-9f7a9380-276f-456a-bcd8-6d86390c806f tempest-ProjectReaderTests-573888410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:53:20 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-9f7a9380-276f-456a-bcd8-6d86390c806f tempest-ProjectReaderTests-573888410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:53:20 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-9f7a9380-276f-456a-bcd8-6d86390c806f tempest-ProjectReaderTests-573888410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:53:20 devstack sudo[105473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:53:20 devstack sudo[105473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:53:21 devstack sudo[105473]: pam_unix(sudo:session): session closed for user root Sep 23 14:53:21 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-9f7a9380-276f-456a-bcd8-6d86390c806f tempest-ProjectReaderTests-573888410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.244s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:53:21 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-9f7a9380-276f-456a-bcd8-6d86390c806f tempest-ProjectReaderTests-573888410 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:53:21 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-9f7a9380-276f-456a-bcd8-6d86390c806f tempest-ProjectReaderTests-573888410 None] Deleted volume successfully. Sep 23 14:53:21 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-9f7a9380-276f-456a-bcd8-6d86390c806f tempest-ProjectReaderTests-573888410 None] Lock "cinder-4f691ca9-5308-4fbf-bf23-a98284447bae-delete_volume" released by "delete_volume" :: held 1.107s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:53:21 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e9c717c-345b-4529-99a1-a395dd3c3533 tempest-ProjectReaderTests-573888410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:53:21 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-0e9c717c-345b-4529-99a1-a395dd3c3533 tempest-ProjectReaderTests-573888410 None] Flow 'volume_create_manager' (1eb3b80f-02c7-4957-b894-c132319e6f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:53:21 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-0e9c717c-345b-4529-99a1-a395dd3c3533 tempest-ProjectReaderTests-573888410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43c5b6fa-acf9-4d77-ac39-c4a5f167e900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:53:21 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-0e9c717c-345b-4529-99a1-a395dd3c3533 tempest-ProjectReaderTests-573888410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43c5b6fa-acf9-4d77-ac39-c4a5f167e900) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:53:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1975580108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6af4d729-5f60-4859-8130-273d88c9b9d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a021bd4772d4768b94a259c5b6a1bef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:53:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:53:22Z,use_quota=True,user_id='dbbd83cbf1e54fefb96f3d25fb8036e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:53:21 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-0e9c717c-345b-4529-99a1-a395dd3c3533 tempest-ProjectReaderTests-573888410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8f7eb0b-937d-4756-8cea-aaa663382223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:53:21 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-0e9c717c-345b-4529-99a1-a395dd3c3533 tempest-ProjectReaderTests-573888410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8f7eb0b-937d-4756-8cea-aaa663382223) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:53:21 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-0e9c717c-345b-4529-99a1-a395dd3c3533 tempest-ProjectReaderTests-573888410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d22e33e2-1c94-48e2-bd12-ff49e470a48e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:53:21 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-0e9c717c-345b-4529-99a1-a395dd3c3533 tempest-ProjectReaderTests-573888410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d22e33e2-1c94-48e2-bd12-ff49e470a48e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6af4d729-5f60-4859-8130-273d88c9b9d0', 'volume_name': 'volume-6af4d729-5f60-4859-8130-273d88c9b9d0', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:53:21 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-0e9c717c-345b-4529-99a1-a395dd3c3533 tempest-ProjectReaderTests-573888410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29c075fd-872a-4b19-82b9-d4f0b106eae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:53:21 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-0e9c717c-345b-4529-99a1-a395dd3c3533 tempest-ProjectReaderTests-573888410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29c075fd-872a-4b19-82b9-d4f0b106eae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:53:21 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-0e9c717c-345b-4529-99a1-a395dd3c3533 tempest-ProjectReaderTests-573888410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dce8eac4-31d0-4e11-8d8e-449ed9830105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:53:21 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-0e9c717c-345b-4529-99a1-a395dd3c3533 tempest-ProjectReaderTests-573888410 None] Volume 6af4d729-5f60-4859-8130-273d88c9b9d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6af4d729-5f60-4859-8130-273d88c9b9d0', 'volume_size': 1} Sep 23 14:53:21 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-0e9c717c-345b-4529-99a1-a395dd3c3533 tempest-ProjectReaderTests-573888410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:53:21 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-0e9c717c-345b-4529-99a1-a395dd3c3533 tempest-ProjectReaderTests-573888410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:53:21 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-0e9c717c-345b-4529-99a1-a395dd3c3533 tempest-ProjectReaderTests-573888410 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:53:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1975580108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6af4d729-5f60-4859-8130-273d88c9b9d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a021bd4772d4768b94a259c5b6a1bef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:53:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:53:22Z,use_quota=True,user_id='dbbd83cbf1e54fefb96f3d25fb8036e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:53:21 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-0e9c717c-345b-4529-99a1-a395dd3c3533 tempest-ProjectReaderTests-573888410 None] Creating volume 6af4d729-5f60-4859-8130-273d88c9b9d0 {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:53:21 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-0e9c717c-345b-4529-99a1-a395dd3c3533 tempest-ProjectReaderTests-573888410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:53:21 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-0e9c717c-345b-4529-99a1-a395dd3c3533 tempest-ProjectReaderTests-573888410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:53:21 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-0e9c717c-345b-4529-99a1-a395dd3c3533 tempest-ProjectReaderTests-573888410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:53:21 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-0e9c717c-345b-4529-99a1-a395dd3c3533 tempest-ProjectReaderTests-573888410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:53:21 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-0e9c717c-345b-4529-99a1-a395dd3c3533 tempest-ProjectReaderTests-573888410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:53:21 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-0e9c717c-345b-4529-99a1-a395dd3c3533 tempest-ProjectReaderTests-573888410 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:53:21 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-0e9c717c-345b-4529-99a1-a395dd3c3533 tempest-ProjectReaderTests-573888410 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:53:21 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-0e9c717c-345b-4529-99a1-a395dd3c3533 tempest-ProjectReaderTests-573888410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6af4d729-5f60-4859-8130-273d88c9b9d0 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:53:21 devstack sudo[105476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6af4d729-5f60-4859-8130-273d88c9b9d0 1073741824 Sep 23 14:53:21 devstack sudo[105476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:53:22 devstack sudo[105476]: pam_unix(sudo:session): session closed for user root Sep 23 14:53:22 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-0e9c717c-345b-4529-99a1-a395dd3c3533 tempest-ProjectReaderTests-573888410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6af4d729-5f60-4859-8130-273d88c9b9d0 1073741824" returned: 0 in 0.410s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:53:22 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-0e9c717c-345b-4529-99a1-a395dd3c3533 tempest-ProjectReaderTests-573888410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6af4d729-5f60-4859-8130-273d88c9b9d0 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:53:22 devstack sudo[105481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6af4d729-5f60-4859-8130-273d88c9b9d0 Sep 23 14:53:22 devstack sudo[105481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:53:22 devstack sudo[105481]: pam_unix(sudo:session): session closed for user root Sep 23 14:53:22 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-0e9c717c-345b-4529-99a1-a395dd3c3533 tempest-ProjectReaderTests-573888410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6af4d729-5f60-4859-8130-273d88c9b9d0" returned: 0 in 0.236s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:53:22 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-0e9c717c-345b-4529-99a1-a395dd3c3533 tempest-ProjectReaderTests-573888410 None] <== create_volume: return (693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:53:22 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-0e9c717c-345b-4529-99a1-a395dd3c3533 tempest-ProjectReaderTests-573888410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.696s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:53:22 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-0e9c717c-345b-4529-99a1-a395dd3c3533 tempest-ProjectReaderTests-573888410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dce8eac4-31d0-4e11-8d8e-449ed9830105) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6af4d729-5f60-4859-8130-273d88c9b9d0', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:53:22 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-0e9c717c-345b-4529-99a1-a395dd3c3533 tempest-ProjectReaderTests-573888410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc6231af-7901-4aea-9872-c6202d8210cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:53:22 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-0e9c717c-345b-4529-99a1-a395dd3c3533 tempest-ProjectReaderTests-573888410 None] Volume volume-6af4d729-5f60-4859-8130-273d88c9b9d0 (6af4d729-5f60-4859-8130-273d88c9b9d0): created successfully Sep 23 14:53:22 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-0e9c717c-345b-4529-99a1-a395dd3c3533 tempest-ProjectReaderTests-573888410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc6231af-7901-4aea-9872-c6202d8210cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:53:22 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-0e9c717c-345b-4529-99a1-a395dd3c3533 tempest-ProjectReaderTests-573888410 None] Flow 'volume_create_manager' (1eb3b80f-02c7-4957-b894-c132319e6f7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:53:22 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-0e9c717c-345b-4529-99a1-a395dd3c3533 tempest-ProjectReaderTests-573888410 None] Created volume successfully. Sep 23 14:53:22 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-9b480376-9364-4c59-b93e-6e088bd0fb22 tempest-ProjectReaderTests-573888410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:53:22 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-9b480376-9364-4c59-b93e-6e088bd0fb22 tempest-ProjectReaderTests-573888410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:53:22 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-9b480376-9364-4c59-b93e-6e088bd0fb22 tempest-ProjectReaderTests-573888410 None] Creating offline snapshot 3e5a40a3-cd6a-45b4-8c29-0a7299579a2e of volume 6af4d729-5f60-4859-8130-273d88c9b9d0 {{(pid=86310) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 14:53:22 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[b48dd210-9bb6-4260-a419-4a6265e7f093]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:53:22 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-9b480376-9364-4c59-b93e-6e088bd0fb22 tempest-ProjectReaderTests-573888410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6af4d729-5f60-4859-8130-273d88c9b9d0 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:53:22 devstack sudo[105484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6af4d729-5f60-4859-8130-273d88c9b9d0 Sep 23 14:53:22 devstack sudo[105484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:53:23 devstack sudo[105484]: pam_unix(sudo:session): session closed for user root Sep 23 14:53:23 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-9b480376-9364-4c59-b93e-6e088bd0fb22 tempest-ProjectReaderTests-573888410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6af4d729-5f60-4859-8130-273d88c9b9d0" returned: 0 in 0.350s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:53:23 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-9b480376-9364-4c59-b93e-6e088bd0fb22 tempest-ProjectReaderTests-573888410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6af4d729-5f60-4859-8130-273d88c9b9d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6af4d729-5f60-4859-8130-273d88c9b9d0.3e5a40a3-cd6a-45b4-8c29-0a7299579a2e 1G {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:53:23 devstack sudo[105490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6af4d729-5f60-4859-8130-273d88c9b9d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6af4d729-5f60-4859-8130-273d88c9b9d0.3e5a40a3-cd6a-45b4-8c29-0a7299579a2e 1G Sep 23 14:53:23 devstack sudo[105490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:53:23 devstack sudo[105490]: pam_unix(sudo:session): session closed for user root Sep 23 14:53:23 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-9b480376-9364-4c59-b93e-6e088bd0fb22 tempest-ProjectReaderTests-573888410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6af4d729-5f60-4859-8130-273d88c9b9d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6af4d729-5f60-4859-8130-273d88c9b9d0.3e5a40a3-cd6a-45b4-8c29-0a7299579a2e 1G" returned: 0 in 0.389s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:53:23 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-9b480376-9364-4c59-b93e-6e088bd0fb22 tempest-ProjectReaderTests-573888410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6af4d729-5f60-4859-8130-273d88c9b9d0 -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6af4d729-5f60-4859-8130-273d88c9b9d0.3e5a40a3-cd6a-45b4-8c29-0a7299579a2e {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:53:23 devstack sudo[105495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6af4d729-5f60-4859-8130-273d88c9b9d0 -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6af4d729-5f60-4859-8130-273d88c9b9d0.3e5a40a3-cd6a-45b4-8c29-0a7299579a2e Sep 23 14:53:23 devstack sudo[105495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:53:23 devstack sudo[105495]: pam_unix(sudo:session): session closed for user root Sep 23 14:53:23 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-9b480376-9364-4c59-b93e-6e088bd0fb22 tempest-ProjectReaderTests-573888410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6af4d729-5f60-4859-8130-273d88c9b9d0 -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6af4d729-5f60-4859-8130-273d88c9b9d0.3e5a40a3-cd6a-45b4-8c29-0a7299579a2e" returned: 0 in 0.291s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:53:23 devstack cinder-volume[86310]: WARNING cinder.volume.drivers.remotefs [None req-9b480376-9364-4c59-b93e-6e088bd0fb22 tempest-ProjectReaderTests-573888410 None] /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6af4d729-5f60-4859-8130-273d88c9b9d0.3e5a40a3-cd6a-45b4-8c29-0a7299579a2e is being set with open permissions: ugo+rw Sep 23 14:53:23 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-9b480376-9364-4c59-b93e-6e088bd0fb22 tempest-ProjectReaderTests-573888410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6af4d729-5f60-4859-8130-273d88c9b9d0.3e5a40a3-cd6a-45b4-8c29-0a7299579a2e {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:53:23 devstack sudo[105500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6af4d729-5f60-4859-8130-273d88c9b9d0.3e5a40a3-cd6a-45b4-8c29-0a7299579a2e Sep 23 14:53:23 devstack sudo[105500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:53:24 devstack sudo[105500]: pam_unix(sudo:session): session closed for user root Sep 23 14:53:24 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-9b480376-9364-4c59-b93e-6e088bd0fb22 tempest-ProjectReaderTests-573888410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6af4d729-5f60-4859-8130-273d88c9b9d0.3e5a40a3-cd6a-45b4-8c29-0a7299579a2e" returned: 0 in 0.250s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:53:24 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-9b480376-9364-4c59-b93e-6e088bd0fb22 tempest-ProjectReaderTests-573888410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6af4d729-5f60-4859-8130-273d88c9b9d0.info {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:53:24 devstack sudo[105503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6af4d729-5f60-4859-8130-273d88c9b9d0.info Sep 23 14:53:24 devstack sudo[105503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:53:24 devstack sudo[105503]: pam_unix(sudo:session): session closed for user root Sep 23 14:53:24 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-9b480376-9364-4c59-b93e-6e088bd0fb22 tempest-ProjectReaderTests-573888410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6af4d729-5f60-4859-8130-273d88c9b9d0.info" returned: 0 in 0.244s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:53:24 devstack cinder-volume[86310]: WARNING cinder.volume.drivers.remotefs [None req-9b480376-9364-4c59-b93e-6e088bd0fb22 tempest-ProjectReaderTests-573888410 None] /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6af4d729-5f60-4859-8130-273d88c9b9d0.info is being set with open permissions: ugo+rw Sep 23 14:53:24 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-9b480376-9364-4c59-b93e-6e088bd0fb22 tempest-ProjectReaderTests-573888410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6af4d729-5f60-4859-8130-273d88c9b9d0.info {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:53:24 devstack sudo[105506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6af4d729-5f60-4859-8130-273d88c9b9d0.info Sep 23 14:53:24 devstack sudo[105506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:53:24 devstack sudo[105506]: pam_unix(sudo:session): session closed for user root Sep 23 14:53:24 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-9b480376-9364-4c59-b93e-6e088bd0fb22 tempest-ProjectReaderTests-573888410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6af4d729-5f60-4859-8130-273d88c9b9d0.info" returned: 0 in 0.231s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:53:24 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-9b480376-9364-4c59-b93e-6e088bd0fb22 tempest-ProjectReaderTests-573888410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.834s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:53:24 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-9b480376-9364-4c59-b93e-6e088bd0fb22 tempest-ProjectReaderTests-573888410 None] Create snapshot completed successfully Sep 23 14:53:24 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-afe0e4d5-d2e8-479f-a1a0-1d56a3bb5ca0 tempest-ProjectReaderTests-573888410 None] Acquiring lock "cinder-3e5a40a3-cd6a-45b4-8c29-0a7299579a2e-delete_snapshot" by "delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:53:24 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-afe0e4d5-d2e8-479f-a1a0-1d56a3bb5ca0 tempest-ProjectReaderTests-573888410 None] Lock "cinder-3e5a40a3-cd6a-45b4-8c29-0a7299579a2e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:53:24 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-afe0e4d5-d2e8-479f-a1a0-1d56a3bb5ca0 tempest-ProjectReaderTests-573888410 None] Acquiring lock "cinder-quobyte-6af4d729-5f60-4859-8130-273d88c9b9d0" by "delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:53:24 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-afe0e4d5-d2e8-479f-a1a0-1d56a3bb5ca0 tempest-ProjectReaderTests-573888410 None] Lock "cinder-quobyte-6af4d729-5f60-4859-8130-273d88c9b9d0" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:53:24 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-afe0e4d5-d2e8-479f-a1a0-1d56a3bb5ca0 tempest-ProjectReaderTests-573888410 None] Acquiring lock "cinder-quobyte-3e5a40a3-cd6a-45b4-8c29-0a7299579a2e" by "_delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:53:24 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-afe0e4d5-d2e8-479f-a1a0-1d56a3bb5ca0 tempest-ProjectReaderTests-573888410 None] Lock "cinder-quobyte-3e5a40a3-cd6a-45b4-8c29-0a7299579a2e" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:53:24 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-afe0e4d5-d2e8-479f-a1a0-1d56a3bb5ca0 tempest-ProjectReaderTests-573888410 None] Deleting offline snapshot 3e5a40a3-cd6a-45b4-8c29-0a7299579a2e of volume 6af4d729-5f60-4859-8130-273d88c9b9d0 {{(pid=86310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 14:53:25 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-afe0e4d5-d2e8-479f-a1a0-1d56a3bb5ca0 tempest-ProjectReaderTests-573888410 None] snapshot_file for this snap is: volume-6af4d729-5f60-4859-8130-273d88c9b9d0.3e5a40a3-cd6a-45b4-8c29-0a7299579a2e {{(pid=86310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 14:53:25 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e8e1cc0-1348-4fe6-a8a3-b81fcc965b54]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:53:25 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-afe0e4d5-d2e8-479f-a1a0-1d56a3bb5ca0 tempest-ProjectReaderTests-573888410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6af4d729-5f60-4859-8130-273d88c9b9d0.3e5a40a3-cd6a-45b4-8c29-0a7299579a2e {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:53:25 devstack sudo[105509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6af4d729-5f60-4859-8130-273d88c9b9d0.3e5a40a3-cd6a-45b4-8c29-0a7299579a2e Sep 23 14:53:25 devstack sudo[105509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:53:25 devstack sudo[105509]: pam_unix(sudo:session): session closed for user root Sep 23 14:53:25 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-afe0e4d5-d2e8-479f-a1a0-1d56a3bb5ca0 tempest-ProjectReaderTests-573888410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6af4d729-5f60-4859-8130-273d88c9b9d0.3e5a40a3-cd6a-45b4-8c29-0a7299579a2e" returned: 0 in 0.341s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:53:25 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-afe0e4d5-d2e8-479f-a1a0-1d56a3bb5ca0 tempest-ProjectReaderTests-573888410 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6af4d729-5f60-4859-8130-273d88c9b9d0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 14:53:25 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c64787e-b7d0-4b4e-aa25-207cd14fcbc6]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:53:25 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-afe0e4d5-d2e8-479f-a1a0-1d56a3bb5ca0 tempest-ProjectReaderTests-573888410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6af4d729-5f60-4859-8130-273d88c9b9d0 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:53:25 devstack sudo[105514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6af4d729-5f60-4859-8130-273d88c9b9d0 Sep 23 14:53:25 devstack sudo[105514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:53:25 devstack sudo[105514]: pam_unix(sudo:session): session closed for user root Sep 23 14:53:25 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-afe0e4d5-d2e8-479f-a1a0-1d56a3bb5ca0 tempest-ProjectReaderTests-573888410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6af4d729-5f60-4859-8130-273d88c9b9d0" returned: 0 in 0.366s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:53:25 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-afe0e4d5-d2e8-479f-a1a0-1d56a3bb5ca0 tempest-ProjectReaderTests-573888410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6af4d729-5f60-4859-8130-273d88c9b9d0.3e5a40a3-cd6a-45b4-8c29-0a7299579a2e {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:53:25 devstack sudo[105519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6af4d729-5f60-4859-8130-273d88c9b9d0.3e5a40a3-cd6a-45b4-8c29-0a7299579a2e Sep 23 14:53:25 devstack sudo[105519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:53:26 devstack sudo[105519]: pam_unix(sudo:session): session closed for user root Sep 23 14:53:26 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-afe0e4d5-d2e8-479f-a1a0-1d56a3bb5ca0 tempest-ProjectReaderTests-573888410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6af4d729-5f60-4859-8130-273d88c9b9d0.3e5a40a3-cd6a-45b4-8c29-0a7299579a2e" returned: 0 in 0.350s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:53:26 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-afe0e4d5-d2e8-479f-a1a0-1d56a3bb5ca0 tempest-ProjectReaderTests-573888410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6af4d729-5f60-4859-8130-273d88c9b9d0.3e5a40a3-cd6a-45b4-8c29-0a7299579a2e {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:53:26 devstack sudo[105525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6af4d729-5f60-4859-8130-273d88c9b9d0.3e5a40a3-cd6a-45b4-8c29-0a7299579a2e Sep 23 14:53:26 devstack sudo[105525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:53:26 devstack sudo[105525]: pam_unix(sudo:session): session closed for user root Sep 23 14:53:26 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-afe0e4d5-d2e8-479f-a1a0-1d56a3bb5ca0 tempest-ProjectReaderTests-573888410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6af4d729-5f60-4859-8130-273d88c9b9d0.3e5a40a3-cd6a-45b4-8c29-0a7299579a2e" returned: 0 in 0.242s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:53:26 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-afe0e4d5-d2e8-479f-a1a0-1d56a3bb5ca0 tempest-ProjectReaderTests-573888410 None] Lock "cinder-quobyte-3e5a40a3-cd6a-45b4-8c29-0a7299579a2e" released by "_delete_snapshot" :: held 1.394s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:53:26 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-afe0e4d5-d2e8-479f-a1a0-1d56a3bb5ca0 tempest-ProjectReaderTests-573888410 None] Lock "cinder-quobyte-6af4d729-5f60-4859-8130-273d88c9b9d0" released by "delete_snapshot" :: held 1.415s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:53:26 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-afe0e4d5-d2e8-479f-a1a0-1d56a3bb5ca0 tempest-ProjectReaderTests-573888410 None] Created reservations ['b9b4ae3b-8cf8-4872-abbf-4ad06b30c916', '3d9ad832-5f90-4a0d-a0f6-5b5698182352', '744ca1ea-35e5-4ff6-8fbb-2b295ee00f39', 'a6252ee0-a2ee-4759-8833-79645507d022'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:53:26 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-afe0e4d5-d2e8-479f-a1a0-1d56a3bb5ca0 tempest-ProjectReaderTests-573888410 None] Delete snapshot completed successfully. Sep 23 14:53:26 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-afe0e4d5-d2e8-479f-a1a0-1d56a3bb5ca0 tempest-ProjectReaderTests-573888410 None] Lock "cinder-3e5a40a3-cd6a-45b4-8c29-0a7299579a2e-delete_snapshot" released by "delete_snapshot" :: held 1.538s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:53:27 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-27cb37fc-81e2-442e-9a3a-ac6ac9b0a3e3 tempest-ProjectReaderTests-573888410 None] Acquiring lock "cinder-6af4d729-5f60-4859-8130-273d88c9b9d0-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:53:27 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-27cb37fc-81e2-442e-9a3a-ac6ac9b0a3e3 tempest-ProjectReaderTests-573888410 None] Lock "cinder-6af4d729-5f60-4859-8130-273d88c9b9d0-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:53:27 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-27cb37fc-81e2-442e-9a3a-ac6ac9b0a3e3 tempest-ProjectReaderTests-573888410 None] Acquiring lock "cinder-quobyte-6af4d729-5f60-4859-8130-273d88c9b9d0" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:53:27 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-27cb37fc-81e2-442e-9a3a-ac6ac9b0a3e3 tempest-ProjectReaderTests-573888410 None] Lock "cinder-quobyte-6af4d729-5f60-4859-8130-273d88c9b9d0" acquired by "delete_volume" :: waited 0.015s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:53:27 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f83f689-a82b-4779-a191-4358f1268ffe]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:53:27 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-27cb37fc-81e2-442e-9a3a-ac6ac9b0a3e3 tempest-ProjectReaderTests-573888410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6af4d729-5f60-4859-8130-273d88c9b9d0 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:53:27 devstack sudo[105528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6af4d729-5f60-4859-8130-273d88c9b9d0 Sep 23 14:53:27 devstack sudo[105528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:53:27 devstack sudo[105528]: pam_unix(sudo:session): session closed for user root Sep 23 14:53:27 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-27cb37fc-81e2-442e-9a3a-ac6ac9b0a3e3 tempest-ProjectReaderTests-573888410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6af4d729-5f60-4859-8130-273d88c9b9d0" returned: 0 in 0.356s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:53:27 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-27cb37fc-81e2-442e-9a3a-ac6ac9b0a3e3 tempest-ProjectReaderTests-573888410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6af4d729-5f60-4859-8130-273d88c9b9d0 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:53:27 devstack sudo[105534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6af4d729-5f60-4859-8130-273d88c9b9d0 Sep 23 14:53:27 devstack sudo[105534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:53:27 devstack sudo[105534]: pam_unix(sudo:session): session closed for user root Sep 23 14:53:27 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-27cb37fc-81e2-442e-9a3a-ac6ac9b0a3e3 tempest-ProjectReaderTests-573888410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6af4d729-5f60-4859-8130-273d88c9b9d0" returned: 0 in 0.243s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:53:27 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-27cb37fc-81e2-442e-9a3a-ac6ac9b0a3e3 tempest-ProjectReaderTests-573888410 None] Lock "cinder-quobyte-6af4d729-5f60-4859-8130-273d88c9b9d0" released by "delete_volume" :: held 0.657s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:53:27 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-27cb37fc-81e2-442e-9a3a-ac6ac9b0a3e3 tempest-ProjectReaderTests-573888410 None] Created reservations ['41c00797-3e73-43cf-b4bb-c851ff7d635e', '4b7d6677-c220-43da-afea-bb96aa995641', '0b420f4b-396f-49de-86d7-3321feb7c0ae', 'c147d32f-a05b-4397-bbf0-31babd2b6a0b'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:53:27 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-27cb37fc-81e2-442e-9a3a-ac6ac9b0a3e3 tempest-ProjectReaderTests-573888410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:53:27 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-27cb37fc-81e2-442e-9a3a-ac6ac9b0a3e3 tempest-ProjectReaderTests-573888410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:53:27 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-27cb37fc-81e2-442e-9a3a-ac6ac9b0a3e3 tempest-ProjectReaderTests-573888410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:53:27 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-27cb37fc-81e2-442e-9a3a-ac6ac9b0a3e3 tempest-ProjectReaderTests-573888410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:53:27 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-27cb37fc-81e2-442e-9a3a-ac6ac9b0a3e3 tempest-ProjectReaderTests-573888410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:53:27 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-27cb37fc-81e2-442e-9a3a-ac6ac9b0a3e3 tempest-ProjectReaderTests-573888410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:53:27 devstack sudo[105537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:53:27 devstack sudo[105537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:53:28 devstack sudo[105537]: pam_unix(sudo:session): session closed for user root Sep 23 14:53:28 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-27cb37fc-81e2-442e-9a3a-ac6ac9b0a3e3 tempest-ProjectReaderTests-573888410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.234s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:53:28 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-27cb37fc-81e2-442e-9a3a-ac6ac9b0a3e3 tempest-ProjectReaderTests-573888410 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:53:28 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-27cb37fc-81e2-442e-9a3a-ac6ac9b0a3e3 tempest-ProjectReaderTests-573888410 None] Deleted volume successfully. Sep 23 14:53:28 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-27cb37fc-81e2-442e-9a3a-ac6ac9b0a3e3 tempest-ProjectReaderTests-573888410 None] Lock "cinder-6af4d729-5f60-4859-8130-273d88c9b9d0-delete_volume" released by "delete_volume" :: held 1.100s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:53:28 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-09d68bb5-c39f-4631-b656-3bebeb6e2930 tempest-ProjectReaderTests-573888410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:53:28 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-09d68bb5-c39f-4631-b656-3bebeb6e2930 tempest-ProjectReaderTests-573888410 None] Flow 'volume_create_manager' (efaa07d4-68b1-44e7-9e9e-02bb8006dec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:53:28 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-09d68bb5-c39f-4631-b656-3bebeb6e2930 tempest-ProjectReaderTests-573888410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe81f54c-2ff9-4209-9f97-fd012e30bda2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:53:28 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-09d68bb5-c39f-4631-b656-3bebeb6e2930 tempest-ProjectReaderTests-573888410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe81f54c-2ff9-4209-9f97-fd012e30bda2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:53:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1414274628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e5e4023-7ef9-4332-80c3-6ff411cc36e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a021bd4772d4768b94a259c5b6a1bef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:53:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:53:29Z,use_quota=True,user_id='dbbd83cbf1e54fefb96f3d25fb8036e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:53:28 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-09d68bb5-c39f-4631-b656-3bebeb6e2930 tempest-ProjectReaderTests-573888410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf86b9ae-79e5-406a-b5bc-058547d7e239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:53:28 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-09d68bb5-c39f-4631-b656-3bebeb6e2930 tempest-ProjectReaderTests-573888410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf86b9ae-79e5-406a-b5bc-058547d7e239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:53:28 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-09d68bb5-c39f-4631-b656-3bebeb6e2930 tempest-ProjectReaderTests-573888410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d70ca4eb-fc43-407e-acdf-f5aa2bd19e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:53:28 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-09d68bb5-c39f-4631-b656-3bebeb6e2930 tempest-ProjectReaderTests-573888410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d70ca4eb-fc43-407e-acdf-f5aa2bd19e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e5e4023-7ef9-4332-80c3-6ff411cc36e7', 'volume_name': 'volume-6e5e4023-7ef9-4332-80c3-6ff411cc36e7', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:53:28 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-09d68bb5-c39f-4631-b656-3bebeb6e2930 tempest-ProjectReaderTests-573888410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e7fbaa4-0c34-429b-a899-1729caf43dff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:53:28 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-09d68bb5-c39f-4631-b656-3bebeb6e2930 tempest-ProjectReaderTests-573888410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e7fbaa4-0c34-429b-a899-1729caf43dff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:53:28 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-09d68bb5-c39f-4631-b656-3bebeb6e2930 tempest-ProjectReaderTests-573888410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76d30dfa-4502-41c9-9b58-f82e37ae1c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:53:28 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-09d68bb5-c39f-4631-b656-3bebeb6e2930 tempest-ProjectReaderTests-573888410 None] Volume 6e5e4023-7ef9-4332-80c3-6ff411cc36e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e5e4023-7ef9-4332-80c3-6ff411cc36e7', 'volume_size': 1} Sep 23 14:53:28 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-09d68bb5-c39f-4631-b656-3bebeb6e2930 tempest-ProjectReaderTests-573888410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:53:28 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-09d68bb5-c39f-4631-b656-3bebeb6e2930 tempest-ProjectReaderTests-573888410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:53:28 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-09d68bb5-c39f-4631-b656-3bebeb6e2930 tempest-ProjectReaderTests-573888410 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:53:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1414274628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e5e4023-7ef9-4332-80c3-6ff411cc36e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a021bd4772d4768b94a259c5b6a1bef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:53:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:53:29Z,use_quota=True,user_id='dbbd83cbf1e54fefb96f3d25fb8036e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:53:28 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-09d68bb5-c39f-4631-b656-3bebeb6e2930 tempest-ProjectReaderTests-573888410 None] Creating volume 6e5e4023-7ef9-4332-80c3-6ff411cc36e7 {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:53:28 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-09d68bb5-c39f-4631-b656-3bebeb6e2930 tempest-ProjectReaderTests-573888410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:53:28 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-09d68bb5-c39f-4631-b656-3bebeb6e2930 tempest-ProjectReaderTests-573888410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:53:28 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-09d68bb5-c39f-4631-b656-3bebeb6e2930 tempest-ProjectReaderTests-573888410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:53:28 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-09d68bb5-c39f-4631-b656-3bebeb6e2930 tempest-ProjectReaderTests-573888410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:53:28 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-09d68bb5-c39f-4631-b656-3bebeb6e2930 tempest-ProjectReaderTests-573888410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:53:28 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-09d68bb5-c39f-4631-b656-3bebeb6e2930 tempest-ProjectReaderTests-573888410 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:53:28 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-09d68bb5-c39f-4631-b656-3bebeb6e2930 tempest-ProjectReaderTests-573888410 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:53:28 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-09d68bb5-c39f-4631-b656-3bebeb6e2930 tempest-ProjectReaderTests-573888410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6e5e4023-7ef9-4332-80c3-6ff411cc36e7 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:53:28 devstack sudo[105540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6e5e4023-7ef9-4332-80c3-6ff411cc36e7 1073741824 Sep 23 14:53:28 devstack sudo[105540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:53:29 devstack sudo[105540]: pam_unix(sudo:session): session closed for user root Sep 23 14:53:29 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-09d68bb5-c39f-4631-b656-3bebeb6e2930 tempest-ProjectReaderTests-573888410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6e5e4023-7ef9-4332-80c3-6ff411cc36e7 1073741824" returned: 0 in 0.396s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:53:29 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-09d68bb5-c39f-4631-b656-3bebeb6e2930 tempest-ProjectReaderTests-573888410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6e5e4023-7ef9-4332-80c3-6ff411cc36e7 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:53:29 devstack sudo[105545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6e5e4023-7ef9-4332-80c3-6ff411cc36e7 Sep 23 14:53:29 devstack sudo[105545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:53:29 devstack sudo[105545]: pam_unix(sudo:session): session closed for user root Sep 23 14:53:29 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-09d68bb5-c39f-4631-b656-3bebeb6e2930 tempest-ProjectReaderTests-573888410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6e5e4023-7ef9-4332-80c3-6ff411cc36e7" returned: 0 in 0.253s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:53:29 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-09d68bb5-c39f-4631-b656-3bebeb6e2930 tempest-ProjectReaderTests-573888410 None] <== create_volume: return (687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:53:29 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-09d68bb5-c39f-4631-b656-3bebeb6e2930 tempest-ProjectReaderTests-573888410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.689s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:53:29 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-09d68bb5-c39f-4631-b656-3bebeb6e2930 tempest-ProjectReaderTests-573888410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76d30dfa-4502-41c9-9b58-f82e37ae1c92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e5e4023-7ef9-4332-80c3-6ff411cc36e7', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:53:29 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-09d68bb5-c39f-4631-b656-3bebeb6e2930 tempest-ProjectReaderTests-573888410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e04ba5d-bd02-484c-ade8-8981dee2658e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:53:29 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-09d68bb5-c39f-4631-b656-3bebeb6e2930 tempest-ProjectReaderTests-573888410 None] Volume volume-6e5e4023-7ef9-4332-80c3-6ff411cc36e7 (6e5e4023-7ef9-4332-80c3-6ff411cc36e7): created successfully Sep 23 14:53:29 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-09d68bb5-c39f-4631-b656-3bebeb6e2930 tempest-ProjectReaderTests-573888410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e04ba5d-bd02-484c-ade8-8981dee2658e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:53:29 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-09d68bb5-c39f-4631-b656-3bebeb6e2930 tempest-ProjectReaderTests-573888410 None] Flow 'volume_create_manager' (efaa07d4-68b1-44e7-9e9e-02bb8006dec1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:53:29 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-09d68bb5-c39f-4631-b656-3bebeb6e2930 tempest-ProjectReaderTests-573888410 None] Created volume successfully. Sep 23 14:53:29 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-59937180-0016-4710-80e1-bd615ce4181b tempest-ProjectReaderTests-573888410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:53:29 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-59937180-0016-4710-80e1-bd615ce4181b tempest-ProjectReaderTests-573888410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:53:29 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-59937180-0016-4710-80e1-bd615ce4181b tempest-ProjectReaderTests-573888410 None] Creating offline snapshot ffe52e21-cddb-4d8d-9389-fbcaff3e96ad of volume 6e5e4023-7ef9-4332-80c3-6ff411cc36e7 {{(pid=86310) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 14:53:29 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb7d7ae0-3869-459f-8976-bba41cc66ad2]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:53:29 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-59937180-0016-4710-80e1-bd615ce4181b tempest-ProjectReaderTests-573888410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6e5e4023-7ef9-4332-80c3-6ff411cc36e7 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:53:29 devstack sudo[105584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6e5e4023-7ef9-4332-80c3-6ff411cc36e7 Sep 23 14:53:29 devstack sudo[105584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:53:30 devstack sudo[105584]: pam_unix(sudo:session): session closed for user root Sep 23 14:53:30 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-59937180-0016-4710-80e1-bd615ce4181b tempest-ProjectReaderTests-573888410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6e5e4023-7ef9-4332-80c3-6ff411cc36e7" returned: 0 in 0.371s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:53:30 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-59937180-0016-4710-80e1-bd615ce4181b tempest-ProjectReaderTests-573888410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6e5e4023-7ef9-4332-80c3-6ff411cc36e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6e5e4023-7ef9-4332-80c3-6ff411cc36e7.ffe52e21-cddb-4d8d-9389-fbcaff3e96ad 1G {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:53:30 devstack sudo[105589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6e5e4023-7ef9-4332-80c3-6ff411cc36e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6e5e4023-7ef9-4332-80c3-6ff411cc36e7.ffe52e21-cddb-4d8d-9389-fbcaff3e96ad 1G Sep 23 14:53:30 devstack sudo[105589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:53:30 devstack sudo[105589]: pam_unix(sudo:session): session closed for user root Sep 23 14:53:30 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-59937180-0016-4710-80e1-bd615ce4181b tempest-ProjectReaderTests-573888410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6e5e4023-7ef9-4332-80c3-6ff411cc36e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6e5e4023-7ef9-4332-80c3-6ff411cc36e7.ffe52e21-cddb-4d8d-9389-fbcaff3e96ad 1G" returned: 0 in 0.408s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:53:30 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-59937180-0016-4710-80e1-bd615ce4181b tempest-ProjectReaderTests-573888410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e5e4023-7ef9-4332-80c3-6ff411cc36e7 -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6e5e4023-7ef9-4332-80c3-6ff411cc36e7.ffe52e21-cddb-4d8d-9389-fbcaff3e96ad {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:53:30 devstack sudo[105594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e5e4023-7ef9-4332-80c3-6ff411cc36e7 -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6e5e4023-7ef9-4332-80c3-6ff411cc36e7.ffe52e21-cddb-4d8d-9389-fbcaff3e96ad Sep 23 14:53:30 devstack sudo[105594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:53:30 devstack sudo[105594]: pam_unix(sudo:session): session closed for user root Sep 23 14:53:30 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-59937180-0016-4710-80e1-bd615ce4181b tempest-ProjectReaderTests-573888410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e5e4023-7ef9-4332-80c3-6ff411cc36e7 -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6e5e4023-7ef9-4332-80c3-6ff411cc36e7.ffe52e21-cddb-4d8d-9389-fbcaff3e96ad" returned: 0 in 0.297s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:53:30 devstack cinder-volume[86310]: WARNING cinder.volume.drivers.remotefs [None req-59937180-0016-4710-80e1-bd615ce4181b tempest-ProjectReaderTests-573888410 None] /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6e5e4023-7ef9-4332-80c3-6ff411cc36e7.ffe52e21-cddb-4d8d-9389-fbcaff3e96ad is being set with open permissions: ugo+rw Sep 23 14:53:30 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-59937180-0016-4710-80e1-bd615ce4181b tempest-ProjectReaderTests-573888410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6e5e4023-7ef9-4332-80c3-6ff411cc36e7.ffe52e21-cddb-4d8d-9389-fbcaff3e96ad {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:53:30 devstack sudo[105599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6e5e4023-7ef9-4332-80c3-6ff411cc36e7.ffe52e21-cddb-4d8d-9389-fbcaff3e96ad Sep 23 14:53:30 devstack sudo[105599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:53:31 devstack sudo[105599]: pam_unix(sudo:session): session closed for user root Sep 23 14:53:31 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-59937180-0016-4710-80e1-bd615ce4181b tempest-ProjectReaderTests-573888410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6e5e4023-7ef9-4332-80c3-6ff411cc36e7.ffe52e21-cddb-4d8d-9389-fbcaff3e96ad" returned: 0 in 0.234s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:53:31 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-59937180-0016-4710-80e1-bd615ce4181b tempest-ProjectReaderTests-573888410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6e5e4023-7ef9-4332-80c3-6ff411cc36e7.info {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:53:31 devstack sudo[105602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6e5e4023-7ef9-4332-80c3-6ff411cc36e7.info Sep 23 14:53:31 devstack sudo[105602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:53:31 devstack sudo[105602]: pam_unix(sudo:session): session closed for user root Sep 23 14:53:31 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-59937180-0016-4710-80e1-bd615ce4181b tempest-ProjectReaderTests-573888410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6e5e4023-7ef9-4332-80c3-6ff411cc36e7.info" returned: 0 in 0.243s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:53:31 devstack cinder-volume[86310]: WARNING cinder.volume.drivers.remotefs [None req-59937180-0016-4710-80e1-bd615ce4181b tempest-ProjectReaderTests-573888410 None] /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6e5e4023-7ef9-4332-80c3-6ff411cc36e7.info is being set with open permissions: ugo+rw Sep 23 14:53:31 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-59937180-0016-4710-80e1-bd615ce4181b tempest-ProjectReaderTests-573888410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6e5e4023-7ef9-4332-80c3-6ff411cc36e7.info {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:53:31 devstack sudo[105605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6e5e4023-7ef9-4332-80c3-6ff411cc36e7.info Sep 23 14:53:31 devstack sudo[105605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:53:31 devstack sudo[105605]: pam_unix(sudo:session): session closed for user root Sep 23 14:53:31 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-59937180-0016-4710-80e1-bd615ce4181b tempest-ProjectReaderTests-573888410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6e5e4023-7ef9-4332-80c3-6ff411cc36e7.info" returned: 0 in 0.232s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:53:31 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-59937180-0016-4710-80e1-bd615ce4181b tempest-ProjectReaderTests-573888410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.865s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:53:31 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-59937180-0016-4710-80e1-bd615ce4181b tempest-ProjectReaderTests-573888410 None] Create snapshot completed successfully Sep 23 14:53:31 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-a1231283-e33c-43a5-8c1a-f6c45868f5be tempest-ProjectReaderTests-573888410 None] Acquiring lock "cinder-ffe52e21-cddb-4d8d-9389-fbcaff3e96ad-delete_snapshot" by "delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:53:31 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-a1231283-e33c-43a5-8c1a-f6c45868f5be tempest-ProjectReaderTests-573888410 None] Lock "cinder-ffe52e21-cddb-4d8d-9389-fbcaff3e96ad-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:53:31 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-a1231283-e33c-43a5-8c1a-f6c45868f5be tempest-ProjectReaderTests-573888410 None] Acquiring lock "cinder-quobyte-6e5e4023-7ef9-4332-80c3-6ff411cc36e7" by "delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:53:31 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-a1231283-e33c-43a5-8c1a-f6c45868f5be tempest-ProjectReaderTests-573888410 None] Lock "cinder-quobyte-6e5e4023-7ef9-4332-80c3-6ff411cc36e7" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:53:31 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-a1231283-e33c-43a5-8c1a-f6c45868f5be tempest-ProjectReaderTests-573888410 None] Acquiring lock "cinder-quobyte-ffe52e21-cddb-4d8d-9389-fbcaff3e96ad" by "_delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:53:31 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-a1231283-e33c-43a5-8c1a-f6c45868f5be tempest-ProjectReaderTests-573888410 None] Lock "cinder-quobyte-ffe52e21-cddb-4d8d-9389-fbcaff3e96ad" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:53:31 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-a1231283-e33c-43a5-8c1a-f6c45868f5be tempest-ProjectReaderTests-573888410 None] Deleting offline snapshot ffe52e21-cddb-4d8d-9389-fbcaff3e96ad of volume 6e5e4023-7ef9-4332-80c3-6ff411cc36e7 {{(pid=86310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 14:53:32 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-a1231283-e33c-43a5-8c1a-f6c45868f5be tempest-ProjectReaderTests-573888410 None] snapshot_file for this snap is: volume-6e5e4023-7ef9-4332-80c3-6ff411cc36e7.ffe52e21-cddb-4d8d-9389-fbcaff3e96ad {{(pid=86310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 14:53:32 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7148377-9dc8-473f-8c5f-fd4b5d2f5229]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:53:32 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a1231283-e33c-43a5-8c1a-f6c45868f5be tempest-ProjectReaderTests-573888410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6e5e4023-7ef9-4332-80c3-6ff411cc36e7.ffe52e21-cddb-4d8d-9389-fbcaff3e96ad {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:53:32 devstack sudo[105608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6e5e4023-7ef9-4332-80c3-6ff411cc36e7.ffe52e21-cddb-4d8d-9389-fbcaff3e96ad Sep 23 14:53:32 devstack sudo[105608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:53:32 devstack sudo[105608]: pam_unix(sudo:session): session closed for user root Sep 23 14:53:32 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a1231283-e33c-43a5-8c1a-f6c45868f5be tempest-ProjectReaderTests-573888410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6e5e4023-7ef9-4332-80c3-6ff411cc36e7.ffe52e21-cddb-4d8d-9389-fbcaff3e96ad" returned: 0 in 0.340s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:53:32 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-a1231283-e33c-43a5-8c1a-f6c45868f5be tempest-ProjectReaderTests-573888410 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e5e4023-7ef9-4332-80c3-6ff411cc36e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 14:53:32 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd1f8811-9dea-4f44-9d75-4eaf81500f50]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:53:32 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a1231283-e33c-43a5-8c1a-f6c45868f5be tempest-ProjectReaderTests-573888410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6e5e4023-7ef9-4332-80c3-6ff411cc36e7 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:53:32 devstack sudo[105613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6e5e4023-7ef9-4332-80c3-6ff411cc36e7 Sep 23 14:53:32 devstack sudo[105613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:53:32 devstack sudo[105613]: pam_unix(sudo:session): session closed for user root Sep 23 14:53:32 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a1231283-e33c-43a5-8c1a-f6c45868f5be tempest-ProjectReaderTests-573888410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6e5e4023-7ef9-4332-80c3-6ff411cc36e7" returned: 0 in 0.340s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:53:32 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a1231283-e33c-43a5-8c1a-f6c45868f5be tempest-ProjectReaderTests-573888410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6e5e4023-7ef9-4332-80c3-6ff411cc36e7.ffe52e21-cddb-4d8d-9389-fbcaff3e96ad {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:53:32 devstack sudo[105618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6e5e4023-7ef9-4332-80c3-6ff411cc36e7.ffe52e21-cddb-4d8d-9389-fbcaff3e96ad Sep 23 14:53:32 devstack sudo[105618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:53:33 devstack sudo[105618]: pam_unix(sudo:session): session closed for user root Sep 23 14:53:33 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a1231283-e33c-43a5-8c1a-f6c45868f5be tempest-ProjectReaderTests-573888410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6e5e4023-7ef9-4332-80c3-6ff411cc36e7.ffe52e21-cddb-4d8d-9389-fbcaff3e96ad" returned: 0 in 0.334s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:53:33 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a1231283-e33c-43a5-8c1a-f6c45868f5be tempest-ProjectReaderTests-573888410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6e5e4023-7ef9-4332-80c3-6ff411cc36e7.ffe52e21-cddb-4d8d-9389-fbcaff3e96ad {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:53:33 devstack sudo[105625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6e5e4023-7ef9-4332-80c3-6ff411cc36e7.ffe52e21-cddb-4d8d-9389-fbcaff3e96ad Sep 23 14:53:33 devstack sudo[105625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:53:33 devstack sudo[105625]: pam_unix(sudo:session): session closed for user root Sep 23 14:53:33 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-a1231283-e33c-43a5-8c1a-f6c45868f5be tempest-ProjectReaderTests-573888410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6e5e4023-7ef9-4332-80c3-6ff411cc36e7.ffe52e21-cddb-4d8d-9389-fbcaff3e96ad" returned: 0 in 0.249s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:53:33 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-a1231283-e33c-43a5-8c1a-f6c45868f5be tempest-ProjectReaderTests-573888410 None] Lock "cinder-quobyte-ffe52e21-cddb-4d8d-9389-fbcaff3e96ad" released by "_delete_snapshot" :: held 1.366s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:53:33 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-a1231283-e33c-43a5-8c1a-f6c45868f5be tempest-ProjectReaderTests-573888410 None] Lock "cinder-quobyte-6e5e4023-7ef9-4332-80c3-6ff411cc36e7" released by "delete_snapshot" :: held 1.388s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:53:33 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-a1231283-e33c-43a5-8c1a-f6c45868f5be tempest-ProjectReaderTests-573888410 None] Created reservations ['bb9f9a73-cb62-4078-a2bb-3781d6fc7847', '34c3289e-f5c7-4dca-b200-9bbf32d7ec19', '01063796-8761-41ff-a92e-9819db3fc30e', '7c3b688c-9033-436a-8c17-2734d4577a9d'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:53:33 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-a1231283-e33c-43a5-8c1a-f6c45868f5be tempest-ProjectReaderTests-573888410 None] Delete snapshot completed successfully. Sep 23 14:53:33 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-a1231283-e33c-43a5-8c1a-f6c45868f5be tempest-ProjectReaderTests-573888410 None] Lock "cinder-ffe52e21-cddb-4d8d-9389-fbcaff3e96ad-delete_snapshot" released by "delete_snapshot" :: held 1.517s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:53:34 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-8d97ee4f-afe3-463e-ae4e-3b1dceb0a2ca tempest-ProjectReaderTests-573888410 None] Acquiring lock "cinder-6e5e4023-7ef9-4332-80c3-6ff411cc36e7-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:53:34 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-8d97ee4f-afe3-463e-ae4e-3b1dceb0a2ca tempest-ProjectReaderTests-573888410 None] Lock "cinder-6e5e4023-7ef9-4332-80c3-6ff411cc36e7-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:53:34 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-8d97ee4f-afe3-463e-ae4e-3b1dceb0a2ca tempest-ProjectReaderTests-573888410 None] Acquiring lock "cinder-quobyte-6e5e4023-7ef9-4332-80c3-6ff411cc36e7" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:53:34 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-8d97ee4f-afe3-463e-ae4e-3b1dceb0a2ca tempest-ProjectReaderTests-573888410 None] Lock "cinder-quobyte-6e5e4023-7ef9-4332-80c3-6ff411cc36e7" acquired by "delete_volume" :: waited 0.015s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:53:34 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[678e2ce2-5d97-4d41-8c83-ef034c164d07]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:53:34 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8d97ee4f-afe3-463e-ae4e-3b1dceb0a2ca tempest-ProjectReaderTests-573888410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6e5e4023-7ef9-4332-80c3-6ff411cc36e7 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:53:34 devstack sudo[105628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6e5e4023-7ef9-4332-80c3-6ff411cc36e7 Sep 23 14:53:34 devstack sudo[105628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:53:34 devstack sudo[105628]: pam_unix(sudo:session): session closed for user root Sep 23 14:53:34 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8d97ee4f-afe3-463e-ae4e-3b1dceb0a2ca tempest-ProjectReaderTests-573888410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6e5e4023-7ef9-4332-80c3-6ff411cc36e7" returned: 0 in 0.346s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:53:34 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8d97ee4f-afe3-463e-ae4e-3b1dceb0a2ca tempest-ProjectReaderTests-573888410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6e5e4023-7ef9-4332-80c3-6ff411cc36e7 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:53:34 devstack sudo[105639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6e5e4023-7ef9-4332-80c3-6ff411cc36e7 Sep 23 14:53:34 devstack sudo[105639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:53:34 devstack sudo[105639]: pam_unix(sudo:session): session closed for user root Sep 23 14:53:34 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8d97ee4f-afe3-463e-ae4e-3b1dceb0a2ca tempest-ProjectReaderTests-573888410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-6e5e4023-7ef9-4332-80c3-6ff411cc36e7" returned: 0 in 0.257s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:53:34 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-8d97ee4f-afe3-463e-ae4e-3b1dceb0a2ca tempest-ProjectReaderTests-573888410 None] Lock "cinder-quobyte-6e5e4023-7ef9-4332-80c3-6ff411cc36e7" released by "delete_volume" :: held 0.667s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:53:34 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-8d97ee4f-afe3-463e-ae4e-3b1dceb0a2ca tempest-ProjectReaderTests-573888410 None] Created reservations ['136d5d67-2c5b-4661-8e02-c478f51b4022', '58a719ee-db03-4b39-ac99-e6e00ad8a4ae', '6c896e52-bd48-4b99-a94e-32f0fdf8f22b', '91dc060d-cba9-4b76-b3b2-2ba4b462bc27'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:53:34 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-8d97ee4f-afe3-463e-ae4e-3b1dceb0a2ca tempest-ProjectReaderTests-573888410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:53:34 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-8d97ee4f-afe3-463e-ae4e-3b1dceb0a2ca tempest-ProjectReaderTests-573888410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:53:34 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-8d97ee4f-afe3-463e-ae4e-3b1dceb0a2ca tempest-ProjectReaderTests-573888410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:53:34 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-8d97ee4f-afe3-463e-ae4e-3b1dceb0a2ca tempest-ProjectReaderTests-573888410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:53:34 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-8d97ee4f-afe3-463e-ae4e-3b1dceb0a2ca tempest-ProjectReaderTests-573888410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:53:34 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8d97ee4f-afe3-463e-ae4e-3b1dceb0a2ca tempest-ProjectReaderTests-573888410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:53:34 devstack sudo[105642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:53:34 devstack sudo[105642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:53:35 devstack sudo[105642]: pam_unix(sudo:session): session closed for user root Sep 23 14:53:35 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-8d97ee4f-afe3-463e-ae4e-3b1dceb0a2ca tempest-ProjectReaderTests-573888410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.245s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:53:35 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-8d97ee4f-afe3-463e-ae4e-3b1dceb0a2ca tempest-ProjectReaderTests-573888410 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:53:35 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-8d97ee4f-afe3-463e-ae4e-3b1dceb0a2ca tempest-ProjectReaderTests-573888410 None] Deleted volume successfully. Sep 23 14:53:35 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-8d97ee4f-afe3-463e-ae4e-3b1dceb0a2ca tempest-ProjectReaderTests-573888410 None] Lock "cinder-6e5e4023-7ef9-4332-80c3-6ff411cc36e7-delete_volume" released by "delete_volume" :: held 1.114s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:53:35 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8b66202-156f-47a1-af14-c3b9f4fd8bf6 tempest-ProjectReaderTests-573888410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:53:35 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-d8b66202-156f-47a1-af14-c3b9f4fd8bf6 tempest-ProjectReaderTests-573888410 None] Flow 'volume_create_manager' (e7165254-504a-47a1-88ea-9a787acb7e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:53:35 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-d8b66202-156f-47a1-af14-c3b9f4fd8bf6 tempest-ProjectReaderTests-573888410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5468b53-8c5a-41c8-8f45-7913af9fbe83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:53:35 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-d8b66202-156f-47a1-af14-c3b9f4fd8bf6 tempest-ProjectReaderTests-573888410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5468b53-8c5a-41c8-8f45-7913af9fbe83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:53:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-463167311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56e1637b-9c54-4405-8b2b-e461c0e67548,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a021bd4772d4768b94a259c5b6a1bef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:53:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:53:36Z,use_quota=True,user_id='dbbd83cbf1e54fefb96f3d25fb8036e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:53:35 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-d8b66202-156f-47a1-af14-c3b9f4fd8bf6 tempest-ProjectReaderTests-573888410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9bd0fe3-9cf2-462f-ab7f-dc8b4e39ca34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:53:35 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-d8b66202-156f-47a1-af14-c3b9f4fd8bf6 tempest-ProjectReaderTests-573888410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9bd0fe3-9cf2-462f-ab7f-dc8b4e39ca34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:53:35 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-d8b66202-156f-47a1-af14-c3b9f4fd8bf6 tempest-ProjectReaderTests-573888410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3e6761c-399f-40f8-826f-0d742063807c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:53:35 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-d8b66202-156f-47a1-af14-c3b9f4fd8bf6 tempest-ProjectReaderTests-573888410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3e6761c-399f-40f8-826f-0d742063807c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56e1637b-9c54-4405-8b2b-e461c0e67548', 'volume_name': 'volume-56e1637b-9c54-4405-8b2b-e461c0e67548', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:53:35 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-d8b66202-156f-47a1-af14-c3b9f4fd8bf6 tempest-ProjectReaderTests-573888410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89a17df6-2b62-48e0-a188-b856dcf502e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:53:35 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-d8b66202-156f-47a1-af14-c3b9f4fd8bf6 tempest-ProjectReaderTests-573888410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89a17df6-2b62-48e0-a188-b856dcf502e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:53:35 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-d8b66202-156f-47a1-af14-c3b9f4fd8bf6 tempest-ProjectReaderTests-573888410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f8b82af-75d4-4a67-b94c-616c404924d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:53:35 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-d8b66202-156f-47a1-af14-c3b9f4fd8bf6 tempest-ProjectReaderTests-573888410 None] Volume 56e1637b-9c54-4405-8b2b-e461c0e67548: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56e1637b-9c54-4405-8b2b-e461c0e67548', 'volume_size': 1} Sep 23 14:53:35 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-d8b66202-156f-47a1-af14-c3b9f4fd8bf6 tempest-ProjectReaderTests-573888410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:53:35 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-d8b66202-156f-47a1-af14-c3b9f4fd8bf6 tempest-ProjectReaderTests-573888410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:53:35 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-d8b66202-156f-47a1-af14-c3b9f4fd8bf6 tempest-ProjectReaderTests-573888410 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:53:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-463167311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56e1637b-9c54-4405-8b2b-e461c0e67548,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a021bd4772d4768b94a259c5b6a1bef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:53:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:53:36Z,use_quota=True,user_id='dbbd83cbf1e54fefb96f3d25fb8036e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:53:35 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-d8b66202-156f-47a1-af14-c3b9f4fd8bf6 tempest-ProjectReaderTests-573888410 None] Creating volume 56e1637b-9c54-4405-8b2b-e461c0e67548 {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:53:35 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-d8b66202-156f-47a1-af14-c3b9f4fd8bf6 tempest-ProjectReaderTests-573888410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:53:35 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-d8b66202-156f-47a1-af14-c3b9f4fd8bf6 tempest-ProjectReaderTests-573888410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:53:35 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-d8b66202-156f-47a1-af14-c3b9f4fd8bf6 tempest-ProjectReaderTests-573888410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:53:35 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-d8b66202-156f-47a1-af14-c3b9f4fd8bf6 tempest-ProjectReaderTests-573888410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:53:35 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-d8b66202-156f-47a1-af14-c3b9f4fd8bf6 tempest-ProjectReaderTests-573888410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:53:35 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-d8b66202-156f-47a1-af14-c3b9f4fd8bf6 tempest-ProjectReaderTests-573888410 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:53:35 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-d8b66202-156f-47a1-af14-c3b9f4fd8bf6 tempest-ProjectReaderTests-573888410 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:53:35 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d8b66202-156f-47a1-af14-c3b9f4fd8bf6 tempest-ProjectReaderTests-573888410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-56e1637b-9c54-4405-8b2b-e461c0e67548 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:53:35 devstack sudo[105645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-56e1637b-9c54-4405-8b2b-e461c0e67548 1073741824 Sep 23 14:53:35 devstack sudo[105645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:53:36 devstack sudo[105645]: pam_unix(sudo:session): session closed for user root Sep 23 14:53:36 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d8b66202-156f-47a1-af14-c3b9f4fd8bf6 tempest-ProjectReaderTests-573888410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-56e1637b-9c54-4405-8b2b-e461c0e67548 1073741824" returned: 0 in 0.411s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:53:36 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d8b66202-156f-47a1-af14-c3b9f4fd8bf6 tempest-ProjectReaderTests-573888410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-56e1637b-9c54-4405-8b2b-e461c0e67548 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:53:36 devstack sudo[105650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-56e1637b-9c54-4405-8b2b-e461c0e67548 Sep 23 14:53:36 devstack sudo[105650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:53:36 devstack sudo[105650]: pam_unix(sudo:session): session closed for user root Sep 23 14:53:36 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-d8b66202-156f-47a1-af14-c3b9f4fd8bf6 tempest-ProjectReaderTests-573888410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-56e1637b-9c54-4405-8b2b-e461c0e67548" returned: 0 in 0.254s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:53:36 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-d8b66202-156f-47a1-af14-c3b9f4fd8bf6 tempest-ProjectReaderTests-573888410 None] <== create_volume: return (705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:53:36 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-d8b66202-156f-47a1-af14-c3b9f4fd8bf6 tempest-ProjectReaderTests-573888410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.708s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:53:36 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-d8b66202-156f-47a1-af14-c3b9f4fd8bf6 tempest-ProjectReaderTests-573888410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f8b82af-75d4-4a67-b94c-616c404924d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56e1637b-9c54-4405-8b2b-e461c0e67548', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:53:36 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-d8b66202-156f-47a1-af14-c3b9f4fd8bf6 tempest-ProjectReaderTests-573888410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f90cb6d2-57dd-42c1-b950-e6a105d1dfb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:53:36 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-d8b66202-156f-47a1-af14-c3b9f4fd8bf6 tempest-ProjectReaderTests-573888410 None] Volume volume-56e1637b-9c54-4405-8b2b-e461c0e67548 (56e1637b-9c54-4405-8b2b-e461c0e67548): created successfully Sep 23 14:53:36 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-d8b66202-156f-47a1-af14-c3b9f4fd8bf6 tempest-ProjectReaderTests-573888410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f90cb6d2-57dd-42c1-b950-e6a105d1dfb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:53:36 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-d8b66202-156f-47a1-af14-c3b9f4fd8bf6 tempest-ProjectReaderTests-573888410 None] Flow 'volume_create_manager' (e7165254-504a-47a1-88ea-9a787acb7e1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:53:36 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-d8b66202-156f-47a1-af14-c3b9f4fd8bf6 tempest-ProjectReaderTests-573888410 None] Created volume successfully. Sep 23 14:53:36 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-3fc0c5b7-672d-46f4-bdb4-f5aac61b1b32 tempest-ProjectReaderTests-573888410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:53:36 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-3fc0c5b7-672d-46f4-bdb4-f5aac61b1b32 tempest-ProjectReaderTests-573888410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:53:36 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-3fc0c5b7-672d-46f4-bdb4-f5aac61b1b32 tempest-ProjectReaderTests-573888410 None] Creating offline snapshot d93a9257-db87-40e1-a36f-794b1dfa3f87 of volume 56e1637b-9c54-4405-8b2b-e461c0e67548 {{(pid=86310) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 14:53:36 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8f1875c-3c4c-470e-83f7-8df1b0f52b30]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:53:36 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-3fc0c5b7-672d-46f4-bdb4-f5aac61b1b32 tempest-ProjectReaderTests-573888410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-56e1637b-9c54-4405-8b2b-e461c0e67548 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:53:36 devstack sudo[105653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-56e1637b-9c54-4405-8b2b-e461c0e67548 Sep 23 14:53:36 devstack sudo[105653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:53:37 devstack sudo[105653]: pam_unix(sudo:session): session closed for user root Sep 23 14:53:37 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-3fc0c5b7-672d-46f4-bdb4-f5aac61b1b32 tempest-ProjectReaderTests-573888410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-56e1637b-9c54-4405-8b2b-e461c0e67548" returned: 0 in 0.340s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:53:37 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-3fc0c5b7-672d-46f4-bdb4-f5aac61b1b32 tempest-ProjectReaderTests-573888410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-56e1637b-9c54-4405-8b2b-e461c0e67548,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-56e1637b-9c54-4405-8b2b-e461c0e67548.d93a9257-db87-40e1-a36f-794b1dfa3f87 1G {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:53:37 devstack sudo[105658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-56e1637b-9c54-4405-8b2b-e461c0e67548,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-56e1637b-9c54-4405-8b2b-e461c0e67548.d93a9257-db87-40e1-a36f-794b1dfa3f87 1G Sep 23 14:53:37 devstack sudo[105658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:53:37 devstack sudo[105658]: pam_unix(sudo:session): session closed for user root Sep 23 14:53:37 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-3fc0c5b7-672d-46f4-bdb4-f5aac61b1b32 tempest-ProjectReaderTests-573888410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-56e1637b-9c54-4405-8b2b-e461c0e67548,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-56e1637b-9c54-4405-8b2b-e461c0e67548.d93a9257-db87-40e1-a36f-794b1dfa3f87 1G" returned: 0 in 0.374s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:53:37 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-3fc0c5b7-672d-46f4-bdb4-f5aac61b1b32 tempest-ProjectReaderTests-573888410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56e1637b-9c54-4405-8b2b-e461c0e67548 -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-56e1637b-9c54-4405-8b2b-e461c0e67548.d93a9257-db87-40e1-a36f-794b1dfa3f87 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:53:37 devstack sudo[105663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56e1637b-9c54-4405-8b2b-e461c0e67548 -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-56e1637b-9c54-4405-8b2b-e461c0e67548.d93a9257-db87-40e1-a36f-794b1dfa3f87 Sep 23 14:53:37 devstack sudo[105663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:53:37 devstack sudo[105663]: pam_unix(sudo:session): session closed for user root Sep 23 14:53:37 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-3fc0c5b7-672d-46f4-bdb4-f5aac61b1b32 tempest-ProjectReaderTests-573888410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56e1637b-9c54-4405-8b2b-e461c0e67548 -F qcow2 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-56e1637b-9c54-4405-8b2b-e461c0e67548.d93a9257-db87-40e1-a36f-794b1dfa3f87" returned: 0 in 0.299s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:53:37 devstack cinder-volume[86310]: WARNING cinder.volume.drivers.remotefs [None req-3fc0c5b7-672d-46f4-bdb4-f5aac61b1b32 tempest-ProjectReaderTests-573888410 None] /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-56e1637b-9c54-4405-8b2b-e461c0e67548.d93a9257-db87-40e1-a36f-794b1dfa3f87 is being set with open permissions: ugo+rw Sep 23 14:53:37 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-3fc0c5b7-672d-46f4-bdb4-f5aac61b1b32 tempest-ProjectReaderTests-573888410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-56e1637b-9c54-4405-8b2b-e461c0e67548.d93a9257-db87-40e1-a36f-794b1dfa3f87 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:53:37 devstack sudo[105669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-56e1637b-9c54-4405-8b2b-e461c0e67548.d93a9257-db87-40e1-a36f-794b1dfa3f87 Sep 23 14:53:37 devstack sudo[105669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:53:38 devstack sudo[105669]: pam_unix(sudo:session): session closed for user root Sep 23 14:53:38 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-3fc0c5b7-672d-46f4-bdb4-f5aac61b1b32 tempest-ProjectReaderTests-573888410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-56e1637b-9c54-4405-8b2b-e461c0e67548.d93a9257-db87-40e1-a36f-794b1dfa3f87" returned: 0 in 0.253s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:53:38 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-3fc0c5b7-672d-46f4-bdb4-f5aac61b1b32 tempest-ProjectReaderTests-573888410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-56e1637b-9c54-4405-8b2b-e461c0e67548.info {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:53:38 devstack sudo[105672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-56e1637b-9c54-4405-8b2b-e461c0e67548.info Sep 23 14:53:38 devstack sudo[105672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:53:38 devstack sudo[105672]: pam_unix(sudo:session): session closed for user root Sep 23 14:53:38 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-3fc0c5b7-672d-46f4-bdb4-f5aac61b1b32 tempest-ProjectReaderTests-573888410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-56e1637b-9c54-4405-8b2b-e461c0e67548.info" returned: 0 in 0.255s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:53:38 devstack cinder-volume[86310]: WARNING cinder.volume.drivers.remotefs [None req-3fc0c5b7-672d-46f4-bdb4-f5aac61b1b32 tempest-ProjectReaderTests-573888410 None] /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-56e1637b-9c54-4405-8b2b-e461c0e67548.info is being set with open permissions: ugo+rw Sep 23 14:53:38 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-3fc0c5b7-672d-46f4-bdb4-f5aac61b1b32 tempest-ProjectReaderTests-573888410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-56e1637b-9c54-4405-8b2b-e461c0e67548.info {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:53:38 devstack sudo[105675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-56e1637b-9c54-4405-8b2b-e461c0e67548.info Sep 23 14:53:38 devstack sudo[105675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:53:38 devstack sudo[105675]: pam_unix(sudo:session): session closed for user root Sep 23 14:53:38 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-3fc0c5b7-672d-46f4-bdb4-f5aac61b1b32 tempest-ProjectReaderTests-573888410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-56e1637b-9c54-4405-8b2b-e461c0e67548.info" returned: 0 in 0.243s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:53:38 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-3fc0c5b7-672d-46f4-bdb4-f5aac61b1b32 tempest-ProjectReaderTests-573888410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.850s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:53:38 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-3fc0c5b7-672d-46f4-bdb4-f5aac61b1b32 tempest-ProjectReaderTests-573888410 None] Create snapshot completed successfully Sep 23 14:53:38 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-120c7f69-83e5-439c-bb05-f3749722cc46 tempest-ProjectReaderTests-573888410 None] Acquiring lock "cinder-d93a9257-db87-40e1-a36f-794b1dfa3f87-delete_snapshot" by "delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:53:38 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-120c7f69-83e5-439c-bb05-f3749722cc46 tempest-ProjectReaderTests-573888410 None] Lock "cinder-d93a9257-db87-40e1-a36f-794b1dfa3f87-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:53:38 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-120c7f69-83e5-439c-bb05-f3749722cc46 tempest-ProjectReaderTests-573888410 None] Acquiring lock "cinder-quobyte-56e1637b-9c54-4405-8b2b-e461c0e67548" by "delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:53:39 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-120c7f69-83e5-439c-bb05-f3749722cc46 tempest-ProjectReaderTests-573888410 None] Lock "cinder-quobyte-56e1637b-9c54-4405-8b2b-e461c0e67548" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:53:39 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-120c7f69-83e5-439c-bb05-f3749722cc46 tempest-ProjectReaderTests-573888410 None] Acquiring lock "cinder-quobyte-d93a9257-db87-40e1-a36f-794b1dfa3f87" by "_delete_snapshot" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:53:39 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-120c7f69-83e5-439c-bb05-f3749722cc46 tempest-ProjectReaderTests-573888410 None] Lock "cinder-quobyte-d93a9257-db87-40e1-a36f-794b1dfa3f87" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:53:39 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-120c7f69-83e5-439c-bb05-f3749722cc46 tempest-ProjectReaderTests-573888410 None] Deleting offline snapshot d93a9257-db87-40e1-a36f-794b1dfa3f87 of volume 56e1637b-9c54-4405-8b2b-e461c0e67548 {{(pid=86310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 14:53:39 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-120c7f69-83e5-439c-bb05-f3749722cc46 tempest-ProjectReaderTests-573888410 None] snapshot_file for this snap is: volume-56e1637b-9c54-4405-8b2b-e461c0e67548.d93a9257-db87-40e1-a36f-794b1dfa3f87 {{(pid=86310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 14:53:39 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f1cd8c8-2698-42ff-b3d0-9fd9aa8d9c4b]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:53:39 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-120c7f69-83e5-439c-bb05-f3749722cc46 tempest-ProjectReaderTests-573888410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-56e1637b-9c54-4405-8b2b-e461c0e67548.d93a9257-db87-40e1-a36f-794b1dfa3f87 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:53:39 devstack sudo[105678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-56e1637b-9c54-4405-8b2b-e461c0e67548.d93a9257-db87-40e1-a36f-794b1dfa3f87 Sep 23 14:53:39 devstack sudo[105678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:53:39 devstack sudo[105678]: pam_unix(sudo:session): session closed for user root Sep 23 14:53:39 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-120c7f69-83e5-439c-bb05-f3749722cc46 tempest-ProjectReaderTests-573888410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-56e1637b-9c54-4405-8b2b-e461c0e67548.d93a9257-db87-40e1-a36f-794b1dfa3f87" returned: 0 in 0.339s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:53:39 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-120c7f69-83e5-439c-bb05-f3749722cc46 tempest-ProjectReaderTests-573888410 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-56e1637b-9c54-4405-8b2b-e461c0e67548(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 14:53:39 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[775f5743-718e-4bbe-aab9-0b274cdc36db]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:53:39 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-120c7f69-83e5-439c-bb05-f3749722cc46 tempest-ProjectReaderTests-573888410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-56e1637b-9c54-4405-8b2b-e461c0e67548 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:53:39 devstack sudo[105683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-56e1637b-9c54-4405-8b2b-e461c0e67548 Sep 23 14:53:39 devstack sudo[105683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:53:39 devstack sudo[105683]: pam_unix(sudo:session): session closed for user root Sep 23 14:53:39 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-120c7f69-83e5-439c-bb05-f3749722cc46 tempest-ProjectReaderTests-573888410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-56e1637b-9c54-4405-8b2b-e461c0e67548" returned: 0 in 0.340s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:53:39 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-120c7f69-83e5-439c-bb05-f3749722cc46 tempest-ProjectReaderTests-573888410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-56e1637b-9c54-4405-8b2b-e461c0e67548.d93a9257-db87-40e1-a36f-794b1dfa3f87 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:53:39 devstack sudo[105688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-56e1637b-9c54-4405-8b2b-e461c0e67548.d93a9257-db87-40e1-a36f-794b1dfa3f87 Sep 23 14:53:39 devstack sudo[105688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:53:40 devstack sudo[105688]: pam_unix(sudo:session): session closed for user root Sep 23 14:53:40 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-120c7f69-83e5-439c-bb05-f3749722cc46 tempest-ProjectReaderTests-573888410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-56e1637b-9c54-4405-8b2b-e461c0e67548.d93a9257-db87-40e1-a36f-794b1dfa3f87" returned: 0 in 0.327s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:53:40 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-120c7f69-83e5-439c-bb05-f3749722cc46 tempest-ProjectReaderTests-573888410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-56e1637b-9c54-4405-8b2b-e461c0e67548.d93a9257-db87-40e1-a36f-794b1dfa3f87 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:53:40 devstack sudo[105693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-56e1637b-9c54-4405-8b2b-e461c0e67548.d93a9257-db87-40e1-a36f-794b1dfa3f87 Sep 23 14:53:40 devstack sudo[105693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:53:40 devstack sudo[105693]: pam_unix(sudo:session): session closed for user root Sep 23 14:53:40 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-120c7f69-83e5-439c-bb05-f3749722cc46 tempest-ProjectReaderTests-573888410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-56e1637b-9c54-4405-8b2b-e461c0e67548.d93a9257-db87-40e1-a36f-794b1dfa3f87" returned: 0 in 0.251s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:53:40 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-120c7f69-83e5-439c-bb05-f3749722cc46 tempest-ProjectReaderTests-573888410 None] Lock "cinder-quobyte-d93a9257-db87-40e1-a36f-794b1dfa3f87" released by "_delete_snapshot" :: held 1.356s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:53:40 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-120c7f69-83e5-439c-bb05-f3749722cc46 tempest-ProjectReaderTests-573888410 None] Lock "cinder-quobyte-56e1637b-9c54-4405-8b2b-e461c0e67548" released by "delete_snapshot" :: held 1.381s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:53:40 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-120c7f69-83e5-439c-bb05-f3749722cc46 tempest-ProjectReaderTests-573888410 None] Created reservations ['518f25e3-c92a-4864-9a09-d9813c399daa', 'be7f8219-7069-4d03-b60c-ebb569d2e6ab', '54c1a337-7b37-4dd7-9044-764b88697432', '0cbc9bf8-fb3f-463b-a66a-845f66edac93'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:53:40 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-120c7f69-83e5-439c-bb05-f3749722cc46 tempest-ProjectReaderTests-573888410 None] Delete snapshot completed successfully. Sep 23 14:53:40 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-120c7f69-83e5-439c-bb05-f3749722cc46 tempest-ProjectReaderTests-573888410 None] Lock "cinder-d93a9257-db87-40e1-a36f-794b1dfa3f87-delete_snapshot" released by "delete_snapshot" :: held 1.519s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:53:41 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-72331629-9baf-486e-94ee-6f991e534c56 tempest-ProjectReaderTests-573888410 None] Acquiring lock "cinder-56e1637b-9c54-4405-8b2b-e461c0e67548-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:53:41 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-72331629-9baf-486e-94ee-6f991e534c56 tempest-ProjectReaderTests-573888410 None] Lock "cinder-56e1637b-9c54-4405-8b2b-e461c0e67548-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:53:41 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-72331629-9baf-486e-94ee-6f991e534c56 tempest-ProjectReaderTests-573888410 None] Acquiring lock "cinder-quobyte-56e1637b-9c54-4405-8b2b-e461c0e67548" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:53:41 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-72331629-9baf-486e-94ee-6f991e534c56 tempest-ProjectReaderTests-573888410 None] Lock "cinder-quobyte-56e1637b-9c54-4405-8b2b-e461c0e67548" acquired by "delete_volume" :: waited 0.015s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:53:41 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[40d6219b-5bbd-4ab3-a4bc-0e7f2e6ed0a1]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:53:41 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-72331629-9baf-486e-94ee-6f991e534c56 tempest-ProjectReaderTests-573888410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-56e1637b-9c54-4405-8b2b-e461c0e67548 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:53:41 devstack sudo[105696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-56e1637b-9c54-4405-8b2b-e461c0e67548 Sep 23 14:53:41 devstack sudo[105696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:53:41 devstack sudo[105696]: pam_unix(sudo:session): session closed for user root Sep 23 14:53:41 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-72331629-9baf-486e-94ee-6f991e534c56 tempest-ProjectReaderTests-573888410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-56e1637b-9c54-4405-8b2b-e461c0e67548" returned: 0 in 0.357s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:53:41 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-72331629-9baf-486e-94ee-6f991e534c56 tempest-ProjectReaderTests-573888410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-56e1637b-9c54-4405-8b2b-e461c0e67548 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:53:41 devstack sudo[105701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-56e1637b-9c54-4405-8b2b-e461c0e67548 Sep 23 14:53:41 devstack sudo[105701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:53:41 devstack sudo[105701]: pam_unix(sudo:session): session closed for user root Sep 23 14:53:41 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-72331629-9baf-486e-94ee-6f991e534c56 tempest-ProjectReaderTests-573888410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-56e1637b-9c54-4405-8b2b-e461c0e67548" returned: 0 in 0.244s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:53:41 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-72331629-9baf-486e-94ee-6f991e534c56 tempest-ProjectReaderTests-573888410 None] Lock "cinder-quobyte-56e1637b-9c54-4405-8b2b-e461c0e67548" released by "delete_volume" :: held 0.662s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:53:41 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-72331629-9baf-486e-94ee-6f991e534c56 tempest-ProjectReaderTests-573888410 None] Created reservations ['c1e83686-5d17-464e-821f-e5a714c57ed8', '9e8d44c5-abcd-466d-8fc7-2f9dbbc3aac4', '5886a357-1c10-4ac4-b29d-f956570e5bbf', '85f12ceb-5fe4-40e4-88d9-81822cf896d8'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:53:41 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-72331629-9baf-486e-94ee-6f991e534c56 tempest-ProjectReaderTests-573888410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:53:41 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-72331629-9baf-486e-94ee-6f991e534c56 tempest-ProjectReaderTests-573888410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:53:41 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-72331629-9baf-486e-94ee-6f991e534c56 tempest-ProjectReaderTests-573888410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:53:41 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-72331629-9baf-486e-94ee-6f991e534c56 tempest-ProjectReaderTests-573888410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:53:41 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-72331629-9baf-486e-94ee-6f991e534c56 tempest-ProjectReaderTests-573888410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:53:41 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-72331629-9baf-486e-94ee-6f991e534c56 tempest-ProjectReaderTests-573888410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:53:41 devstack sudo[105704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:53:41 devstack sudo[105704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:53:42 devstack sudo[105704]: pam_unix(sudo:session): session closed for user root Sep 23 14:53:42 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-72331629-9baf-486e-94ee-6f991e534c56 tempest-ProjectReaderTests-573888410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.234s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:53:42 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-72331629-9baf-486e-94ee-6f991e534c56 tempest-ProjectReaderTests-573888410 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:53:42 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-72331629-9baf-486e-94ee-6f991e534c56 tempest-ProjectReaderTests-573888410 None] Deleted volume successfully. Sep 23 14:53:42 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-72331629-9baf-486e-94ee-6f991e534c56 tempest-ProjectReaderTests-573888410 None] Lock "cinder-56e1637b-9c54-4405-8b2b-e461c0e67548-delete_volume" released by "delete_volume" :: held 1.082s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:53:51 devstack cinder-volume[86310]: DEBUG oslo_service.periodic_task [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86310) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 14:53:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:53:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:53:51 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:53:51 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:53:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:53:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:53:51 devstack sudo[105710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:53:51 devstack sudo[105710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:53:51 devstack sudo[105710]: pam_unix(sudo:session): session closed for user root Sep 23 14:53:51 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.253s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:53:51 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:53:51 devstack cinder-volume[86310]: DEBUG oslo_service.periodic_task [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] Running periodic task VolumeManager._thread_info {{(pid=86310) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 14:53:51 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] thread count: 28 {{(pid=86310) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 14:53:51 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-118c2065-4fb6-468c-861e-a2bca3dd1abc None None] thread info: [<_MainThread(MainThread, started 128854208852096)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86310) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 14:53:51 devstack cinder-volume[86310]: DEBUG dbcounter [-] [86310] Writing DB stats cinder:SELECT=118,cinder:INSERT=38,cinder:UPDATE=122,cinder:DELETE=14 {{(pid=86310) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 14:53:52 devstack cinder-volume[86310]: DEBUG dbcounter [-] [86310] Writing DB stats cinder:UPDATE=145,cinder:SELECT=84,cinder:INSERT=36,cinder:DELETE=8 {{(pid=86310) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 14:54:00 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2b5d38b-9aea-45a7-9738-b0d2ebcce8d0 tempest-ProjectReaderTests-1851707126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:54:00 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-c2b5d38b-9aea-45a7-9738-b0d2ebcce8d0 tempest-ProjectReaderTests-1851707126 None] Flow 'volume_create_manager' (e9aa5fae-e151-4718-af5e-be6d8849495c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:54:00 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-c2b5d38b-9aea-45a7-9738-b0d2ebcce8d0 tempest-ProjectReaderTests-1851707126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5816eeda-7ae0-4bfa-a29d-6dd39eb288f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:54:00 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-c2b5d38b-9aea-45a7-9738-b0d2ebcce8d0 tempest-ProjectReaderTests-1851707126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5816eeda-7ae0-4bfa-a29d-6dd39eb288f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:54:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1466820133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11f5eef6-2dad-45e4-b689-f1f9cb45daa2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0dfdea2e69e43be8fd4d5dc1ee889c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:54:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:54:00Z,use_quota=True,user_id='929efaffafc34a59ac5d3ae37277d60f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:54:00 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-c2b5d38b-9aea-45a7-9738-b0d2ebcce8d0 tempest-ProjectReaderTests-1851707126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df6da29f-09bd-4c57-8007-1868657090f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:54:00 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-c2b5d38b-9aea-45a7-9738-b0d2ebcce8d0 tempest-ProjectReaderTests-1851707126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df6da29f-09bd-4c57-8007-1868657090f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:54:00 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-c2b5d38b-9aea-45a7-9738-b0d2ebcce8d0 tempest-ProjectReaderTests-1851707126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (235bffe7-022f-4be8-b464-7938219dfb24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:54:00 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-c2b5d38b-9aea-45a7-9738-b0d2ebcce8d0 tempest-ProjectReaderTests-1851707126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (235bffe7-022f-4be8-b464-7938219dfb24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11f5eef6-2dad-45e4-b689-f1f9cb45daa2', 'volume_name': 'volume-11f5eef6-2dad-45e4-b689-f1f9cb45daa2', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:54:00 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-c2b5d38b-9aea-45a7-9738-b0d2ebcce8d0 tempest-ProjectReaderTests-1851707126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eaaa2ef2-f8aa-46b8-b319-6f34701a6236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:54:00 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-c2b5d38b-9aea-45a7-9738-b0d2ebcce8d0 tempest-ProjectReaderTests-1851707126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eaaa2ef2-f8aa-46b8-b319-6f34701a6236) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:54:00 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-c2b5d38b-9aea-45a7-9738-b0d2ebcce8d0 tempest-ProjectReaderTests-1851707126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aceaa94f-6ed7-4e1e-8fb7-bfb209fbf1fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:54:00 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-c2b5d38b-9aea-45a7-9738-b0d2ebcce8d0 tempest-ProjectReaderTests-1851707126 None] Volume 11f5eef6-2dad-45e4-b689-f1f9cb45daa2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11f5eef6-2dad-45e4-b689-f1f9cb45daa2', 'volume_size': 1} Sep 23 14:54:00 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-c2b5d38b-9aea-45a7-9738-b0d2ebcce8d0 tempest-ProjectReaderTests-1851707126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:54:00 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-c2b5d38b-9aea-45a7-9738-b0d2ebcce8d0 tempest-ProjectReaderTests-1851707126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:54:00 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-c2b5d38b-9aea-45a7-9738-b0d2ebcce8d0 tempest-ProjectReaderTests-1851707126 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:54:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1466820133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11f5eef6-2dad-45e4-b689-f1f9cb45daa2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0dfdea2e69e43be8fd4d5dc1ee889c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:54:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:54:00Z,use_quota=True,user_id='929efaffafc34a59ac5d3ae37277d60f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:54:00 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-c2b5d38b-9aea-45a7-9738-b0d2ebcce8d0 tempest-ProjectReaderTests-1851707126 None] Creating volume 11f5eef6-2dad-45e4-b689-f1f9cb45daa2 {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:54:00 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-c2b5d38b-9aea-45a7-9738-b0d2ebcce8d0 tempest-ProjectReaderTests-1851707126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:54:00 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-c2b5d38b-9aea-45a7-9738-b0d2ebcce8d0 tempest-ProjectReaderTests-1851707126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:54:00 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-c2b5d38b-9aea-45a7-9738-b0d2ebcce8d0 tempest-ProjectReaderTests-1851707126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:54:00 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-c2b5d38b-9aea-45a7-9738-b0d2ebcce8d0 tempest-ProjectReaderTests-1851707126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:54:00 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-c2b5d38b-9aea-45a7-9738-b0d2ebcce8d0 tempest-ProjectReaderTests-1851707126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:54:00 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-c2b5d38b-9aea-45a7-9738-b0d2ebcce8d0 tempest-ProjectReaderTests-1851707126 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:54:00 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-c2b5d38b-9aea-45a7-9738-b0d2ebcce8d0 tempest-ProjectReaderTests-1851707126 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:54:00 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-c2b5d38b-9aea-45a7-9738-b0d2ebcce8d0 tempest-ProjectReaderTests-1851707126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-11f5eef6-2dad-45e4-b689-f1f9cb45daa2 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:54:00 devstack sudo[105714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-11f5eef6-2dad-45e4-b689-f1f9cb45daa2 1073741824 Sep 23 14:54:00 devstack sudo[105714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:54:00 devstack sudo[105714]: pam_unix(sudo:session): session closed for user root Sep 23 14:54:00 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-c2b5d38b-9aea-45a7-9738-b0d2ebcce8d0 tempest-ProjectReaderTests-1851707126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-11f5eef6-2dad-45e4-b689-f1f9cb45daa2 1073741824" returned: 0 in 0.388s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:54:00 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-c2b5d38b-9aea-45a7-9738-b0d2ebcce8d0 tempest-ProjectReaderTests-1851707126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-11f5eef6-2dad-45e4-b689-f1f9cb45daa2 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:54:00 devstack sudo[105720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-11f5eef6-2dad-45e4-b689-f1f9cb45daa2 Sep 23 14:54:00 devstack sudo[105720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:54:01 devstack sudo[105720]: pam_unix(sudo:session): session closed for user root Sep 23 14:54:01 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-c2b5d38b-9aea-45a7-9738-b0d2ebcce8d0 tempest-ProjectReaderTests-1851707126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-11f5eef6-2dad-45e4-b689-f1f9cb45daa2" returned: 0 in 0.240s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:54:01 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-c2b5d38b-9aea-45a7-9738-b0d2ebcce8d0 tempest-ProjectReaderTests-1851707126 None] <== create_volume: return (666ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:54:01 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-c2b5d38b-9aea-45a7-9738-b0d2ebcce8d0 tempest-ProjectReaderTests-1851707126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.669s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:54:01 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-c2b5d38b-9aea-45a7-9738-b0d2ebcce8d0 tempest-ProjectReaderTests-1851707126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aceaa94f-6ed7-4e1e-8fb7-bfb209fbf1fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11f5eef6-2dad-45e4-b689-f1f9cb45daa2', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:54:01 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-c2b5d38b-9aea-45a7-9738-b0d2ebcce8d0 tempest-ProjectReaderTests-1851707126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (934dacf2-aee5-4994-8ec3-67fa2204e806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:54:01 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-c2b5d38b-9aea-45a7-9738-b0d2ebcce8d0 tempest-ProjectReaderTests-1851707126 None] Volume volume-11f5eef6-2dad-45e4-b689-f1f9cb45daa2 (11f5eef6-2dad-45e4-b689-f1f9cb45daa2): created successfully Sep 23 14:54:01 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-c2b5d38b-9aea-45a7-9738-b0d2ebcce8d0 tempest-ProjectReaderTests-1851707126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (934dacf2-aee5-4994-8ec3-67fa2204e806) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:54:01 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-c2b5d38b-9aea-45a7-9738-b0d2ebcce8d0 tempest-ProjectReaderTests-1851707126 None] Flow 'volume_create_manager' (e9aa5fae-e151-4718-af5e-be6d8849495c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:54:01 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-c2b5d38b-9aea-45a7-9738-b0d2ebcce8d0 tempest-ProjectReaderTests-1851707126 None] Created volume successfully. Sep 23 14:54:01 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-59469094-9ee4-49ed-a02a-1d13a2b615cf tempest-ProjectReaderTests-1851707126 None] Acquiring lock "cinder-11f5eef6-2dad-45e4-b689-f1f9cb45daa2-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:54:01 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-59469094-9ee4-49ed-a02a-1d13a2b615cf tempest-ProjectReaderTests-1851707126 None] Lock "cinder-11f5eef6-2dad-45e4-b689-f1f9cb45daa2-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:54:01 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-59469094-9ee4-49ed-a02a-1d13a2b615cf tempest-ProjectReaderTests-1851707126 None] Acquiring lock "cinder-quobyte-11f5eef6-2dad-45e4-b689-f1f9cb45daa2" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:54:01 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-59469094-9ee4-49ed-a02a-1d13a2b615cf tempest-ProjectReaderTests-1851707126 None] Lock "cinder-quobyte-11f5eef6-2dad-45e4-b689-f1f9cb45daa2" acquired by "delete_volume" :: waited 0.019s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:54:01 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[350faf26-a04c-4986-846f-afb7d19d8bf6]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:54:01 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-59469094-9ee4-49ed-a02a-1d13a2b615cf tempest-ProjectReaderTests-1851707126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-11f5eef6-2dad-45e4-b689-f1f9cb45daa2 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:54:01 devstack sudo[105723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-11f5eef6-2dad-45e4-b689-f1f9cb45daa2 Sep 23 14:54:01 devstack sudo[105723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:54:02 devstack sudo[105723]: pam_unix(sudo:session): session closed for user root Sep 23 14:54:02 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-59469094-9ee4-49ed-a02a-1d13a2b615cf tempest-ProjectReaderTests-1851707126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-11f5eef6-2dad-45e4-b689-f1f9cb45daa2" returned: 0 in 0.344s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:54:02 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-59469094-9ee4-49ed-a02a-1d13a2b615cf tempest-ProjectReaderTests-1851707126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-11f5eef6-2dad-45e4-b689-f1f9cb45daa2 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:54:02 devstack sudo[105728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-11f5eef6-2dad-45e4-b689-f1f9cb45daa2 Sep 23 14:54:02 devstack sudo[105728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:54:02 devstack sudo[105728]: pam_unix(sudo:session): session closed for user root Sep 23 14:54:02 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-59469094-9ee4-49ed-a02a-1d13a2b615cf tempest-ProjectReaderTests-1851707126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-11f5eef6-2dad-45e4-b689-f1f9cb45daa2" returned: 0 in 0.239s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:54:02 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-59469094-9ee4-49ed-a02a-1d13a2b615cf tempest-ProjectReaderTests-1851707126 None] Lock "cinder-quobyte-11f5eef6-2dad-45e4-b689-f1f9cb45daa2" released by "delete_volume" :: held 0.621s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:54:02 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-59469094-9ee4-49ed-a02a-1d13a2b615cf tempest-ProjectReaderTests-1851707126 None] Created reservations ['703258d7-c080-4bb3-8515-8989282c00fd', '6c79abe3-cfc1-4277-8008-c9fbe489bfef', '86b488f4-4a43-407f-b71e-731bd0fdb7d3', '3c4ca0bd-bc8e-4c50-83a4-a0f18345cd71'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:54:02 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-59469094-9ee4-49ed-a02a-1d13a2b615cf tempest-ProjectReaderTests-1851707126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:54:02 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-59469094-9ee4-49ed-a02a-1d13a2b615cf tempest-ProjectReaderTests-1851707126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:54:02 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-59469094-9ee4-49ed-a02a-1d13a2b615cf tempest-ProjectReaderTests-1851707126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:54:02 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-59469094-9ee4-49ed-a02a-1d13a2b615cf tempest-ProjectReaderTests-1851707126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:54:02 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-59469094-9ee4-49ed-a02a-1d13a2b615cf tempest-ProjectReaderTests-1851707126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:54:02 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-59469094-9ee4-49ed-a02a-1d13a2b615cf tempest-ProjectReaderTests-1851707126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:54:02 devstack sudo[105731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:54:02 devstack sudo[105731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:54:02 devstack sudo[105731]: pam_unix(sudo:session): session closed for user root Sep 23 14:54:02 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-59469094-9ee4-49ed-a02a-1d13a2b615cf tempest-ProjectReaderTests-1851707126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.224s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:54:02 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-59469094-9ee4-49ed-a02a-1d13a2b615cf tempest-ProjectReaderTests-1851707126 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:54:02 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-59469094-9ee4-49ed-a02a-1d13a2b615cf tempest-ProjectReaderTests-1851707126 None] Deleted volume successfully. Sep 23 14:54:02 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-59469094-9ee4-49ed-a02a-1d13a2b615cf tempest-ProjectReaderTests-1851707126 None] Lock "cinder-11f5eef6-2dad-45e4-b689-f1f9cb45daa2-delete_volume" released by "delete_volume" :: held 1.037s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:54:03 devstack cinder-volume[86310]: DEBUG cinder.volume.flows.manager.create_volume [None req-78655614-bdc9-427f-9872-4fe71bb27c65 tempest-ProjectReaderTests-1851707126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 14:54:03 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-78655614-bdc9-427f-9872-4fe71bb27c65 tempest-ProjectReaderTests-1851707126 None] Flow 'volume_create_manager' (a5988a8d-c972-4ece-89d2-0099da43c93f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:54:03 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-78655614-bdc9-427f-9872-4fe71bb27c65 tempest-ProjectReaderTests-1851707126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f698af86-4303-4cb9-89de-2e3b08e79026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:54:03 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-78655614-bdc9-427f-9872-4fe71bb27c65 tempest-ProjectReaderTests-1851707126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f698af86-4303-4cb9-89de-2e3b08e79026) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:54:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1691415020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3927dc62-b019-4b5a-a8f7-606a83295cc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0dfdea2e69e43be8fd4d5dc1ee889c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:54:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:54:03Z,use_quota=True,user_id='929efaffafc34a59ac5d3ae37277d60f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:54:03 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-78655614-bdc9-427f-9872-4fe71bb27c65 tempest-ProjectReaderTests-1851707126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (141c8bb6-23d9-4ae3-af81-67c191c59966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:54:03 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-78655614-bdc9-427f-9872-4fe71bb27c65 tempest-ProjectReaderTests-1851707126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (141c8bb6-23d9-4ae3-af81-67c191c59966) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:54:03 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-78655614-bdc9-427f-9872-4fe71bb27c65 tempest-ProjectReaderTests-1851707126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d16c2579-efd9-45e7-bf04-5c7f02239169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:54:03 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-78655614-bdc9-427f-9872-4fe71bb27c65 tempest-ProjectReaderTests-1851707126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d16c2579-efd9-45e7-bf04-5c7f02239169) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3927dc62-b019-4b5a-a8f7-606a83295cc5', 'volume_name': 'volume-3927dc62-b019-4b5a-a8f7-606a83295cc5', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:54:03 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-78655614-bdc9-427f-9872-4fe71bb27c65 tempest-ProjectReaderTests-1851707126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57a1423a-e99f-4085-a401-0c17f1de265b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:54:03 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-78655614-bdc9-427f-9872-4fe71bb27c65 tempest-ProjectReaderTests-1851707126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57a1423a-e99f-4085-a401-0c17f1de265b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:54:03 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-78655614-bdc9-427f-9872-4fe71bb27c65 tempest-ProjectReaderTests-1851707126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82b7cccd-952f-4109-9da0-23413e9255ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:54:03 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-78655614-bdc9-427f-9872-4fe71bb27c65 tempest-ProjectReaderTests-1851707126 None] Volume 3927dc62-b019-4b5a-a8f7-606a83295cc5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3927dc62-b019-4b5a-a8f7-606a83295cc5', 'volume_size': 1} Sep 23 14:54:03 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-78655614-bdc9-427f-9872-4fe71bb27c65 tempest-ProjectReaderTests-1851707126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:54:03 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-78655614-bdc9-427f-9872-4fe71bb27c65 tempest-ProjectReaderTests-1851707126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:54:03 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-78655614-bdc9-427f-9872-4fe71bb27c65 tempest-ProjectReaderTests-1851707126 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-23T12:54:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1691415020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3927dc62-b019-4b5a-a8f7-606a83295cc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0dfdea2e69e43be8fd4d5dc1ee889c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-23T12:54:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-23T12:54:03Z,use_quota=True,user_id='929efaffafc34a59ac5d3ae37277d60f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cba8eb3-1328-460c-a128-96ef91495a0a),volume_type_id=3cba8eb3-1328-460c-a128-96ef91495a0a)}" {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 14:54:03 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.remotefs [None req-78655614-bdc9-427f-9872-4fe71bb27c65 tempest-ProjectReaderTests-1851707126 None] Creating volume 3927dc62-b019-4b5a-a8f7-606a83295cc5 {{(pid=86310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 14:54:03 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-78655614-bdc9-427f-9872-4fe71bb27c65 tempest-ProjectReaderTests-1851707126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:54:03 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-78655614-bdc9-427f-9872-4fe71bb27c65 tempest-ProjectReaderTests-1851707126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:54:03 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-78655614-bdc9-427f-9872-4fe71bb27c65 tempest-ProjectReaderTests-1851707126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:54:03 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-78655614-bdc9-427f-9872-4fe71bb27c65 tempest-ProjectReaderTests-1851707126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:54:03 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-78655614-bdc9-427f-9872-4fe71bb27c65 tempest-ProjectReaderTests-1851707126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:54:03 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-78655614-bdc9-427f-9872-4fe71bb27c65 tempest-ProjectReaderTests-1851707126 None] Selected osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 as target Quobyte volume. {{(pid=86310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 14:54:03 devstack cinder-volume[86310]: INFO cinder.volume.drivers.remotefs [None req-78655614-bdc9-427f-9872-4fe71bb27c65 tempest-ProjectReaderTests-1851707126 None] casted to osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362 Sep 23 14:54:03 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-78655614-bdc9-427f-9872-4fe71bb27c65 tempest-ProjectReaderTests-1851707126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-3927dc62-b019-4b5a-a8f7-606a83295cc5 1073741824 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:54:03 devstack sudo[105735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-3927dc62-b019-4b5a-a8f7-606a83295cc5 1073741824 Sep 23 14:54:03 devstack sudo[105735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:54:03 devstack sudo[105735]: pam_unix(sudo:session): session closed for user root Sep 23 14:54:03 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-78655614-bdc9-427f-9872-4fe71bb27c65 tempest-ProjectReaderTests-1851707126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-3927dc62-b019-4b5a-a8f7-606a83295cc5 1073741824" returned: 0 in 0.398s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:54:03 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-78655614-bdc9-427f-9872-4fe71bb27c65 tempest-ProjectReaderTests-1851707126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-3927dc62-b019-4b5a-a8f7-606a83295cc5 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:54:03 devstack sudo[105741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-3927dc62-b019-4b5a-a8f7-606a83295cc5 Sep 23 14:54:03 devstack sudo[105741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:54:03 devstack sudo[105741]: pam_unix(sudo:session): session closed for user root Sep 23 14:54:03 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-78655614-bdc9-427f-9872-4fe71bb27c65 tempest-ProjectReaderTests-1851707126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-3927dc62-b019-4b5a-a8f7-606a83295cc5" returned: 0 in 0.234s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:54:03 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-78655614-bdc9-427f-9872-4fe71bb27c65 tempest-ProjectReaderTests-1851707126 None] <== create_volume: return (671ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'} {{(pid=86310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 14:54:03 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-78655614-bdc9-427f-9872-4fe71bb27c65 tempest-ProjectReaderTests-1851707126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.673s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:54:03 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-78655614-bdc9-427f-9872-4fe71bb27c65 tempest-ProjectReaderTests-1851707126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82b7cccd-952f-4109-9da0-23413e9255ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3927dc62-b019-4b5a-a8f7-606a83295cc5', 'volume_size': 1}' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:54:03 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-78655614-bdc9-427f-9872-4fe71bb27c65 tempest-ProjectReaderTests-1851707126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (026bf1a5-53f1-4fad-8351-8ef23f753655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 14:54:03 devstack cinder-volume[86310]: INFO cinder.volume.flows.manager.create_volume [None req-78655614-bdc9-427f-9872-4fe71bb27c65 tempest-ProjectReaderTests-1851707126 None] Volume volume-3927dc62-b019-4b5a-a8f7-606a83295cc5 (3927dc62-b019-4b5a-a8f7-606a83295cc5): created successfully Sep 23 14:54:03 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-78655614-bdc9-427f-9872-4fe71bb27c65 tempest-ProjectReaderTests-1851707126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (026bf1a5-53f1-4fad-8351-8ef23f753655) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86310) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 14:54:03 devstack cinder-volume[86310]: DEBUG cinder.volume.manager [None req-78655614-bdc9-427f-9872-4fe71bb27c65 tempest-ProjectReaderTests-1851707126 None] Flow 'volume_create_manager' (a5988a8d-c972-4ece-89d2-0099da43c93f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86310) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 14:54:03 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-78655614-bdc9-427f-9872-4fe71bb27c65 tempest-ProjectReaderTests-1851707126 None] Created volume successfully. Sep 23 14:54:04 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-90543293-523d-4019-9a9e-1b8955c434a6 tempest-ProjectReaderTests-1851707126 None] Acquiring lock "cinder-3927dc62-b019-4b5a-a8f7-606a83295cc5-delete_volume" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:54:04 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-90543293-523d-4019-9a9e-1b8955c434a6 tempest-ProjectReaderTests-1851707126 None] Lock "cinder-3927dc62-b019-4b5a-a8f7-606a83295cc5-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:54:04 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-90543293-523d-4019-9a9e-1b8955c434a6 tempest-ProjectReaderTests-1851707126 None] Acquiring lock "cinder-quobyte-3927dc62-b019-4b5a-a8f7-606a83295cc5" by "delete_volume" {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 14:54:04 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-90543293-523d-4019-9a9e-1b8955c434a6 tempest-ProjectReaderTests-1851707126 None] Lock "cinder-quobyte-3927dc62-b019-4b5a-a8f7-606a83295cc5" acquired by "delete_volume" :: waited 0.013s {{(pid=86310) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 14:54:04 devstack cinder-volume[86310]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1e6744c-2c7a-4885-8d6f-d96a23257dcc]: (4, 'qcow2') {{(pid=87848) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 14:54:04 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-90543293-523d-4019-9a9e-1b8955c434a6 tempest-ProjectReaderTests-1851707126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-3927dc62-b019-4b5a-a8f7-606a83295cc5 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:54:04 devstack sudo[105744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-3927dc62-b019-4b5a-a8f7-606a83295cc5 Sep 23 14:54:04 devstack sudo[105744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:54:04 devstack sudo[105744]: pam_unix(sudo:session): session closed for user root Sep 23 14:54:04 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-90543293-523d-4019-9a9e-1b8955c434a6 tempest-ProjectReaderTests-1851707126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-3927dc62-b019-4b5a-a8f7-606a83295cc5" returned: 0 in 0.355s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:54:04 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-90543293-523d-4019-9a9e-1b8955c434a6 tempest-ProjectReaderTests-1851707126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-3927dc62-b019-4b5a-a8f7-606a83295cc5 {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:54:04 devstack sudo[105749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-3927dc62-b019-4b5a-a8f7-606a83295cc5 Sep 23 14:54:04 devstack sudo[105749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:54:04 devstack sudo[105749]: pam_unix(sudo:session): session closed for user root Sep 23 14:54:04 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-90543293-523d-4019-9a9e-1b8955c434a6 tempest-ProjectReaderTests-1851707126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd/volume-3927dc62-b019-4b5a-a8f7-606a83295cc5" returned: 0 in 0.233s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:54:04 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-90543293-523d-4019-9a9e-1b8955c434a6 tempest-ProjectReaderTests-1851707126 None] Lock "cinder-quobyte-3927dc62-b019-4b5a-a8f7-606a83295cc5" released by "delete_volume" :: held 0.625s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:54:04 devstack cinder-volume[86310]: DEBUG cinder.quota [None req-90543293-523d-4019-9a9e-1b8955c434a6 tempest-ProjectReaderTests-1851707126 None] Created reservations ['6c026f5b-bff0-4b98-b2ab-151c9153991c', '6222b8dc-4878-490a-93a9-caf4a92ce101', 'f03fcefd-1c06-4dfc-b553-4ae02dbd6dcd', '647ded35-f679-4a4a-a824-bee90458c7b9'] {{(pid=86310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 23 14:54:04 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-90543293-523d-4019-9a9e-1b8955c434a6 tempest-ProjectReaderTests-1851707126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 14:54:04 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-90543293-523d-4019-9a9e-1b8955c434a6 tempest-ProjectReaderTests-1851707126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 14:54:04 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-90543293-523d-4019-9a9e-1b8955c434a6 tempest-ProjectReaderTests-1851707126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362': None} {{(pid=86310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 14:54:04 devstack cinder-volume[86310]: DEBUG cinder.volume.drivers.quobyte [None req-90543293-523d-4019-9a9e-1b8955c434a6 tempest-ProjectReaderTests-1851707126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acbeaaba-b855-4ad2-8be3-c2e59f9bf362'] {{(pid=86310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 14:54:04 devstack cinder-volume[86310]: DEBUG oslo_concurrency.lockutils [None req-90543293-523d-4019-9a9e-1b8955c434a6 tempest-ProjectReaderTests-1851707126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86310) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 14:54:04 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-90543293-523d-4019-9a9e-1b8955c434a6 tempest-ProjectReaderTests-1851707126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 14:54:05 devstack sudo[105752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd Sep 23 14:54:05 devstack sudo[105752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 14:54:05 devstack sudo[105752]: pam_unix(sudo:session): session closed for user root Sep 23 14:54:05 devstack cinder-volume[86310]: DEBUG oslo_concurrency.processutils [None req-90543293-523d-4019-9a9e-1b8955c434a6 tempest-ProjectReaderTests-1851707126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/263e9f484776f18f7505a65bae41aabd" returned: 0 in 0.226s {{(pid=86310) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 14:54:05 devstack cinder-volume[86310]: DEBUG cinder.manager [None req-90543293-523d-4019-9a9e-1b8955c434a6 tempest-ProjectReaderTests-1851707126 None] Notifying Schedulers of capabilities ... {{(pid=86310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 14:54:05 devstack cinder-volume[86310]: INFO cinder.volume.manager [None req-90543293-523d-4019-9a9e-1b8955c434a6 tempest-ProjectReaderTests-1851707126 None] Deleted volume successfully. Sep 23 14:54:05 devstack cinder-volume[86310]: DEBUG cinder.coordination [None req-90543293-523d-4019-9a9e-1b8955c434a6 tempest-ProjectReaderTests-1851707126 None] Lock "cinder-3927dc62-b019-4b5a-a8f7-606a83295cc5-delete_volume" released by "delete_volume" :: held 1.029s {{(pid=86310) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 14:54:14 devstack cinder-volume[86310]: DEBUG dbcounter [-] [86310] Writing DB stats cinder:UPDATE=24,cinder:SELECT=11,cinder:INSERT=5,cinder:DELETE=3 {{(pid=86310) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 14:54:15 devstack cinder-volume[86310]: DEBUG dbcounter [-] [86310] Writing DB stats cinder:SELECT=17,cinder:UPDATE=20,cinder:INSERT=5,cinder:DELETE=1 {{(pid=86310) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}